swh-lister/swh
Antoine R. Dumont (@ardumont) 0ad37740d9
pattern: Make lister flush regularly origins to scheduler
As origins is a generator, the previous behavior would try to consume the overall
generator to send the records.

This groups and sends batch of 100 origins to the scheduler for writing.

Related to T3003
2021-01-28 16:52:03 +01:00
..
lister pattern: Make lister flush regularly origins to scheduler 2021-01-28 16:52:03 +01:00
__init__.py typing: minimal changes to make a no-op mypy run pass 2019-10-28 15:35:21 +01:00