swh-lister/swh
Antoine R. Dumont (@ardumont) 920ed0d529
lister.pattern: Restore flushing origin batch in the scheduler
Prior to this commit, the newly introduced check on url validity was consuming the
stream of origins. In effect, this would no longer write origin records regularly.

For all listers, that would translate to flush origins only at the end of the listing
which could take a while for some (e.g. packagist lister has been running for more than
12h currently without writing anything in the scheduler).
2023-08-01 10:04:48 +02:00
..
lister lister.pattern: Restore flushing origin batch in the scheduler 2023-08-01 10:04:48 +02:00
__init__.py Pin mypy and drop type annotations which makes mypy unhappy 2021-12-16 16:10:20 +01:00