swh-lister/swh/lister
David Douard bd11830328 cgit: reduce the batch size to 10 and add a bit of logging
Since the CGit lister now perform an HTTP query for each git repos listed in
the main index, it is significantly slower, so reducing the time between
database commits make sense, and won't overload the database.

With a bit of logging, it makes it easier to follow/debug the progress of
a listing.
2019-09-04 15:37:40 +02:00
..
bitbucket plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
cgit cgit: reduce the batch size to 10 and add a bit of logging 2019-09-04 15:37:40 +02:00
core implement listers as plugins 2019-09-03 15:02:24 +02:00
cran plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
debian plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
github plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
gitlab plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
gnu plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
npm plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
packagist plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
phabricator plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
pypi plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
tests plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
__init__.py Add missing __init__.py files 2017-10-30 16:38:27 +01:00
cli.py plugins: add support for scheduler's task-type declaration 2019-09-04 15:36:08 +02:00
utils.py gitlab.lister: Simplify retrieving headers information 2018-07-16 13:57:34 +02:00