swh-lister/swh/lister
David Douard 3816b4d3bf cgit: rewrite the CGit lister
Simplify the code:
- do only inherit from ListerBase
- implement HTTP queries directly using requests
- get rid of convoluted code

Make the origin_url gathered from the git repo's "project" page instead of
building it from the 'url_prefix' hack. Now, the lister WILL make substancially
more requests, since it will make one request per listed git repo, but
the provided origin_url should be pretty reliable now.

When several url are provided as clonable URLs, choose the http/https one first,
otherwise, choose the first one of the list.

Add proper tests for the cgit lister.

Also, get rid of the 'time_updated' column in the model.
2019-09-02 12:29:31 +02:00
..
bitbucket bitbucket: simplify a bit BitBucketLister's constructor 2019-08-30 17:56:19 +02:00
cgit cgit: rewrite the CGit lister 2019-09-02 12:29:31 +02:00
core core: move credentials' docstring from request_params to request_instance_credentials 2019-08-30 17:56:19 +02:00
cran listers: Allow to override policy and priority for scheduled tasks 2019-08-28 11:57:10 +02:00
debian Drop SWH prefix in classes everywhere 2019-06-20 19:08:46 +02:00
github lister: Type correctly the 'indexable' column 2019-06-26 10:58:54 +02:00
gitlab Finish dropping the 'description' column. 2019-06-26 14:46:27 +02:00
gnu listers: Allow to override policy and priority for scheduled tasks 2019-08-28 11:57:10 +02:00
npm lister: Type correctly the 'indexable' column 2019-06-26 10:58:54 +02:00
packagist listers: Allow to override policy and priority for scheduled tasks 2019-08-28 11:57:10 +02:00
phabricator phabricator: randomly select the API token in the provided list 2019-08-30 17:56:19 +02:00
pypi listers: Allow to override policy and priority for scheduled tasks 2019-08-28 11:57:10 +02:00
tests cgit: rewrite the CGit lister 2019-09-02 12:29:31 +02:00
__init__.py Add missing __init__.py files 2017-10-30 16:38:27 +01:00
cli.py cgit: rewrite the CGit lister 2019-09-02 12:29:31 +02:00
utils.py gitlab.lister: Simplify retrieving headers information 2018-07-16 13:57:34 +02:00