swh-lister/swh/lister
Franck Bret ea146ce297 Nuget: Implement incremental listing
The lister is incremental and based on the value of ``commitTimeStamp`` retrieved on index http api endpoint.

Related T1718
2022-11-14 09:30:54 +01:00
..
arch Send package artifact checksums to loaders when info is available 2022-09-30 18:44:11 +02:00
aur Update instructions for running a lister in docker 2022-09-29 11:26:40 +02:00
bitbucket Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
bower Update instructions for running a lister in docker 2022-09-29 11:26:40 +02:00
cgit cgit/tests: Rename readme.md to readme 2022-09-26 13:22:10 +02:00
conda conda: Yield listed origins after all artifacts in a page are processed 2022-10-25 10:49:52 +02:00
cpan cpan: Fix module version extraction for some edge cases 2022-10-11 15:24:34 +02:00
cran Send package artifact checksums to loaders when info is available 2022-09-30 18:44:11 +02:00
crates Crates.io: Add last_update for each version of a crate 2022-10-05 17:10:28 +02:00
debian debian: Remove no longer needed code to get accurate origins count 2022-09-29 11:14:42 +02:00
gitea gogs/lister: Allow public gogs instance listing 2022-10-21 18:21:18 +02:00
github lister: Make sure lister that requires github tokens can use it 2022-10-26 17:23:40 +02:00
gitlab Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
gnu nixguix: Add lister 2022-10-03 18:26:36 +02:00
gogs gogs/lister: Allow public gogs instance listing 2022-10-21 18:21:18 +02:00
golang Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
hackage Hackage: List origins from hackage.haskell.org, The Haskell Package Repository 2022-09-27 14:22:03 +02:00
launchpad Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
maven Validate origin URLs before sending to the scheduler 2022-11-04 15:58:45 +01:00
nixguix nixguix: Reject Git SSH URLs and pseudo-URLs 2022-11-04 15:58:50 +01:00
npm Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
nuget Nuget: Implement incremental listing 2022-11-14 09:30:54 +01:00
opam Validate origin URLs before sending to the scheduler 2022-11-04 15:58:45 +01:00
packagist Validate origin URLs before sending to the scheduler 2022-11-04 15:58:45 +01:00
phabricator Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
pubdev pubdev: Update outdated lister documentation 2022-10-28 11:22:15 +02:00
puppet Puppet: Lister implements incremental mode 2022-11-08 14:29:07 +01:00
pypi Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
rubygems rubygems: Fix debug log 2022-10-13 16:40:35 +02:00
sourceforge Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
tests nixguix: Register task 2022-10-03 18:26:36 +02:00
tuleap Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
__init__.py Add support for more tarball recognition based on extensions 2022-10-25 09:50:31 +02:00
cli.py python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
pattern.py Validate origin URLs before sending to the scheduler 2022-11-04 15:58:45 +01:00
py.typed typing: minimal changes to make a no-op mypy run pass 2019-10-28 15:35:21 +01:00
utils.py Validate origin URLs before sending to the scheduler 2022-11-04 15:58:45 +01:00