reonokiy/swh-lister
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
swh-lister/swh/lister
History
Antoine Lambert 4f6b3f3f09 conda: Yield listed origins after all artifacts in a page are processed 
swh-scheduler will deduplicate listed origins according to their URL
and visit type but not according to their extra loader arguments.

Previously, listed origins were yielded after each processed artifact
in a page so we could lose some package version info due to the
deduplication process.

So ensure to yield listed origins once all artifacts in a page have
been processed.
2022-10-25 10:49:52 +02:00
..
arch Send package artifact checksums to loaders when info is available 2022-09-30 18:44:11 +02:00
aur Update instructions for running a lister in docker 2022-09-29 11:26:40 +02:00
bitbucket Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
bower Update instructions for running a lister in docker 2022-09-29 11:26:40 +02:00
cgit cgit/tests: Rename readme.md to readme 2022-09-26 13:22:10 +02:00
conda conda: Yield listed origins after all artifacts in a page are processed 2022-10-25 10:49:52 +02:00
cpan cpan: Fix module version extraction for some edge cases 2022-10-11 15:24:34 +02:00
cran Send package artifact checksums to loaders when info is available 2022-09-30 18:44:11 +02:00
crates Crates.io: Add last_update for each version of a crate 2022-10-05 17:10:28 +02:00
debian debian: Remove no longer needed code to get accurate origins count 2022-09-29 11:14:42 +02:00
gitea gogs/lister: Allow public gogs instance listing 2022-10-21 18:21:18 +02:00
github Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
gitlab Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
gnu nixguix: Add lister 2022-10-03 18:26:36 +02:00
gogs gogs/lister: Allow public gogs instance listing 2022-10-21 18:21:18 +02:00
golang Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
hackage Hackage: List origins from hackage.haskell.org, The Haskell Package Repository 2022-09-27 14:22:03 +02:00
launchpad Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
maven maven: Use real data from github API + rely on requests_mock_datadir 2022-10-13 18:28:17 +02:00
nixguix Add support for more tarball recognition based on extensions 2022-10-25 09:50:31 +02:00
npm Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
nuget Nuget: Lister for NuGet the package manager for .NET 2022-09-27 14:56:36 +02:00
opam python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
packagist packagist: Canonicalize github origins 2022-10-13 17:14:58 +02:00
phabricator Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
pubdev Update instructions for running a lister in docker 2022-09-29 11:26:40 +02:00
puppet Send package artifact checksums to loaders when info is available 2022-09-30 18:44:11 +02:00
pypi Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
rubygems rubygems: Fix debug log 2022-10-13 16:40:35 +02:00
sourceforge Update value of User-Agent HTTP request header used by listers 2022-09-26 10:48:40 +02:00
tests nixguix: Register task 2022-10-03 18:26:36 +02:00
tuleap Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
__init__.py Add support for more tarball recognition based on extensions 2022-10-25 09:50:31 +02:00
cli.py python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
pattern.py pattern: Ensure accurate origin counts returned by run method 2022-09-29 11:14:08 +02:00
py.typed typing: minimal changes to make a no-op mypy run pass 2019-10-28 15:35:21 +01:00
utils.py Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00