reonokiy/swh-lister
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
swh-lister/swh/lister
History
Antoine Lambert db6ce12e9e Refactor and deduplicate HTTP requests code in listers 
Numerous listers were using the same page_request method or equivalent
in their implementation so prefer to deduplicate that code by adding
an http_request method in base lister class: swh.lister.pattern.Lister.

That method simply wraps a call to requests.Session.request and logs
some useful info for debugging and error reporting, also an HTTPError
will be raised if a request ends up with an error.

All listers using that new method now benefit of requests retry when
an HTTP error occurs thanks to the use of the http_retry decorator.
2022-09-26 10:48:40 +02:00
..
arch Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
aur Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
bitbucket Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
bower Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
cgit Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
cran python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
crates tests: Simplify origin comparison and improve pytest diff on failure 2022-08-24 17:21:24 +02:00
debian Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
gitea Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
github Use swh.core.github.pytest_plugin in github tests 2022-05-20 16:06:11 +02:00
gitlab Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
gnu python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
gogs Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
golang Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
launchpad Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
maven Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
npm Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
opam python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
packagist Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
phabricator Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
pubdev Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
pypi Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
sourceforge Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
tests Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00
tuleap Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
__init__.py Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
cli.py python: Reformat code with black 22.3.0 2022-04-08 15:15:09 +02:00
pattern.py Refactor and deduplicate HTTP requests code in listers 2022-09-26 10:48:40 +02:00
py.typed typing: minimal changes to make a no-op mypy run pass 2019-10-28 15:35:21 +01:00
utils.py Use generic HTTP retry policy by default and rename dedicated decorator 2022-09-26 10:48:40 +02:00