swh-lister/swh/lister
Raphaël Gomès 9ca5295a40 sourceforge: retry for all retryable exceptions
Since this lister is doing a lot more requests than most other, it makes
sense that issues would arise more often. We want the lister to continue
even if the website is having issues and not break on the first 500 or
closed connection it encounters.

This change introduces a mechanism to retry all exceptions worth
retrying and uses it for the SourceForge lister. Other listers might
benefit from this, but this is out of scope here.

Tests had to be adjusted to stub the sleep function since retries happened
way more often.
2021-05-26 12:05:39 +02:00
..
bitbucket s/REST( API)?/API/ 2021-04-27 18:13:13 +02:00
cgit cgit: remove the repository urls's trailing / 2021-02-01 17:31:08 +01:00
cran cran: Prevent multiple listing of an origin 2021-02-05 14:34:37 +01:00
debian debian: Update archive mirror URL templates to process 2021-02-08 14:01:59 +01:00
gitea Remove no longer used models field in dict returned by register 2021-02-02 16:33:52 +01:00
github GitHub: handle edge cases with empty responses 2021-03-19 16:53:52 +01:00
gitlab gitlab: Deal with missing or trailing / in url input 2021-01-28 10:46:58 +01:00
gnu gnu: Remove dependency on pytz 2021-02-02 13:19:04 +01:00
launchpad launchpad: Remove call to dataclasses.asdict on lister state 2021-01-28 19:17:58 +01:00
npm Remove no longer used models field in dict returned by register 2021-02-02 16:33:52 +01:00
packagist packagist: Reimplement lister using new Lister API 2021-02-02 14:48:47 +01:00
phabricator Remove no longer used models field in dict returned by register 2021-02-02 16:33:52 +01:00
pypi pypi: Use BeautifulSoup for parsing HTML instead of xmltodict 2021-02-05 14:23:11 +01:00
sourceforge sourceforge: retry for all retryable exceptions 2021-05-26 12:05:39 +02:00
tests Remove no longer used legacy Lister API and update CLI options 2021-02-02 15:54:55 +01:00
__init__.py Hook up listers implemented with the new pattern to the CLI 2021-01-11 11:00:29 +01:00
cli.py Remove no longer used legacy Lister API and update CLI options 2021-02-02 15:54:55 +01:00
pattern.py Fix various Sphinx warnings 2021-04-13 21:56:08 +02:00
py.typed typing: minimal changes to make a no-op mypy run pass 2019-10-28 15:35:21 +01:00
utils.py sourceforge: retry for all retryable exceptions 2021-05-26 12:05:39 +02:00