Commit graph

9 commits

Author SHA1 Message Date
Antoine Lambert
edef3b850c
Apply swh-py-template v0.3.3 with copier
Bump development tools: mypy, codespell, isort, ...

Move all tools configuration in pyproject.toml.

Remove no longer needed mypy overrides.
2025-02-17 13:44:24 +01:00
Antoine Lambert
af24960bc2 Add save-bulk lister to check origins prior their insertion in database
This new and special lister enables to verify a list of origins to archive
provided by users (for instance through the Web API).

Its purpose is to avoid polluting the scheduler database with origins that
cannot be loaded into the archive.

Each origin is identified by an URL and a visit type. For a given visit type
the lister is checking if the origin URL can be found and if the visit type
is valid.

The supported visit types are those for VCS (bzr, cvs, hg, git and svn) plus
the one for loading a tarball content into the archive.

Accepted origins are inserted or upserted in the scheduler database.

Rejected origins are stored in the lister state.

Related to #4709
2024-09-04 10:42:23 +02:00
David Douard
c6baacbcd7 Apply swh-py-template v0.2.3 2024-08-27 16:25:53 +02:00
Jérémy Bobbio (Lunar)
d70dd84939 Fix the listing of listers
Commit c2402f405f renamed the entry points from `lister.*` without
updating the rest of the framework. Revert the changes (and sort the
list alphabetically).
2024-01-10 17:46:23 +01:00
Franck Bret
4b1f49ac22 Adapt and rebase
'url' and 'instance' are mandatory
Add elm lister entry to pyproject.toml
2024-01-09 14:05:56 +01:00
David Douard
ac52cfed21 Apply swh-py-template 0.1.6 2023-12-03 17:54:52 +01:00
David Douard
c2402f405f Migrate to copier-based swh-py-template 2023-11-29 17:23:28 +01:00
Antoine Lambert
d24846a957 pre-commit: Add isort hook and configuration
Related to T2610
2020-09-17 17:48:25 +02:00
David Douard
29325c1d94 Add a pyproject.toml file to target py37 for black 2020-04-08 22:16:53 +02:00