swh-lister/swh
Franck Bret 4a09f660b3 Crates.io: Add last_update for each version of a crate
In order to reduce http api call amount made by the loader, download a
crates.io database dump, and parse its csv files to get a last_update
value for each versions of a Crate.
Those values are sent to the loader through extra_loader_arguments
'crates_metadata'.

'artifacts' and 'crates_metadata' now uses "version" as key.

Related T4104, D8171
2022-10-05 17:10:28 +02:00
..
lister Crates.io: Add last_update for each version of a crate 2022-10-05 17:10:28 +02:00
__init__.py Pin mypy and drop type annotations which makes mypy unhappy 2021-12-16 16:10:20 +01:00