swh-lister/swh/lister/crates
Franck Bret 4a09f660b3 Crates.io: Add last_update for each version of a crate
In order to reduce http api call amount made by the loader, download a
crates.io database dump, and parse its csv files to get a last_update
value for each versions of a Crate.
Those values are sent to the loader through extra_loader_arguments
'crates_metadata'.

'artifacts' and 'crates_metadata' now uses "version" as key.

Related T4104, D8171
2022-10-05 17:10:28 +02:00
..
tests Crates.io: Add last_update for each version of a crate 2022-10-05 17:10:28 +02:00
__init__.py Crates.io: Add last_update for each version of a crate 2022-10-05 17:10:28 +02:00
lister.py Crates.io: Add last_update for each version of a crate 2022-10-05 17:10:28 +02:00
tasks.py lister: Add new rust crates lister 2022-03-28 08:42:31 +02:00