swh-lister/swh
Nicolas Dandrimont c574897e2a Guesstimate partition boundaries from extrema rather than using expensive offsets
Summary:
Using order by and offset makes the partitioning a n^2 operation on the number
of entries in the table, rather than an instant operation when using
min/max.

This assumes the indexable column is more or less uniform, which is not exactly
true but not the worst approximation either.

Test Plan: tox

Reviewers: #reviewers, douardda

Reviewed By: #reviewers, douardda

Subscribers: douardda, swh-public-ci

Differential Revision: https://forge.softwareheritage.org/D1267
2019-03-19 13:51:38 +01:00
..
lister Guesstimate partition boundaries from extrema rather than using expensive offsets 2019-03-19 13:51:38 +01:00
__init__.py Cleanup packaging 2017-10-12 17:16:49 +02:00