reonokiy/swh-lister
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

pattern: Bump packet split to chunk of 1000 records

Browse source 
Listers like github and bitbucket should not be impacted as they already list 1000
records per page.
This commit is contained in:
Antoine R. Dumont (@ardumont) 2021-01-29 16:55:29 +01:00
parent 2e22073558
commit 003cf5491f
No known key found for this signature in database
GPG key ID: 52E2E9840D10C3B8
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
swh/lister/pattern.py
View file

@ -223,7 +223,7 @@ class Lister(Generic[StateType, PageType]):
the number of listed origins recorded in the scheduler
"""
count = 0
for batch_origins in grouper(origins, n=100):
for batch_origins in grouper(origins, n=1000):
ret = self.scheduler.record_listed_origins(batch_origins)
count += len(ret)