Stefano Zacchiroli
|
df469d01d2
|
update-github-list: do not compute stats after update
they forced configuration duplication, and were redundant anyhow
|
2015-09-10 18:16:29 +02:00 |
|
Stefano Zacchiroli
|
fca6397cdf
|
ghlister: PEP8 fixes
also: prefer lexer-time string concatenations to runtime ones
|
2015-09-10 18:12:28 +02:00 |
|
Stefano Zacchiroli
|
a97a2953c8
|
ghlister: remove unused constant CACHE_DIR
since quite a while cache dir is set via the conffile only
|
2015-09-10 18:11:31 +02:00 |
|
Stefano Zacchiroli
|
8768c60ddf
|
etc/: check-in sample crontab
|
2015-09-10 18:10:32 +02:00 |
|
Stefano Zacchiroli
|
802baf6425
|
crawler.sql: add crawl_history table
|
2015-07-07 11:31:21 +02:00 |
|
Stefano Zacchiroli
|
752e23eb4b
|
SQL: move stuff not strictly related to ghlister to crawler.sql
|
2015-07-07 11:07:19 +02:00 |
|
Stefano Zacchiroli
|
df959dd584
|
pimp_db: add plpgsql function list some well-known repos
|
2015-07-03 00:15:36 +02:00 |
|
Stefano Zacchiroli
|
f1adec6fde
|
pimp_db: add plpgsql function to extract random repos sample
|
2015-07-02 18:04:30 +02:00 |
|
Stefano Zacchiroli
|
48f93a9307
|
sql: add view to monitor daily repository creations
|
2015-05-08 15:11:17 +02:00 |
|
Stefano Zacchiroli
|
ce3f9fd17f
|
bin/update-github-list: cron updater script
|
2015-04-30 12:39:44 +02:00 |
|
Stefano Zacchiroli
|
5bd3ab91f3
|
sql: add repos_history table
|
2015-04-30 12:39:32 +02:00 |
|
Stefano Zacchiroli
|
c093e81c23
|
README: document dependency on psycopg2
|
2015-04-29 20:13:10 +02:00 |
|
Stefano Zacchiroli
|
059b323341
|
new TODO item: split cache dir in subdirs
|
2015-04-29 12:00:45 +02:00 |
|
Stefano Zacchiroli
|
011ce383e2
|
ghlister: fail when no action is given
|
2015-04-29 11:08:28 +02:00 |
|
Stefano Zacchiroli
|
944d4a9c49
|
ghlister: add "catchup" action to continue from last time
|
2015-04-29 11:05:28 +02:00 |
|
Stefano Zacchiroli
|
e564aa3fa5
|
add TODO list
|
2015-04-29 08:55:13 +02:00 |
|
Stefano Zacchiroli
|
647a780764
|
add SQL info on how to pimp the DB
|
2015-04-29 08:54:46 +02:00 |
|
Stefano Zacchiroli
|
c51c86a735
|
status: local change, connect to the right pgsql cluster
|
2015-04-28 10:31:56 +02:00 |
|
Stefano Zacchiroli
|
a65ab0cf2a
|
bin/batch: add support for continuing from last id
|
2015-04-28 10:31:30 +02:00 |
|
Stefano Zacchiroli
|
99f2c06c95
|
gitignore: ignore cache dir even if it is a symlink
|
2015-04-28 10:31:04 +02:00 |
|
Stefano Zacchiroli
|
9a78c80b5c
|
lister.py: handle temporary connection error
increase MAX_SLEEP a bit, as it is now used for both connection-level and
throttle-level retries
|
2015-04-26 16:29:36 +02:00 |
|
Stefano Zacchiroli
|
8cedd574ab
|
add license information
|
2015-04-26 16:24:32 +02:00 |
|
Stefano Zacchiroli
|
b409f4fa47
|
bin/status: also show max repo ID reached thus far
|
2015-04-26 16:13:49 +02:00 |
|
Stefano Zacchiroli
|
9e2123b4a6
|
add ACKNOWLEDGEMENTS
thanks copiesofcopies!
|
2015-04-26 15:54:25 +02:00 |
|
Stefano Zacchiroli
|
9a1bab27cb
|
README: skeleton, including dependency and conffile information
|
2015-04-26 15:19:00 +02:00 |
|
Stefano Zacchiroli
|
bf08743356
|
bin/status: hack to monitor bin/batch retrival progress
|
2015-04-26 15:18:27 +02:00 |
|
Stefano Zacchiroli
|
1292fc1bba
|
reset.sh: armageddon to reset lister status
|
2015-04-26 14:30:17 +02:00 |
|
Stefano Zacchiroli
|
894b42ed65
|
lister.py: fix off by 1 in ?since=... usage
|
2015-04-26 14:29:42 +02:00 |
|
Stefano Zacchiroli
|
162bbd3ac8
|
bin/batch: do not use $MIN_ID when not given
|
2015-04-26 14:29:15 +02:00 |
|
Stefano Zacchiroli
|
e44226544a
|
initial check in
|
2015-04-26 10:32:17 +02:00 |
|