Revert to the pre-qless refactoring version

This commit is contained in:
Nicolas Dandrimont 2016-09-13 14:57:26 +02:00
parent 9550ca3edd
commit 2a62db6827
13 changed files with 582 additions and 49 deletions

24
README
View file

@ -18,20 +18,30 @@ along with this program.
Dependencies
============
See requirements.txt
- python3
- python3-psycopg2
- python3-requests
- python3-sqlalchemy
Deployment
==========
The github lister can be run standalone by using `python3 -m swh.lister.github.lister`.
1. git clone under $GHLISTER_ROOT (of your choosing)
2. mkdir ~/.config/swh/ ~/.cache/swh/lister-github/
3. edit $GHLISTER_ROOT/etc/crontab and customize GHLISTER_ROOT
4. crontab $GHLISTER_ROOT/etc/crontab
5. create configuration file ~/.config/swh/lister-github.ini
Sample configuration file
-------------------------
cat ~/.config/swh/lister/github.ini
cat ~/.config/swh/lister-github.ini
[main]
storage_class = local_storage
storage_args = dbname=softwareheritage-dev, /srv/softwareheritage/objects
queue_file = ~/.cache/swh/lister-github/queue.pickle
credentials = olasd:olasd_github_token, zacchiro:zacchiro_github_token
db_url = postgres:///github
# see http://docs.sqlalchemy.org/en/latest/core/engines.html#database-urls
cache_dir = /home/zack/.cache/swh/lister-github
log_dir = /home/zack/.cache/swh/lister-github
username = foobar # github username
password = quux # github password