jnothman / openaustralia-members

Data on Australian federal parliamentarians, joining a number of XML files


Contributors jnothman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.5.2  $ pip install -r requirements.txt  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 1))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting pandas==0.20.1 (from -r /tmp/build/requirements.txt (line 2))  Downloading pandas-0.20.1-cp35-cp35m-manylinux1_x86_64.whl (24.0MB)  Collecting scraperwiki (from -r /tmp/build/requirements.txt (line 3))  Downloading scraperwiki-0.5.1.tar.gz  Collecting numpy>=1.7.0 (from pandas==0.20.1->-r /tmp/build/requirements.txt (line 2))  Downloading numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl (16.9MB)  Collecting pytz>=2011k (from pandas==0.20.1->-r /tmp/build/requirements.txt (line 2))  Downloading pytz-2017.3-py2.py3-none-any.whl (511kB)  Collecting python-dateutil>=2 (from pandas==0.20.1->-r /tmp/build/requirements.txt (line 2))  Downloading python_dateutil-2.6.1-py2.py3-none-any.whl (194kB)  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting six (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading six-1.11.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading SQLAlchemy-1.1.15.tar.gz (5.2MB)  Collecting alembic (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading alembic-0.9.6.tar.gz (998kB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading certifi-2017.11.5-py2.py3-none-any.whl (330kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting Mako (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading Mako-1.0.7.tar.gz (564kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading python-editor-1.0.3.tar.gz  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading MarkupSafe-1.0.tar.gz  Installing collected packages: lxml, numpy, pytz, six, python-dateutil, pandas, idna, certifi, urllib3, chardet, requests, sqlalchemy, MarkupSafe, Mako, python-editor, alembic, scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Successfully installed Mako-1.0.7 MarkupSafe-1.0 alembic-0.9.6 certifi-2017.11.5 chardet-3.0.4 idna-2.6 lxml-3.4.4 numpy-1.13.3 pandas-0.20.1 python-dateutil-2.6.1 python-editor-1.0.3 pytz-2017.3 requests-2.18.4 scraperwiki-0.5.1 six-1.11.0 sqlalchemy-1.1.15 urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/openaustraliamembers.py:73: UserWarning: Found more than one personinfo per person in websites.xml filename) Got 2530 records

Statistics

Average successful run time: less than a minute

Total run time: 16 minutes

Total cpu time used: half a minute

Total disk space used: 32.4 KB

History

  • Manually ran revision 2c099df5 and completed successfully .
    nothing changed in the database
  • Manually ran revision ff66ca89 and completed successfully .
    nothing changed in the database
  • Manually ran revision 04940cd6 and failed .
    nothing changed in the database
  • Manually ran revision 772e0318 and completed successfully .
    nothing changed in the database
  • Manually ran revision 5bf990c1 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history