Contributors blablupcom

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.14 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 2))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 3))  Downloading cssselect-0.9.1.tar.gz  Collecting beautifulsoup4 (from -r /tmp/build/requirements.txt (line 4))  Downloading beautifulsoup4-4.6.0-py2-none-any.whl (86kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect, beautifulsoup4  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed beautifulsoup4-4.6.0 certifi-2018.1.18 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.6 lxml-3.4.4 requests-2.18.4 scraperwiki urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... NWR004_NR_gov_2018_02 NWR004_NR_gov_2018_01 NWR004_NR_gov_2017_12 NWR004_NR_gov_2017_11 NWR004_NR_gov_2017_10 NWR004_NR_gov_2017_09 NWR004_NR_gov_2017_08 NWR004_NR_gov_2017_07 NWR004_NR_gov_2017_06 NWR004_NR_gov_2017_05 NWR004_NR_gov_2017_04 NWR004_NR_gov_2017_03 NWR004_NR_gov_2017_02 NWR004_NR_gov_2017_01 NWR004_NR_gov_2016_12 NWR004_NR_gov_2016_11 NWR004_NR_gov_2016_10 NWR004_NR_gov_2016_09 NWR004_NR_gov_2016_08

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (9 KB) Use the API

rows 10 / 19

l f d
https://cdn.networkrail.co.uk/wp-content/uploads/2018/03/Spend-over-£25000-February-2018.xlsx
NWR004_NR_gov_2018_02
2018-03-29 18:12:53.661207
https://cdn.networkrail.co.uk/wp-content/uploads/2018/03/Spend-over-£25000-January-2018.xlsx
NWR004_NR_gov_2018_01
2018-03-29 18:12:54.790548
https://cdn.networkrail.co.uk/wp-content/uploads/2018/01/Spend-over-£25000-December-2017.xlsx
NWR004_NR_gov_2017_12
2018-03-29 18:12:55.748865
https://cdn.networkrail.co.uk/wp-content/uploads/2018/01/Spend-over-£25000-November-2017.xlsx
NWR004_NR_gov_2017_11
2018-03-29 18:12:56.767960
https://cdn.networkrail.co.uk/wp-content/uploads/2017/12/Spend-over-£25000-October-2017.xlsx
NWR004_NR_gov_2017_10
2018-03-29 18:12:57.941208
https://cdn.networkrail.co.uk/wp-content/uploads/2016/11/Spend-over-£25000-September-2017.xlsx
NWR004_NR_gov_2017_09
2018-03-29 18:12:58.887887
https://cdn.networkrail.co.uk/wp-content/uploads/2016/11/Spend-over-£25000-August-2017.xlsx
NWR004_NR_gov_2017_08
2018-03-29 18:12:59.835837
https://cdn.networkrail.co.uk/wp-content/uploads/2016/11/Spend-over-£25000-July-2017.xlsx
NWR004_NR_gov_2017_07
2018-03-29 18:13:00.832755
https://cdn.networkrail.co.uk/wp-content/uploads/2016/11/Spend-over-£25000-June-2017.xlsx
NWR004_NR_gov_2017_06
2018-03-29 18:13:01.825289
https://cdn.networkrail.co.uk/wp-content/uploads/2016/11/Spend-over-£25000-May-2017.xlsx
NWR004_NR_gov_2017_05
2018-03-29 18:13:02.787564

Statistics

Average successful run time: 3 minutes

Total run time: 3 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 54.5 KB

History

  • Manually ran revision d4a41a23 and completed successfully .
    19 records added in the database
  • Created on morph.io

Scraper code

sp_NWR004_NR_gov