woodbine / sp_E4705_WCC_gov

Scrapes datamillnorth.org

Data Mill North – Open Data for the North of England


Contributors blablupcom woodbine

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/.heroku/python/lib/python2.7/site-packages/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings SNIMissingWarning /app/.heroku/python/lib/python2.7/site-packages/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning /app/.heroku/python/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for files.datapress.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.) SubjectAltNameWarning Error validating URL. E4705_WCC_gov_2017_Q3 *Error: Invalid URL* Traceback (most recent call last): File "scraper.py", line 142, in <module> valid = validate(filename, file_url) File "scraper.py", line 73, in validate print file_url UnicodeEncodeError: 'ascii' codec can't encode character u'\xa3' in position 116: ordinal not in range(128)

Data

Downloaded 582 times by SimKennedy MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (10 KB) Use the API

rows 10 / 21

l d f
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q3-2016-2017.csv
2017-10-03 23:35:35.561621
E4705_WCC_gov_2016_Q3
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q2-2016-2017.csv
2017-10-03 23:35:36.261522
E4705_WCC_gov_2016_Q2
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q1-2016-2017.csv
2017-10-03 23:35:36.975378
E4705_WCC_gov_2016_Q1
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q4-2015-2016.csv
2017-10-03 23:35:37.677029
E4705_WCC_gov_2015_Q4
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q3-2015-2016-v2.csv
2017-10-03 23:35:38.321802
E4705_WCC_gov_2015_Q3
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q3-2015-2016.csv
2017-10-03 23:35:38.943274
E4705_WCC_gov_2015_Q3
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q2-2015-2016.csv
2017-10-03 23:35:39.456400
E4705_WCC_gov_2015_Q2
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q1-2015-2016.csv
2017-10-03 23:35:40.069466
E4705_WCC_gov_2015_Q1
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q4-2014-2015.csv
2017-10-03 23:35:40.650223
E4705_WCC_gov_2014_Q4
http://www.wakefield.gov.uk/Spend over 500/spend-over-500-q3-2014-2015.csv
2017-10-03 23:35:41.384749
E4705_WCC_gov_2014_Q3

Statistics

Average successful run time: 11 minutes

Total run time: 6 days

Total cpu time used: 9 minutes

Total disk space used: 42 KB

History

  • Auto ran revision 97357490 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 97357490 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 97357490 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 97357490 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 97357490 and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_E4705_WCC_gov / scraper.py