woodbine / sp_E4305_WMBC_gov

Scrapes www.wirral.gov.uk

Wirral Borough Council


Contributors blablupcom woodbine

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/.heroku/python/lib/python2.7/site-packages/urllib3/util/ssl_.py:369: SNIMissingWarning: An HTTPS request has been made, but the SNI (Server Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings SNIMissingWarning /app/.heroku/python/lib/python2.7/site-packages/urllib3/util/ssl_.py:160: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecurePlatformWarning Traceback (most recent call last): File "scraper.py", line 107, in <module> html = requests.get(url) File "/app/.heroku/python/lib/python2.7/site-packages/requests/api.py", line 72, in get return request('get', url, params=params, **kwargs) File "/app/.heroku/python/lib/python2.7/site-packages/requests/api.py", line 58, in request return session.request(method=method, url=url, **kwargs) File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 512, in request resp = self.send(prep, **send_kwargs) File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 622, in send r = adapter.send(request, **kwargs) File "/app/.heroku/python/lib/python2.7/site-packages/requests/adapters.py", line 513, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='www.wirral.gov.ukhttps', port=80): Max retries exceeded with url: //www.wirral.gov.uk/about-council/budgets-and-spending/payments-suppliers-and-agents/payments-suppliers-and-agents-2018 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x288bf50>: Failed to establish a new connection: [Errno -2] Name or service not known',))

Data

Downloaded 520 times by SimKennedy MikeRalphson randomgitman woodbine

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (32 KB) Use the API

rows 10 / 65

d f l
2015-12-16 14:33:57.507059
E4305_WMBC_gov_2015_07
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2015-16/July%202015.csv
2016-03-31 16:21:39.040675
E4305_WMBC_gov_2015_06
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Over%20%C2%A3500%20payments%20June%202015.csv
2016-03-31 16:21:41.200862
E4305_WMBC_gov_2015_08
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2015-16/Over%20%C2%A3500%20payments%20August%202015.csv
2016-03-31 16:21:46.831815
E4305_WMBC_gov_2016_01
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/over500_220216.csv
2018-04-01 05:21:25.210962
E4305_WMBC_gov_2017_12
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2017-18/December%2017.csv
2018-04-23 14:08:56.663066
E4305_WMBC_gov_2018_02
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2017-18/February 2017/Over%20%C2%A3500%20Payments%20Feb%2018.csv
2018-04-25 01:29:26.278866
E4305_WMBC_gov_2017_04
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2017-18/April 2017/April%20Over%20500%20Payments%202017.csv
2018-04-25 01:29:26.427840
E4305_WMBC_gov_2017_05
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2017-18/May 2017/May%20over%20%C2%A3500.csv
2018-04-25 01:29:26.626204
E4305_WMBC_gov_2017_06
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2017-18/June 2017/June%20over%20%C2%A3500.csv
2018-04-25 01:29:26.707635
E4305_WMBC_gov_2017_07
http://www.wirral.gov.uk/sites/default/files/all/About the council/Performance and spending/Payments to suppliers/2017-18/July 2017/July%20over%20%C2%A3500.csv

Statistics

Average successful run time: 2 minutes

Total run time: 16 days

Total cpu time used: 10 minutes

Total disk space used: 61.2 KB

History

  • Auto ran revision f27b3446 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision f27b3446 and failed .
    nothing changed in the database
    23 pages scraped
  • Auto ran revision f27b3446 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision f27b3446 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision f27b3446 and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_E4305_WMBC_gov / scraper.py