wdiv-scrapers / DC-PollingStations-Calderdale

Polling station and district data from Calderdale Borough Council

Scrapes dataworks.calderdale.gov.uk

Calderdale Data Works – A community site for open data, transparency, and collaboration


Scrape polling station and district data from Calderdale Borough Council

This is a scraper that runs on Morph. To get started see the documentation

Contributors chris48s

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.4.3  $ pip install -r requirements.txt  Collecting git+https://github.com/chris48s/arcgis2geojson.git (from -r requirements.txt (line 1))  Cloning https://github.com/chris48s/arcgis2geojson.git to /tmp/pip-fv6t4eha-build  Collecting git+https://github.com/wdiv-scrapers/dc-base-scrapers.git (from -r requirements.txt (line 2))  Cloning https://github.com/wdiv-scrapers/dc-base-scrapers.git to /tmp/pip-sh0em9aw-build  Collecting lxml==3.6.4 (from dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading lxml-3.6.4-cp34-cp34m-manylinux1_x86_64.whl (4.2MB)  Collecting retry==0.9.2 (from dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading retry-0.9.2-py2.py3-none-any.whl  Collecting scraperwiki==0.5.1 (from dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading scraperwiki-0.5.1.tar.gz  Collecting decorator>=3.4.2 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading decorator-4.0.10-py2.py3-none-any.whl  Collecting py<2.0.0,>=1.4.26 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading py-1.4.31-py2.py3-none-any.whl (81kB)  Collecting requests (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading requests-2.12.3-py2.py3-none-any.whl (575kB)  Collecting six (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading SQLAlchemy-1.1.4.tar.gz (5.1MB)  Collecting alembic (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading alembic-0.8.9.tar.gz (977kB)  Collecting Mako (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading Mako-1.0.6.tar.gz (575kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading python-editor-1.0.3.tar.gz  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading MarkupSafe-0.23.tar.gz  Installing collected packages: arcgis2geojson, lxml, decorator, py, retry, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, alembic, scraperwiki, dc-base-scrapers  Running setup.py install for arcgis2geojson: started  Running setup.py install for arcgis2geojson: finished with status 'done'  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Running setup.py install for dc-base-scrapers: started  Running setup.py install for dc-base-scrapers: finished with status 'done'  Successfully installed Mako-1.0.6 MarkupSafe-0.23 alembic-0.8.9 arcgis2geojson-0.0.0 dc-base-scrapers-0.0.0 decorator-4.0.10 lxml-3.6.4 py-1.4.31 python-editor-1.0.3 requests-2.12.3 retry-0.9.2 scraperwiki-0.5.1 six-1.10.0 sqlalchemy-1.1.4   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... found 2 polling-stations resources found 1 polling-station-districts resources

Data

Downloaded 6 times by wdiv-scrapers

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 3 / 3

dataset url revision_id format created coverage_start_date coverage_end_date
polling-stations
https://files.datapress.com/calderdale/dataset/polling-stations/2016-04-19T13:01:08/Polling Stations.xlsx
0681447b-0472-487f-882e-b7386ec59cf4
XLS
2016-04-19T13:01:47.948580
polling-stations
https://files.datapress.com/calderdale/dataset/polling-stations/2016-04-19T13:12:38/Polling Stations.csv
0681447b-0472-487f-882e-b7386ec59cf4
CSV
2016-04-19T13:13:17.742339
polling-station-districts
https://files.datapress.com/calderdale/dataset/polling-station-districts/2016-03-03T09:41:39/Polling station districts.zip
b4756670-a630-425a-8fd1-4d185703ec2e
ZIP
2016-03-03T09:41:44.162602
2016-03-01
2017-03-01

Statistics

Average successful run time: half a minute

Total run time: 3 days

Total cpu time used: less than a minute

Total disk space used: 37.1 KB

History

  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    790 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    4 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    3 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and failed .
    19 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    28 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    75 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    4 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision c22aa4fb and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision c22aa4fb and completed successfully .
    3 records added in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    1 page scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added, 3 records removed in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    3 records added in the database
    2 pages scraped
  • Auto ran revision 99608ebc and completed successfully .
    nothing changed in the database
  • Manually ran revision 99608ebc and completed successfully .
    nothing changed in the database
  • Created on morph.io