wdiv-scrapers / DC-PollingStations-Hackney

Polling district data from Hackney Borough Council

Scrapes www.map.hackney.gov.uk

MapHackney 4.0


Scrape polling district data from Hackney Borough Council

This is a scraper that runs on Morph. To get started see the documentation

Contributors chris48s

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.4.3, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.4.3 -----> Installing pip -----> Installing requirements with pip  Collecting git+https://github.com/wdiv-scrapers/dc-base-scrapers.git (from -r /tmp/build/requirements.txt (line 1))  Cloning https://github.com/wdiv-scrapers/dc-base-scrapers.git to /tmp/pip-req-build-jknw1n6n  Collecting lxml==3.6.4 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/3a/2d/953dfc8496cc9d5add66c0fd468d786d4e4706d263285bc4bb1785485149/lxml-3.6.4-cp34-cp34m-manylinux1_x86_64.whl (4.2MB)  Collecting retry==0.9.2 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/4b/0d/53aea75710af4528a25ed6837d71d117602b01946b307a3912cb3cfcbcba/retry-0.9.2-py2.py3-none-any.whl  Collecting scraperwiki==0.5.1 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/30/84/d874847baad89f03e6984fcd87505a37bf924b66519d1e07bf76e2369af0/scraperwiki-0.5.1.tar.gz  Collecting arcgis2geojson==1.2.0 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/83/47/a065e6610a997096eb2db3b052dcfa094b8e149dda5f9b3b6d94358275c2/arcgis2geojson-1.2.0.tar.gz  Collecting commitment==2.0.0 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/5b/f1/4422969e6c438568c486d727876addbc96abe0958ba0c54cad414b466209/commitment-2.0.0.tar.gz  Collecting py<2.0.0,>=1.4.26 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/67/a5/f77982214dd4c8fd104b066f249adea2c49e25e8703d284382eb5e9ab35a/py-1.5.3-py2.py3-none-any.whl (84kB)  Collecting decorator>=3.4.2 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/bc/bb/a24838832ba35baf52f32ab1a49b906b5f82fb7c76b2f6a7e35e140bac30/decorator-4.3.0-py2.py3-none-any.whl  Collecting requests (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/49/df/50aa1999ab9bde74656c2919d9c0c085fd2b3775fd3eca826012bef76d8c/requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting six (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/da/ef/f10a6892f8ff3c1fec1c25699a7379d1f72f291c8fa40b71c31cab3f779e/SQLAlchemy-1.2.6.tar.gz (5.6MB)  Collecting alembic (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/89/03/756d5b8e1c90bf283c3f435766aa3f20208d1c3887579dd8f2122e01d5f4/alembic-0.9.9.tar.gz (1.0MB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/7c/e6/92ad559b7192d846975fc916b65f667c7b8c3a32bea7372340bfe9a15fa5/certifi-2018.4.16-py2.py3-none-any.whl (150kB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/27/cc/6dd9a3869f15c2edfab863b992838277279ce92663d334df9ecf5106f5c6/idna-2.6-py2.py3-none-any.whl (56kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/63/cb/6965947c13a94236f6d4b8223e21beb4d576dc72e8130bd7880f600839b8/urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting Mako (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/eb/f3/67579bb486517c0d49547f9697e36582cd19dafb5df9e687ed8e22de57fa/Mako-1.0.7.tar.gz (564kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/65/1e/adf6e000ea5dc909aa420352d6ba37f16434c8a3c2fa030445411a1ed545/python-editor-1.0.3.tar.gz  Collecting python-dateutil (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/0c/57/19f3a65bcf6d5be570ee8c35a5398496e10a0ddcbc95393b2d17f86aaaf8/python_dateutil-2.7.2-py2.py3-none-any.whl (212kB)  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/4d/de/32d741db316d8fdb7680822dd37001ef7a448255de9699ab4bfcbdf4172b/MarkupSafe-1.0.tar.gz  Installing collected packages: lxml, py, decorator, retry, certifi, idna, chardet, urllib3, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki, arcgis2geojson, commitment, dc-base-scrapers  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Running setup.py install for arcgis2geojson: started  Running setup.py install for arcgis2geojson: finished with status 'done'  Running setup.py install for commitment: started  Running setup.py install for commitment: finished with status 'done'  Running setup.py install for dc-base-scrapers: started  Running setup.py install for dc-base-scrapers: finished with status 'done'  Successfully installed Mako-1.0.7 MarkupSafe-1.0 alembic-0.9.9 arcgis2geojson-1.2.0 certifi-2018.4.16 chardet-3.0.4 commitment-2.0.0 dc-base-scrapers-0.0.0 decorator-4.3.0 idna-2.6 lxml-3.6.4 py-1.5.3 python-dateutil-2.7.2 python-editor-1.0.3 requests-2.18.4 retry-0.9.2 scraperwiki-0.5.1 six-1.11.0 sqlalchemy-1.2.6 urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... found 84 stations 84 stations in database

Data

Downloaded 639 times by wdiv-scrapers chris48s

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (150 KB) Use the API

rows 10 / 428

content_hash timestamp table council_id
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-09-27T20:20:43+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-09-28T00:18:51+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-09-29T15:24:14+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-09-30T13:19:10+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-10-01T15:53:06+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-10-02T20:11:09+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-10-03T12:35:27+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-10-04T09:07:18+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-10-05T19:08:07+00:00
stations
54f33a671341266281518f07f71e2f1e6b4ddc16
2016-10-05T23:41:00+00:00
stations

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (150 KB) Use the API

rows 10 / 84

GMAP_URL MI_PRINX pk council_id ADDRESS_1 UPRN geometry PDN WARD ADDRESS_2 NEW MI_STYLE NAME ENTRANCE POSTCODE ID
90
Polling Stations.90
E09000012
Warwick Grove
10008243806
{"geometry": {"coordinates": [-0.05579085095351872, 51.56587530598457], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.90", "properties": {"ADDRESS_1": "Warwick Grove", "ADDRESS_2": "Upper Clapton", "ENTRANCE": null, "GMAP_URL": null, "ID": "HNBE", "MI_PRINX": 90, "MI_STYLE": null, "NAME": "Wrens Park Community Hall", "NEW": null, "PDN": 8, "POSTCODE": "E5 9LL", "UPRN": 10008243806, "WARD": "Springfield", "bbox": [-0.05579085095351872, 51.56587530598457, -0.05579085095351872, 51.56587530598457]}, "type": "Feature"}
8
Springfield
Upper Clapton
Wrens Park Community Hall
E5 9LL
HNBE
85
Polling Stations.85
E09000012
77 Bethune Road
10008305735
{"geometry": {"coordinates": [-0.08131460045216636, 51.57069275923822], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.85", "properties": {"ADDRESS_1": "77 Bethune Road", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HNDC", "MI_PRINX": 85, "MI_STYLE": null, "NAME": "Oaktree Community Centre", "NEW": null, "PDN": 14, "POSTCODE": "N16 5ED", "UPRN": 10008305735, "WARD": "Stamford Hill West", "bbox": [-0.08131460045216636, 51.57069275923822, -0.08131460045216636, 51.57069275923822]}, "type": "Feature"}
14
Stamford Hill West
Oaktree Community Centre
N16 5ED
HNDC
89
Polling Stations.89
E09000012
Gascoyne Road
10008342233
{"geometry": {"coordinates": [-0.0385732169656748, 51.541607449012375], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.89", "properties": {"ADDRESS_1": "Gascoyne Road", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HSRB", "MI_PRINX": 89, "MI_STYLE": null, "NAME": "Gascoyne Community Hall", "NEW": null, "PDN": 71, "POSTCODE": "E9 7FA", "UPRN": 10008342233, "WARD": "Hackney Wick", "bbox": [-0.0385732169656748, 51.541607449012375, -0.0385732169656748, 51.541607449012375]}, "type": "Feature"}
71
Hackney Wick
Gascoyne Community Hall
E9 7FA
HSRB
91
Polling Stations.91
E09000012
122-124 Lower Clapton Road
100021056262
{"geometry": {"coordinates": [-0.05365553915593075, 51.55438340336897], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.91", "properties": {"ADDRESS_1": "122-124 Lower Clapton Road", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HNIC", "MI_PRINX": 91, "MI_STYLE": null, "NAME": "Clapton Salvation Army", "NEW": null, "PDN": 35, "POSTCODE": "E5 0QR", "UPRN": 100021056262, "WARD": "Lea Bridge", "bbox": [-0.05365553915593075, 51.55438340336897, -0.05365553915593075, 51.55438340336897]}, "type": "Feature"}
35
Lea Bridge
Clapton Salvation Army
E5 0QR
HNIC
87
Polling Stations.87
E09000012
2 & 4 Homerton High Street
100023022522
{"geometry": {"coordinates": [-0.05043127837889522, 51.548484705829125], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.87", "properties": {"ADDRESS_1": "2 & 4 Homerton High Street", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HSMB", "MI_PRINX": 87, "MI_STYLE": null, "NAME": "Sutton House", "NEW": null, "PDN": 51, "POSTCODE": "E9 6JQ", "UPRN": 100023022522, "WARD": "Homerton", "bbox": [-0.05043127837889522, 51.548484705829125, -0.05043127837889522, 51.548484705829125]}, "type": "Feature"}
51
Homerton
Sutton House
E9 6JQ
HSMB
88
Polling Stations.88
E09000012
Buckingham Road
10008241541
{"geometry": {"coordinates": [-0.07854173875693024, 51.54498636060778], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.88", "properties": {"ADDRESS_1": "Buckingham Road", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HSOA", "MI_PRINX": 88, "MI_STYLE": null, "NAME": "Kingsgate Community Hall", "NEW": null, "PDN": 58, "POSTCODE": "N1 4DB", "UPRN": 10008241541, "WARD": "De Beauvoir", "bbox": [-0.07854173875693024, 51.54498636060778, -0.07854173875693024, 51.54498636060778]}, "type": "Feature"}
58
De Beauvoir
Kingsgate Community Hall
N1 4DB
HSOA
92
Polling Stations.92
E09000012
Kingsmead Way
100023546618
{"geometry": {"coordinates": [-0.03422259280510769, 51.55342992753731], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.92", "properties": {"ADDRESS_1": "Kingsmead Way", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HSND", "MI_PRINX": 92, "MI_STYLE": null, "NAME": "Concorde Community Centre", "NEW": null, "PDN": 57, "POSTCODE": "E9 5PP", "UPRN": 100023546618, "WARD": "King\u00b4s Park", "bbox": [-0.03422259280510769, 51.55342992753731, -0.03422259280510769, 51.55342992753731]}, "type": "Feature"}
57
King´s Park
Concorde Community Centre
E9 5PP
HSND
1
Polling Stations.1
E09000012
Woodberry Grove
100023184376
{"geometry": {"coordinates": [-0.09439460710610965, 51.572272822408046], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.1", "properties": {"ADDRESS_1": "Woodberry Grove", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HNAA", "MI_PRINX": 1, "MI_STYLE": null, "NAME": "Woodberry Down Youth Hub", "NEW": null, "PDN": 1, "POSTCODE": "N4 1SN", "UPRN": 100023184376, "WARD": "Woodberry Down", "bbox": [-0.09439460710610965, 51.572272822408046, -0.09439460710610965, 51.572272822408046]}, "type": "Feature"}
1
Woodberry Down
Woodberry Down Youth Hub
N4 1SN
HNAA
2
Polling Stations.2
E09000012
Amhurst Park
100023156099
{"geometry": {"coordinates": [-0.07906569089291443, 51.5750892572311], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.2", "properties": {"ADDRESS_1": "Amhurst Park", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HNAB", "MI_PRINX": 2, "MI_STYLE": null, "NAME": "Joseph Court Community Hall", "NEW": null, "PDN": 2, "POSTCODE": "N16 5JA", "UPRN": 100023156099, "WARD": "Woodberry Down", "bbox": [-0.07906569089291443, 51.5750892572311, -0.07906569089291443, 51.5750892572311]}, "type": "Feature"}
2
Woodberry Down
Joseph Court Community Hall
N16 5JA
HNAB
3
Polling Stations.3
E09000012
Kayani Avenue
10008328988
{"geometry": {"coordinates": [-0.09137411887527977, 51.5700852966935], "type": "Point"}, "geometry_name": "GEOLOC", "id": "Polling Stations.3", "properties": {"ADDRESS_1": "Kayani Avenue", "ADDRESS_2": null, "ENTRANCE": null, "GMAP_URL": null, "ID": "HNAC", "MI_PRINX": 3, "MI_STYLE": null, "NAME": "Redmond Community Centre", "NEW": null, "PDN": 3, "POSTCODE": "N4 2HF", "UPRN": 10008328988, "WARD": "Woodberry Down", "bbox": [-0.09137411887527977, 51.5700852966935, -0.09137411887527977, 51.5700852966935]}, "type": "Feature"}
3
Woodberry Down
Redmond Community Centre
N4 2HF
HNAC

Statistics

Average successful run time: half a minute

Total run time: about 4 hours

Total cpu time used: 7 minutes

Total disk space used: 170 KB

History

  • Auto ran revision bde34c21 and completed successfully .
    1 record added, 84 records updated in the database
    1 page scraped
  • Auto ran revision bde34c21 and completed successfully .
    1 record added, 84 records updated in the database
    93 pages scraped
  • Auto ran revision bde34c21 and completed successfully .
    1 record added, 84 records updated in the database
    59 pages scraped
  • Auto ran revision bde34c21 and completed successfully .
    1 record added, 84 records updated in the database
    1 page scraped
  • Auto ran revision bde34c21 and completed successfully .
    1 record added, 84 records updated in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history