wdiv-scrapers / DC-PollingStations-Scarborough

Polling station data from Scarborough Borough Council

Scrapes maps.scarborough.gov.uk

Apache Tomcat/7.0.55


Scrape polling station data from Scarborough Borough Council

This is a scraper that runs on Morph. To get started see the documentation

Contributors chris48s

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.4.3  $ pip install -r requirements.txt  Collecting git+https://github.com/chris48s/arcgis2geojson.git (from -r requirements.txt (line 1))  Cloning https://github.com/chris48s/arcgis2geojson.git to /tmp/pip-93ct4dh9-build  Collecting git+https://github.com/wdiv-scrapers/dc-base-scrapers.git (from -r requirements.txt (line 2))  Cloning https://github.com/wdiv-scrapers/dc-base-scrapers.git to /tmp/pip-6ooomvub-build  Collecting lxml==3.6.4 (from dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading lxml-3.6.4-cp34-cp34m-manylinux1_x86_64.whl (4.2MB)  Collecting retry==0.9.2 (from dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading retry-0.9.2-py2.py3-none-any.whl  Collecting scraperwiki==0.5.1 (from dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading scraperwiki-0.5.1.tar.gz  Collecting py<2.0.0,>=1.4.26 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading py-1.4.31-py2.py3-none-any.whl (81kB)  Collecting decorator>=3.4.2 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading decorator-4.0.10-py2.py3-none-any.whl  Collecting requests (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading requests-2.12.3-py2.py3-none-any.whl (575kB)  Collecting six (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading SQLAlchemy-1.1.4.tar.gz (5.1MB)  Collecting alembic (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading alembic-0.8.9.tar.gz (977kB)  Collecting Mako (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading Mako-1.0.6.tar.gz (575kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading python-editor-1.0.3.tar.gz  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r requirements.txt (line 2))  Downloading MarkupSafe-0.23.tar.gz  Installing collected packages: arcgis2geojson, lxml, py, decorator, retry, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, alembic, scraperwiki, dc-base-scrapers  Running setup.py install for arcgis2geojson: started  Running setup.py install for arcgis2geojson: finished with status 'done'  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Running setup.py install for dc-base-scrapers: started  Running setup.py install for dc-base-scrapers: finished with status 'done'  Successfully installed Mako-1.0.6 MarkupSafe-0.23 alembic-0.8.9 arcgis2geojson-0.0.0 dc-base-scrapers-0.0.0 decorator-4.0.10 lxml-3.6.4 py-1.4.31 python-editor-1.0.3 requests-2.12.3 retry-0.9.2 scraperwiki-0.5.1 six-1.10.0 sqlalchemy-1.1.4   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... found 73 stations 73 stations in database

Data

Downloaded 57 times by wdiv-scrapers chris48s

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (90 KB) Use the API

rows 10 / 40

table timestamp content_hash council_id
stations
2016-10-15T16:01:48+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-16T07:18:15+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-17T01:04:17+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-18T00:32:43+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-19T03:33:51+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-20T08:55:14+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-24T01:19:38+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-24T11:22:31+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-25T04:11:11+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d
stations
2016-10-26T22:44:34+00:00
10dfc5a5a30d405fa9ed04b8ce9f78f3ee63129d

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (90 KB) Use the API

rows 10 / 73

street geometry town id room pk postcode ward_name council_id property
Longwestgate
{"properties": {"street": "Longwestgate ", "room": "Infants Department Hall ", "town": "Scarborough ", "id": "1 ", "postcode": "YO11 1QB ", "ward_name": "Castle ", "property": "Friarage CP School "}, "geometry": {"coordinates": [-0.3959990977362417, 54.28447680425865], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b50"}
Scarborough
1
Infants Department Hall
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b50
YO11 1QB
Castle
E07000168
Friarage CP School
Egton
{"properties": {"street": "Egton ", "room": " ", "town": "Whitby ", "id": "12 ", "postcode": "YO21 1UT ", "ward_name": "Esk Valley ", "property": "Egton Parish Hall "}, "geometry": {"coordinates": [-0.7541757924987806, 54.444598852924386], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b51"}
Whitby
12
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b51
YO21 1UT
Esk Valley
E07000168
Egton Parish Hall
53 Coach Road
{"properties": {"street": "53 Coach Road ", "room": " ", "town": "Sleights ", "id": "13 ", "postcode": "YO22 5BT ", "ward_name": "Esk Valley ", "property": "Sleights Village Hall "}, "geometry": {"coordinates": [-0.663139108386084, 54.4580141857313], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b52"}
Sleights
13
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b52
YO22 5BT
Esk Valley
E07000168
Sleights Village Hall
Sneaton
{"properties": {"street": "Sneaton ", "room": " ", "town": "Whitby ", "id": "14 ", "postcode": "YO22 5HP ", "ward_name": "Esk Valley ", "property": "Sneaton Village Hall "}, "geometry": {"coordinates": [-0.6195355871043746, 54.45729039003599], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b53"}
Whitby
14
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b53
YO22 5HP
Esk Valley
E07000168
Sneaton Village Hall
Seamer Road
{"properties": {"street": "Seamer Road ", "room": " ", "town": "Scarborough ", "id": "15 ", "postcode": "YO12 4DT ", "ward_name": "Falsgrave Park ", "property": "St James Parish Hall "}, "geometry": {"coordinates": [-0.4158387873883236, 54.273887500053924], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b54"}
Scarborough
15
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b54
YO12 4DT
Falsgrave Park
E07000168
St James Parish Hall
Seamer Road
{"properties": {"street": "Seamer Road ", "room": " ", "town": "Scarborough ", "id": "17 ", "postcode": "YO12 4DH ", "ward_name": "Falsgrave Park ", "property": "Falsgrave Resource Centre "}, "geometry": {"coordinates": [-0.4167122744814782, 54.26226564317889], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b55"}
Scarborough
17
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b55
YO12 4DH
Falsgrave Park
E07000168
Falsgrave Resource Centre
John Street
{"properties": {"street": "John Street ", "room": " ", "town": "Filey ", "id": "19 ", "postcode": "YO14 9DQ ", "ward_name": "Filey ", "property": "The Concert Hall "}, "geometry": {"coordinates": [-0.28682611912987593, 54.20870084496904], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b56"}
Filey
19
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b56
YO14 9DQ
Filey
E07000168
The Concert Hall
Queen Street
{"properties": {"street": "Queen Street ", "room": "Lower Hall ", "town": "Scarborough ", "id": "2 ", "postcode": "YO11 1HG ", "ward_name": "Castle ", "property": "Queen Street Central Hall "}, "geometry": {"coordinates": [-0.3979839502815712, 54.28385782981434], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b57"}
Scarborough
2
Lower Hall
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b57
YO11 1HG
Castle
E07000168
Queen Street Central Hall
Hawsker
{"properties": {"street": "Hawsker ", "room": " ", "town": "Whitby ", "id": "20 ", "postcode": "YO22 4LE ", "ward_name": "Fylingdales ", "property": "Hawsker Cum Stainsacre Hall "}, "geometry": {"coordinates": [-0.5800286259347087, 54.455024737785415], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b58"}
Whitby
20
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b58
YO22 4LE
Fylingdales
E07000168
Hawsker Cum Stainsacre Hall
Royal Oak
{"properties": {"street": "Royal Oak ", "room": "Function Room ", "town": "Hunmanby ", "id": "21 ", "postcode": "YO14 9QF ", "ward_name": "Hertford ", "property": "The Royal Oak "}, "geometry": {"coordinates": [-0.298930676539911, 54.18812056184364], "type": "Point"}, "geometry_name": "geom", "type": "Feature", "id": "Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b59"}
Hunmanby
21
Function Room
Polling_Stations_Open.fid-7941259b_158c03ebe5c_7b59
YO14 9QF
Hertford
E07000168
The Royal Oak

Statistics

Average successful run time: half a minute

Total run time: 23 minutes

Total cpu time used: less than a minute

Total disk space used: 117 KB

History

  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 98 records updated in the database
    1027 pages scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1191 pages scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    nothing changed in the database
  • Auto ran revision 2a421185 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Auto ran revision 2a421185 and completed successfully .
    1 record added, 73 records updated in the database
    1 page scraped
  • Manually ran revision 2a421185 and completed successfully .
    74 records added in the database
    1 page scraped
  • Created on morph.io