wdiv-scrapers / DC-PollingStations-Carmarthenshire

Polling station data from Carmarthenshire Council

Scrapes ilocal.carmarthenshire.gov.uk

iLocal - Visit My Nearest and My House to find information about council services near to your home or when you’re out and about. Quick links to our most used online services – Pay – Request – Report. Need a handy reminder about changes to service? Then sign up to My Alerts. iLocal Carmarthenshire County Council - Save time, do it online.


Scrape polling station data from Carmarthenshire Council

This is a scraper that runs on Morph. To get started see the documentation

Contributors chris48s

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.4.3, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.4.3 -----> Installing pip -----> Installing requirements with pip  Collecting git+https://github.com/wdiv-scrapers/dc-base-scrapers.git (from -r /tmp/build/requirements.txt (line 1))  Cloning https://github.com/wdiv-scrapers/dc-base-scrapers.git to /tmp/pip-wdeeamyy-build  Collecting lxml==3.6.4 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading lxml-3.6.4-cp34-cp34m-manylinux1_x86_64.whl (4.2MB)  Collecting retry==0.9.2 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading retry-0.9.2-py2.py3-none-any.whl  Collecting scraperwiki==0.5.1 (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading scraperwiki-0.5.1.tar.gz  Collecting arcgis2geojson (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading arcgis2geojson-1.0.4.tar.gz  Collecting commitment (from dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading commitment-1.0.0.tar.gz  Collecting py<2.0.0,>=1.4.26 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading py-1.5.2-py2.py3-none-any.whl (88kB)  Collecting decorator>=3.4.2 (from retry==0.9.2->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading decorator-4.2.1-py2.py3-none-any.whl  Collecting requests (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting six (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading six-1.11.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading SQLAlchemy-1.2.1.tar.gz (5.5MB)  Collecting alembic (from scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading alembic-0.9.7.tar.gz (1.0MB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting Mako (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading Mako-1.0.7.tar.gz (564kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading python-editor-1.0.3.tar.gz  Collecting python-dateutil (from alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading python_dateutil-2.6.1-py2.py3-none-any.whl (194kB)  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->dc-base-scrapers==0.0.0->-r /tmp/build/requirements.txt (line 1))  Downloading MarkupSafe-1.0.tar.gz  Installing collected packages: lxml, py, decorator, retry, certifi, urllib3, chardet, idna, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki, arcgis2geojson, commitment, dc-base-scrapers  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Running setup.py install for arcgis2geojson: started  Running setup.py install for arcgis2geojson: finished with status 'done'  Running setup.py install for commitment: started  Running setup.py install for commitment: finished with status 'done'  Running setup.py install for dc-base-scrapers: started  Running setup.py install for dc-base-scrapers: finished with status 'done'  Successfully installed Mako-1.0.7 MarkupSafe-1.0 alembic-0.9.7 arcgis2geojson-1.0.4 certifi-2018.1.18 chardet-3.0.4 commitment-1.0.0 dc-base-scrapers-0.0.0 decorator-4.2.1 idna-2.6 lxml-3.6.4 py-1.5.2 python-dateutil-2.6.1 python-editor-1.0.3 requests-2.18.4 retry-0.9.2 scraperwiki-0.5.1 six-1.11.0 sqlalchemy-1.2.1 urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... found 198 stations 198 stations in database

Data

Downloaded 659 times by wdiv-scrapers chris48s

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (258 KB) Use the API

rows 10 / 335

timestamp content_hash table council_id
2016-09-20T20:06:13+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-21T13:05:33+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-22T00:19:54+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-23T21:34:59+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-24T23:22:25+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-25T05:36:17+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-26T07:23:33+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-27T17:23:25+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-28T07:21:35+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations
2016-09-30T19:27:02+00:00
079bd9c5461b9227454b08db3ab90e269426f808
stations

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (258 KB) Use the API

rows 10 / 198

postcode register geometry council_id pk address
A
{"geometry": {"coordinates": [-3.985199053945576, 51.79219796887586], "type": "Point"}, "geometry_name": "geom", "id": 0, "properties": {"address": "Gellimanwydd Hall, Wallasey Road, Ammanford ", "postcode": null, "register": "A "}, "type": "Feature"}
W06000010
0
Gellimanwydd Hall, Wallasey Road, Ammanford
AA
{"geometry": {"coordinates": [-4.26770480846796, 51.865223896141465], "type": "Point"}, "geometry_name": "geom", "id": 1, "properties": {"address": "Abergwilli Curch Hall, Ismyrddin, Abergwili, Carmarthen ", "postcode": null, "register": "AA "}, "type": "Feature"}
W06000010
1
Abergwilli Curch Hall, Ismyrddin, Abergwili, Carmarthen
SA32 7AB
AB
{"geometry": {"coordinates": [-4.272459226871707, 51.89400793687482], "type": "Point"}, "geometry_name": "geom", "id": 2, "properties": {"address": "Peniel Community Room, Peniel, Carmarthen ", "postcode": "SA32 7AB ", "register": "AB "}, "type": "Feature"}
W06000010
2
Peniel Community Room, Peniel, Carmarthen
SA32 7EN
AC
{"geometry": {"coordinates": [-4.233927225242869, 51.87078427048492], "type": "Point"}, "geometry_name": "geom", "id": 3, "properties": {"address": "Whitemill Inn, Whitemill, Carmarthen ", "postcode": "SA32 7EN ", "register": "AC "}, "type": "Feature"}
W06000010
3
Whitemill Inn, Whitemill, Carmarthen
SA33 6NY
AD
{"geometry": {"coordinates": [-4.427417979762718, 51.901092044206834], "type": "Point"}, "geometry_name": "geom", "id": 4, "properties": {"address": "Talog Village Hall, Talog, Carmarthen ", "postcode": "SA33 6NY ", "register": "AD "}, "type": "Feature"}
W06000010
4
Talog Village Hall, Talog, Carmarthen
SA33 6BE
AE
{"geometry": {"coordinates": [-4.298423411254092, 51.89831809283624], "type": "Point"}, "geometry_name": "geom", "id": 5, "properties": {"address": "Bronwydd Memorial Hall, Bronwydd, Carmarthen ", "postcode": "SA33 6BE ", "register": "AE "}, "type": "Feature"}
W06000010
5
Bronwydd Memorial Hall, Bronwydd, Carmarthen
SA31 1EU
AF
{"geometry": {"coordinates": [-4.304071061502991, 51.85871159400572], "type": "Point"}, "geometry_name": "geom", "id": 6, "properties": {"address": "Carmarthen Community Education Centre, Furnace Road, Carmarthen ", "postcode": "SA31 1EU ", "register": "AF "}, "type": "Feature"}
W06000010
6
Carmarthen Community Education Centre, Furnace Road, Carmarthen
SA31 1TE
AG
{"geometry": {"coordinates": [-4.313514707274084, 51.862166413537054], "type": "Point"}, "geometry_name": "geom", "id": 7, "properties": {"address": "Special Needs Unit, Myrddin CP School, Heol Disgwylfa, Carmarthen ", "postcode": "SA31 1TE ", "register": "AG "}, "type": "Feature"}
W06000010
7
Special Needs Unit, Myrddin CP School, Heol Disgwylfa, Carmarthen
SA31 1HZ
AH
{"geometry": {"coordinates": [-4.301515913236835, 51.86004775450764], "type": "Point"}, "geometry_name": "geom", "id": 8, "properties": {"address": "Carmarthen Town AFC Clubhouse, Priory Street, Carmarthen ", "postcode": "SA31 1HZ ", "register": "AH "}, "type": "Feature"}
W06000010
8
Carmarthen Town AFC Clubhouse, Priory Street, Carmarthen
AI
{"geometry": {"coordinates": [-4.313806176653326, 51.85617760548108], "type": "Point"}, "geometry_name": "geom", "id": 9, "properties": {"address": "Parish Hall, Christ Church, Lammas Street, Carmarthen ", "postcode": null, "register": "AI "}, "type": "Feature"}
W06000010
9
Parish Hall, Christ Church, Lammas Street, Carmarthen

Statistics

Average successful run time: half a minute

Total run time: about 1 month

Total cpu time used: 7 minutes

Total disk space used: 280 KB

History

  • Auto ran revision be2e9173 and completed successfully .
    1 record added, 198 records updated in the database
    1 page scraped
  • Auto ran revision be2e9173 and completed successfully .
    1 record added, 198 records updated in the database
    1 page scraped
  • Auto ran revision be2e9173 and failed .
    nothing changed in the database
  • Auto ran revision be2e9173 and failed .
    nothing changed in the database
  • Auto ran revision be2e9173 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history