duncanparkes / welsh_assembly_members

Scrape all current members of the Welsh assembly. Probably just name, party, and contact details.


This is a scraper that runs on Morph. To get started see the documentation

Contributors duncanparkes chrismytton

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 96, in <module> scrape_url(url) File "scraper.py", line 15, in scrape_url region_name = title[0].text.split(':')[-1].strip() AttributeError: 'NoneType' object has no attribute 'split'

Data

Downloaded 109 times by everypolitician duncanparkes tmtmtmtm chrismytton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (35 KB) Use the API

rows 10 / 60

post en_party_name href id en_title image email en_constituency_name name group area twitter en_region_name other_name area_id
Welsh Conservative Party
157
Mark.Isherwood@assembly.wales
Mark Isherwood
Welsh Conservative Party
North Wales
North Wales
ocd-division/country:gb-wls/region:north_wales
Welsh Conservative Party
4087
Janet.Haworth@Assembly.Wales
Janet Haworth
Welsh Conservative Party
North Wales
North Wales
ocd-division/country:gb-wls/region:north_wales
Plaid Cymru
425
llyr.gruffydd@assembly.wales
Llyr Gruffydd
Plaid Cymru
North Wales
North Wales
ocd-division/country:gb-wls/region:north_wales
The Minister for Natural Resources
Welsh Labour
178
The Minister for Natural Resources
Carl.Sargeant@assembly.wales
Alyn and Deeside
Carl Sargeant
Welsh Labour
Alyn and Deeside
ocd-division/country:gb-wls/region:north_wales/constituency:alyn_and_deeside
Plaid Cymru
160
AlunFfred.Jones@assembly.wales
Arfon
Alun Ffred Jones
Plaid Cymru
Arfon
ocd-division/country:gb-wls/region:north_wales/constituency:arfon
The Deputy Minister for Culture, Sport and Tourism
Welsh Labour
267
The Deputy Minister for Culture, Sport and Tourism
Ken.Skates@assembly.wales
Clwyd South
Ken Skates
Welsh Labour
Clwyd South
ocd-division/country:gb-wls/region:north_wales/constituency:clwyd_south
Welsh Conservative Party
171
Darren.Millar@assembly.wales
Clwyd West
Darren Millar
Welsh Conservative Party
Clwyd West
ocd-division/country:gb-wls/region:north_wales/constituency:clwyd_west
Welsh Conservative Party
212
Janet.Finch-Saunders@Assembly.Wales
Aberconwy
Janet Finch-Saunders
Welsh Conservative Party
Aberconwy
ocd-division/country:gb-wls/region:north_wales/constituency:aberconwy
Commissioner-Welsh Labour
Welsh Labour
170
Commissioner
Sandy.Mewies@assembly.wales
Delyn
Sandy Mewies
Welsh Labour
Delyn
ocd-division/country:gb-wls/region:north_wales/constituency:delyn
Welsh Labour
161
Ann.Jones@assembly.wales
Vale of Clwyd
Ann Jones
Welsh Labour
Vale of Clwyd
ocd-division/country:gb-wls/region:north_wales/constituency:vale_of_clwyd

Statistics

Average successful run time: 2 minutes

Total run time: about 5 hours

Total cpu time used: 4 minutes

Total disk space used: 114 KB

History

  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    60 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and failed .
    34 records added, 34 records removed in the database
    39 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    63 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and failed .
    53 records added, 53 records removed in the database
    58 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    64 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    64 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    63 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    67 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    61 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    66 pages scraped
  • Auto ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Manually ran revision ca6d6483 and completed successfully .
    60 records added, 60 records removed in the database
    66 pages scraped
  • Manually ran revision bc4d33da and completed successfully .
    60 records added, 60 records removed in the database
    65 pages scraped
  • Manually ran revision 2d455c74 and completed successfully .
    60 records added in the database
    118 pages scraped
  • Manually ran revision 2d455c74 and completed successfully .
    60 records added, 56 records removed in the database
    118 pages scraped
  • Manually ran revision 4de85d11 and completed successfully .
    59 records added, 59 records removed in the database
    119 pages scraped
  • Manually ran revision 9b612fc3 and failed .
    37 records added, 37 records removed in the database
    82 pages scraped
  • Manually ran revision d28cb347 and failed .
    nothing changed in the database
    8 pages scraped
  • Manually ran revision 4de85d11 and completed successfully .
    60 records added, 60 records removed in the database
    121 pages scraped
  • Manually ran revision fba8637f and completed successfully .
    60 records added, 60 records removed in the database
    121 pages scraped
  • Manually ran revision 053eb6e9 and completed successfully .
    60 records added, 60 records removed in the database
    121 pages scraped
  • Manually ran revision bb7d1d19 and completed successfully .
    60 records added, 60 records removed in the database
  • Manually ran revision 4a7f0174 and completed successfully .
    60 records added, 60 records removed in the database
  • Manually ran revision 7e30f70c and completed successfully .
    60 records added in the database
  • Manually ran revision 7e30f70c and completed successfully .
    60 records added, 57 records removed, 3 records updated in the database
  • Manually ran revision a741ef03 and failed .
    nothing changed in the database
  • Manually ran revision bb63ec17 and completed successfully .
    60 records added, 60 records removed in the database
  • Manually ran revision 5302923d and completed successfully .
    60 records added, 60 records removed in the database
  • Manually ran revision aec4d750 and completed successfully .
    60 records added, 60 records removed in the database
  • Manually ran revision 344865a9 and completed successfully .
    60 records added, 60 records removed in the database
  • Manually ran revision 4175ae39 and completed successfully .
    60 records added in the database
  • Manually ran revision 1e653919 and completed successfully .
    nothing changed in the database
  • Manually ran revision fa875dd0 and failed .
    nothing changed in the database
  • Manually ran revision c95d2a9f and completed successfully .
    nothing changed in the database
  • Manually ran revision cb8c391a and failed .
    nothing changed in the database
  • Manually ran revision a84698c0 and completed successfully .
    nothing changed in the database
  • Manually ran revision 8d1bccfb and completed successfully .
    nothing changed in the database
  • Manually ran revision 727695bc and failed .
    nothing changed in the database
  • Manually ran revision 1e16b548 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

welsh_assembly_members / scraper.py