Contributors tmtmtmtm mashedkeyboard

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.3 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/.. [1G Fetching dependency metadata from https://rubygems.org/. [1G Fetching https://github.com/everypolitician/scraped.git [1G Fetching https://github.com/openc/sqlite_magic.git [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching https://github.com/everypolitician/wikidata-fetcher.git [1G Fetching rake 12.3.2 [1G Fetching ast 2.4.0 [1G Using bundler 1.15.2 [1G Fetching coderay 1.1.2 [1G Installing ast 2.4.0 [1G Installing rake 12.3.2 [1G Installing coderay 1.1.2 [1G Fetching unf_ext 0.0.7.6 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching excon 0.64.0 [1G Fetching multipart-post 2.0.0 [1G Installing excon 0.64.0 [1G Installing multipart-post 2.0.0 [1G Fetching field_serializer 0.3.0 [1G Fetching hashie 3.6.0 [1G Installing hashie 3.6.0 [1G Installing field_serializer 0.3.0 [1G Fetching httpclient 2.8.3 [1G Installing httpclient 2.8.3 [1G Fetching jaro_winkler 1.5.2 [1G Installing jaro_winkler 1.5.2 with native extensions [1G Fetching json 2.2.0 [1G Installing json 2.2.0 with native extensions [1G Fetching method_source 0.9.2 [1G Installing method_source 0.9.2 [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching netrc 0.11.0 [1G Installing netrc 0.11.0 [1G Fetching parallel 1.17.0 [1G Installing parallel 1.17.0 [1G Fetching psych 3.1.0 [1G Installing psych 3.1.0 with native extensions [1G Fetching rainbow 3.0.0 [1G Installing rainbow 3.0.0 [1G Fetching require_all 2.0.0 [1G Installing require_all 2.0.0 [1G Fetching ruby-progressbar 1.10.0 [1G Installing ruby-progressbar 1.10.0 [1G Fetching unicode-display_width 1.5.0 [1G Installing unicode-display_width 1.5.0 [1G Fetching sqlite3 1.4.0 [1G Installing sqlite3 1.4.0 with native extensions [1G Fetching yajl-ruby 1.4.1 [1G Installing yajl-ruby 1.4.1 with native extensions [1G Fetching parser 2.6.2.1 [1G Installing parser 2.6.2.1 [1G Fetching faraday 0.15.4 [1G Installing faraday 0.15.4 [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching pry 0.12.2 [1G Installing pry 0.12.2 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e) [1G Fetching rubocop 0.67.2 [1G Installing rubocop 0.67.2 [1G Fetching faraday_middleware 0.13.1 [1G Installing faraday_middleware 0.13.1 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching wikisnakker 0.9.1 [1G Installing wikisnakker 0.9.1 [1G Fetching wikidata-client 0.0.12 [1G Installing wikidata-client 0.0.12 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching faraday-cookie_jar 0.0.6 [1G Installing faraday-cookie_jar 0.0.6 [1G Fetching rest-client 2.0.2 [1G Installing rest-client 2.0.2 [1G Fetching mediawiki_api 0.7.1 [1G Installing mediawiki_api 0.7.1 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@7fd4391) [1G Using wikidata-fetcher 0.24.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@cb919d1) [1G Bundle complete! 9 Gemfile dependencies, 43 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from rubocop: [1G Performance Cops will be removed from RuboCop 0.68. Use rubocop-performance gem instead. [1G Put this in your Gemfile. [1G gem 'rubocop-performance' [1G And then execute: [1G $ bundle install [1G Put this into your .rubocop.yml. [1G require: rubocop-performance [1G More information: https://github.com/rubocop-hq/rubocop-performance [1G Bundle completed (20.77s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 14 times by mashedkeyboard

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (117 KB) Use the API

rows 10 / 382

statement id name constituency_id constituency party_id party start_date end_date term
Q6530486-CB8A1D67-BFFE-44CB-89F5-710EB4E90A5D
Q6530486
Lesley Griffiths
Q8038114
Wrexham
Q832685
Welsh Labour
2021-05-06
6
Q42846969-24B6E708-A9EB-4C6E-9453-28F17BE6FEED
Q42846969
Jane Dodds
Q6841063
Mid and West Wales
Q7981939
Welsh Liberal Democrats
2021-05-06
6
Q6236400-CB2F14B5-B0ED-4BE6-AC37-63F1084755C2
Q6236400
John Griffiths
Q7018848
Newport East
Q832685
Welsh Labour
2021-05-06
6
Q6297656-8CCC64F9-DABF-4E14-8DB7-153231381DBE
Q6297656
Joyce Watson
Q6841063
Mid and West Wales
Q832685
Welsh Labour
2021-05-06
6
Q6662955-12635913-C184-478A-9D4E-66AF5FBCE017
Q6662955
Llyr Huws Gruffydd
Q7057143
North Wales
Q10691
Plaid Cymru
2021-05-06
6
Q6767407-FCE37360-7600-41C5-B2B3-13F2B79FA797
Q6767407
Mark Drakeford
Q5038486
Cardiff West
Q832685
Welsh Labour
2021-05-06
6
Q6847187-24773F4F-9076-4F10-B257-D0DDA92E4803
Q6847187
Mike Hedges
Q7653683
Swansea East
Q832685
Welsh Labour
2021-05-06
6
Q7150146-EBD3192A-FF5D-43E0-87FF-8FDA4BCD4033
Q7150146
Paul Davies
Q7240912
Preseli Pembrokeshire
Q7981882
Welsh Conservative Party
2021-05-06
6
Q24035607-8779C698-9612-44C1-8BDF-C962F73EE6D3
Q24035607
Rhianon Passmore
Q6084441
Islwyn
Q832685
Welsh Labour
2021-05-06
6
Q24039661-DDA0F2DE-F298-40F9-9DFB-2AAD34FA6861
Q24039661
Lee Waters
Q6661286
Llanelli
Q832685
Welsh Labour
2021-05-06
6

Statistics

Average successful run time: less than a minute

Total run time: about 5 hours

Total cpu time used: 5 minutes

Total disk space used: 136 KB

History

  • Auto ran revision 13c4e67f and completed successfully .
    nothing changed in the database
  • Auto ran revision 13c4e67f and completed successfully .
    300 records updated in the database
  • Auto ran revision 13c4e67f and completed successfully .
    nothing changed in the database
  • Auto ran revision 13c4e67f and completed successfully .
    200 records updated in the database
  • Auto ran revision 13c4e67f and completed successfully .
    200 records updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

welsh-assembly-p39s / scraper.rb