Contributors tmtmtmtm mashedkeyboard

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.3 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/.. [1G Fetching dependency metadata from https://rubygems.org/. [1G Fetching https://github.com/everypolitician/scraped.git [1G Fetching https://github.com/openc/sqlite_magic.git [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching https://github.com/everypolitician/wikidata-fetcher.git [1G Fetching rake 12.3.2 [1G Fetching ast 2.4.0 [1G Using bundler 1.15.2 [1G Fetching coderay 1.1.2 [1G Installing ast 2.4.0 [1G Installing coderay 1.1.2 [1G Installing rake 12.3.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching excon 0.64.0 [1G Fetching multipart-post 2.0.0 [1G Installing multipart-post 2.0.0 [1G Installing excon 0.64.0 [1G Fetching field_serializer 0.3.0 [1G Fetching hashie 3.6.0 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Installing hashie 3.6.0 [1G Fetching httpclient 2.8.3 [1G Installing httpclient 2.8.3 [1G Installing field_serializer 0.3.0 [1G Fetching jaro_winkler 1.5.2 [1G Installing jaro_winkler 1.5.2 with native extensions [1G Fetching json 2.2.0 [1G Installing json 2.2.0 with native extensions [1G Fetching method_source 0.9.2 [1G Installing method_source 0.9.2 [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching netrc 0.11.0 [1G Installing netrc 0.11.0 [1G Fetching parallel 1.17.0 [1G Installing parallel 1.17.0 [1G Fetching psych 3.1.0 [1G Installing psych 3.1.0 with native extensions [1G Fetching rainbow 3.0.0 [1G Installing rainbow 3.0.0 [1G Fetching require_all 2.0.0 [1G Installing require_all 2.0.0 [1G Fetching ruby-progressbar 1.10.0 [1G Installing ruby-progressbar 1.10.0 [1G Fetching unicode-display_width 1.5.0 [1G Installing unicode-display_width 1.5.0 [1G Fetching sqlite3 1.4.0 [1G Installing sqlite3 1.4.0 with native extensions [1G Fetching yajl-ruby 1.4.1 [1G Installing yajl-ruby 1.4.1 with native extensions [1G Fetching parser 2.6.2.1 [1G Installing parser 2.6.2.1 [1G Fetching faraday 0.15.4 [1G Installing faraday 0.15.4 [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching pry 0.12.2 [1G Installing pry 0.12.2 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e) [1G Fetching rubocop 0.67.2 [1G Installing rubocop 0.67.2 [1G Fetching faraday_middleware 0.13.1 [1G Installing faraday_middleware 0.13.1 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching wikisnakker 0.9.1 [1G Installing wikisnakker 0.9.1 [1G Fetching wikidata-client 0.0.12 [1G Installing wikidata-client 0.0.12 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching faraday-cookie_jar 0.0.6 [1G Installing faraday-cookie_jar 0.0.6 [1G Fetching rest-client 2.0.2 [1G Installing rest-client 2.0.2 [1G Fetching mediawiki_api 0.7.1 [1G Installing mediawiki_api 0.7.1 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@7fd4391) [1G Using wikidata-fetcher 0.24.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@cb919d1) [1G Bundle complete! 9 Gemfile dependencies, 43 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from rubocop: [1G Performance Cops will be removed from RuboCop 0.68. Use rubocop-performance gem instead. [1G Put this in your Gemfile. [1G gem 'rubocop-performance' [1G And then execute: [1G $ bundle install [1G Put this into your .rubocop.yml. [1G require: rubocop-performance [1G More information: https://github.com/rubocop-hq/rubocop-performance [1G Bundle completed (20.29s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 14 times by mashedkeyboard

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (117 KB) Use the API

rows 10 / 382

statement id name constituency_id constituency party_id party start_date end_date term
Q5254977-568B0B5E-1377-4719-8129-C02BF6B7A8FC
Q5254977
Delyth Evans
Q6841063
Mid and West Wales
Q832685
Welsh Labour
2000-05-01
2003-04-02
1
Q6519732-3C6D3366-0DB4-410D-9F26-F9EE31403543
Q6519732
Leighton Andrews
Q7321386
Rhondda
Q832685
Welsh Labour
2003-05-01
2007-03-28
2
Q7325461-24C9456D-878C-4499-BD61-A8864725BBA4
Q7325461
Richard Edwards
Q7240912
Preseli Pembrokeshire
Q832685
Welsh Labour
1999-05-06
2003-04-02
1
Q7356340-54AB42B2-62A9-4FBD-96A8-FF664B6CE3B7
Q7356340
Rod Richards
Q7057143
North Wales
Q7981882
Welsh Conservative Party
1999-05-06
2000-02-08
1
Q7356340-55771315-4df2-09d6-383f-9cb4603d4060
Q7356340
Rod Richards
Q7057143
North Wales
Q2415493
non-attached
2000-02-08
2002-09-10
1
Q7681863-CA4E7438-C31E-49A1-B56A-0E1E5C138529
Q7681863
Tamsin Dunwoody
Q7240912
Preseli Pembrokeshire
Q832685
Welsh Labour
2003-05-01
2007-03-28
2
Q19397-F820D5EF-2B44-4FE5-BA5D-6E2C80F4ABF2
Q19397
Alun Michael
Q6841063
Mid and West Wales
Q832685
Welsh Labour
1999-05-06
2000-05-01
1
Q268030-062ED74B-4427-4521-927C-8E37CFCF9071
Q268030
Alun Cairns
Q7568795
South Wales West
Q7981882
Welsh Conservative Party
1999-05-06
2003-04-02
1
Q268030-C64880AC-2373-4EC7-BD15-2C2BBEB7E3A9
Q268030
Alun Cairns
Q7568795
South Wales West
Q7981882
Welsh Conservative Party
2003-05-01
2007-03-28
2
Q3405113-5C683D67-5BBA-492E-B1D3-04467E948CF7
Q3405113
Cynog Dafis
Q6841063
Mid and West Wales
Q10691
Plaid Cymru
1999-05-06
2003-04-02
1

Statistics

Average successful run time: less than a minute

Total run time: about 4 hours

Total cpu time used: 4 minutes

Total disk space used: 136 KB

History

  • Auto ran revision 13c4e67f and completed successfully .
    382 records updated in the database
  • Auto ran revision 13c4e67f and completed successfully .
    300 records updated in the database
  • Auto ran revision 13c4e67f and completed successfully .
    300 records updated in the database
  • Auto ran revision 13c4e67f and completed successfully .
    300 records updated in the database
  • Auto ran revision 13c4e67f and completed successfully .
    300 records updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

welsh-assembly-p39s / scraper.rb