mashedkeyboard / scottish-parliament-wikidata

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Fetching colorize 0.8.1  Fetching diskcached 1.1.3  Installing coderay 1.1.1  Installing colorize 0.8.1  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching require_all 1.4.0  Installing require_all 1.4.0  Fetching excon 0.55.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching hashie 3.5.5  Installing excon 0.55.0  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing httpclient 2.8.3  Installing i18n 0.8.1  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing domain_name 0.5.20170404  Installing rubocop 0.48.1  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing wikidata-client 0.0.10  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (29.71s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:933:in `connect_nonblock': SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (Faraday::SSLError) from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:933:in `connect' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:863:in `do_start' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:852:in `start' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:1398:in `request' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/adapter/net_http.rb:80:in `perform_request' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/adapter/net_http.rb:38:in `block in call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/adapter/net_http.rb:85:in `with_net_http_connection' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/adapter/net_http.rb:33:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday_middleware-0.11.0.1/lib/faraday_middleware/response/follow_redirects.rb:78:in `perform_with_redirection' from /app/vendor/bundle/ruby/2.3.0/gems/faraday_middleware-0.11.0.1/lib/faraday_middleware/response/follow_redirects.rb:66:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-cookie_jar-0.0.6/lib/faraday/cookie_jar.rb:22:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/request/url_encoded.rb:15:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/request/multipart.rb:15:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/rack_builder.rb:139:in `build_response' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/connection.rb:386:in `run_request' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.12.1/lib/faraday/connection.rb:186:in `post' from /app/vendor/bundle/ruby/2.3.0/gems/mediawiki_api-0.7.1/lib/mediawiki_api/client.rb:206:in `send_request' from /app/vendor/bundle/ruby/2.3.0/gems/mediawiki_api-0.7.1/lib/mediawiki_api/client.rb:232:in `raw_action' from /app/vendor/bundle/ruby/2.3.0/gems/mediawiki_api-0.7.1/lib/mediawiki_api/client.rb:36:in `action' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/wikidata-fetcher-6cbd151eb97f/lib/wikidata/category.rb:21:in `_categorymembers_search' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/wikidata-fetcher-6cbd151eb97f/lib/wikidata/category.rb:25:in `members' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/wikidata-fetcher-6cbd151eb97f/lib/wikidata/category.rb:45:in `member_titles' from scraper.rb:13:in `block in <main>' from scraper.rb:13:in `map' from scraper.rb:13:in `<main>'

Data

Downloaded 587 times by loudspeek-bot mashedkeyboard

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (284 KB) Use the API

rows 10 / 134

id name name__en name__gd name__ja name__nl name__bn name__es name__ast name__sco name__sl wikipedia__en wikipedia__gd wikipedia__sco occupation gender given_name image twitter family_name identifier__democracyclub original_wikiname name__de name__fr name__nb name__da name__nn name__sv name__hu name__ru name__ca wikipedia__commons wikipedia__de birth_date name__it identifier__hansard identifier__freebase identifier__rush name__ar wikipedia__ar name__tr name__zh wikipedia__tr name__az wikipedia__az wikipedia__ca name__ga wikipedia__ga identifier__snac name__cy name__zh_hant name__zh_cn name__zh_hans wikipedia__es identifier__VIAF identifier__LCAuth death_date identifier__FAST identifier__ISNI identifier__Oxforddnb identifier__national_archives name__fa name__nds name__en_ca name__en_gb wikipedia__fr website wikipedia__hu name__af name__an name__bar name__br name__co name__cs name__de_at name__de_ch name__eo name__et name__eu name__fi name__frp name__fur name__gl name__gsw name__hr name__ia name__id name__ie name__io name__is name__kg name__lb name__li name__lij name__mg name__min name__ms name__nap name__nds_nl name__nrm name__oc name__pcd name__pl name__pms name__pt name__pt_br name__rm name__ro name__sc name__scn name__sk name__sr_el name__sw name__vec name__vi name__vls name__vo name__wa name__wo name__zu identifier__parliamentDOTuk identifier__ukparliamentid name__he name__la name__mk name__el name__uk name__yue name__fy name__ko name__ka name__zh_hk name__zh_mo name__zh_my name__zh_sg name__zh_tw name__eml name__or name__hy name__te wikipedia__af wikipedia__bar wikipedia__br wikipedia__cs wikipedia__cy wikipedia__da wikipedia__el wikipedia__eml wikipedia__enwikinews wikipedia__enwikiquote wikipedia__eo wikipedia__et wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__fy wikipedia__gl wikipedia__he wikipedia__id wikipedia__ie wikipedia__is wikipedia__it wikipedia__ja wikipedia__ka wikipedia__ko wikipedia__la wikipedia__nl wikipedia__nlwikinews wikipedia__no wikipedia__oc wikipedia__pl wikipedia__plwikiquote wikipedia__pt wikipedia__ro wikipedia__ru wikipedia__ruwikinews wikipedia__simple wikipedia__sv wikipedia__te wikipedia__uk wikipedia__zh_yue wikipedia__zh identifier__GND identifier__guardian_topic identifier__ne_se identifier__BBC_things identifier__quora identifier__Britannica identifier__GTAA name__bm name__frc name__jam name__kab name__lt name__lv name__pap name__prg name__rgn name__vmf name__azb wikipedia__azb facebook wikipedia__mg identifier__publicwhip identifier__TWFY identifier__NPG name__fo name__kl name__kn identifier__EuroparlMEP identifier__wikitree identifier__google_knowledge identifier__bbc_democracy_live honorific_prefix identifier__NTA noble_title name__sh name__bg name__be name__be_tarask name__ext wikipedia__an wikipedia__be_x_old wikipedia__be wikipedia__bewikiquote wikipedia__bg wikipedia__cawikiquote wikipedia__eowikinews wikipedia__sh wikipedia__vi identifier__PACE name__sr_ec name__sr wikipedia__sr wikipedia__hy name__ty identifier__NNDB identifier__BIBSYS identifier__NUKAT name__qu wikipedia__ast wikipedia__io wikipedia__qu wikipedia__ms identifier__current_hansard identifier__journalisted name__sq name__ta wikipedia__ta name__ang name__nys wikipedia__bat_smg wikipedia__itwikiquote name__sgs wikipedia__ia name__arz wikipedia__arz wikipedia__kw name__kw identifier__NLP wikipedia__th name__th instagram identifier__youtube name__no wikipedia__wuu name__wuu wikipedia__fo name__ne
Q2063795
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
politician
female
Pauline
https://upload.wikimedia.org/wikipedia/commons/7/7e/Pauline_McNeill.jpg
pauline4glasgow
McNeill
8393
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Category:Pauline McNeill
Pauline McNeill
1962-09-12
Pauline McNeill
/m/09zndy
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Pauline McNeill
Q544755
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
politician
female
Susan
https://upload.wikimedia.org/wikipedia/commons/d/dc/Susan_Deacon.jpg
Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
1964-02-02
Susan Deacon
/m/057nlz
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Susan Deacon
Q7816757
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
politician
male
Tom
https://upload.wikimedia.org/wikipedia/commons/1/10/Tom_McCabe.jpg
McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Том МакКейб
Tom McCabe
Tom McCabe
1954-04-28
Tom McCabe
/m/05t8qf
Tom McCabe
Tom McCabe
2015-04-19
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Tom McCabe
Q1225080
John Farquhar Munro
John Farquhar Munro
Iain Fearchar Rothach
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
Iain Fearchar Rothach
politician
male
John
https://upload.wikimedia.org/wikipedia/commons/b/b3/Iain_Fearchar_Rothach_aig_SMO.jpg
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
1934-08-26
John Farquhar Munro
/m/040l5q
جون فاركوهار مونرو
جون فاركوهار مونرو
John Farquhar Munro
2014-01-26
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
John Farquhar Munro
Q944741
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
কেনেথ গিবসন
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson (Scottish politician)
Kenneth Gibson
Kenneth Gibson (Scots politeecian)
politician
male
Kenneth
https://upload.wikimedia.org/wikipedia/commons/f/f2/KennethGibsonMSP20110507.JPG
Gibson
9129
Kenneth Gibson (Scottish politician)
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Кеннет Гибсон
Kenneth Gibson
Kenneth Gibson (Politiker, 1961)
1961-09-08
Kenneth Gibson
/m/097g07
كينيث جيبسون
كينيث جيبسون (سياسي)
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Kenneth Gibson
Q1324826
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
politician
female
Elaine
https://upload.wikimedia.org/wikipedia/commons/7/7b/ElaineMurrayMSP20110510.JPG
Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Category:Elaine Murray
Elaine Murray
1954-12-22
Elaine Murray
/m/0bk1qy
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Elaine Murray
Q1265439
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
politician
male
Duncan
https://upload.wikimedia.org/wikipedia/commons/f/fb/DuncanMcNeilMSP20110511.JPG
McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Category:Duncan McNeil
Duncan McNeil
1950-09-07
Duncan McNeil
/m/0414x5
دونكان ماكنيل
دونكان ماكنيل
http://www.duncanmcneil.com/
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Duncan McNeil
Q333630
Nicol Stephen, Baron Stephen
Nicol Stephen, Baron Stephen
Nicol MacSteaphain
ニコル・スティーヴン
Nicol Stephen, Baron Stephen
Nicol Stephen, Baron Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
politician
male
Nicol
https://upload.wikimedia.org/wikipedia/commons/b/bc/Nicol_Stephen.jpg
Stephen
Nicol Stephen
Nicol Stephen, Baron Stephen
Nicol Stephen
Nicol Stephen, baron Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen, Baron Stephen
Nicol Stephen, Baron Stephen
Nicol Stephen
Category:Nicol Stephen
Nicol Stephen, Baron Stephen
1960-03-23
Nicol Stephen, Baron Stephen
mr-nicol-stephen
/m/05s0wy
2970
نيكول ستيفن
نيكول ستيفن
Nicol Stephen
尼科尔·斯蒂芬
Nicol Stephen
Nicol Stephen
Nicol Stephen
尼科爾·斯蒂芬
尼科尔·斯蒂芬
尼科尔·斯蒂芬
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
lords/lord-stephen/4239
F93hJ4DF
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
Nicol Stephen
نيكول ستيفن
نيكول ستيفن
Q765484
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins (politician)
politician
male
Ian
Jenkins
Ian Jenkins (politician)
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins (Politiker)
1941
Ian Jenkins
/m/0cbp4w
يان جنكينز
يان جنكينز
Ian Jenkins
Ian Jenkins
Ian Jenkins
Ian Jenkins
Q1515752
Alex Neil
Alex Neil
Ailig Neil
アレックス・ニール
Alex Neil
Alex Neil
Alex Neil
Alex Neil
Alex Neil
Alex Neil (politician)
Ailig Neil
Alex Neil (politeecian)
politician
male
Alex
https://upload.wikimedia.org/wikipedia/commons/6/69/AlexNeilMSP20110507.jpg
Neil
7511
Alex Neil (politician)
Alex Neil
Alex Neil
Alex Neil
Alex Neil
Alex Neil
Alex Neil
Алекс Нил
Alex Neil
Category:Alex Neil MSP
Alex Neil (Politiker)
1951-08-22
Alex Neil
/m/01j9yl
أليكس نيل
أليكس نيل
亚历克斯·内尔
亞歷克斯·內爾
亚历克斯·内尔
亚历克斯·内尔
الکس نیل
Alex Neil
Alex Neil
Alex Neil
Alex Neil
Alex Neil

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 319 KB

History

  • Auto ran revision 0b29a059 and failed .
    nothing changed in the database
  • Auto ran revision 0b29a059 and failed .
    nothing changed in the database
  • Auto ran revision 0b29a059 and failed .
    nothing changed in the database
  • Auto ran revision 0b29a059 and failed .
    nothing changed in the database
  • Auto ran revision 0b29a059 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history