everypolitician-scrapers / uk-house-of-commons-wikidata

https://morph.io/tmtmtmtm/uk-house-of-commons-wikidata

Scrapes query.wikidata.org, www.wikidata.org, and raw.githubusercontent.com

Wikidata Query Service (Beta)


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/...  Fetching dependency metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching https://github.com/everypolitician/wikisnakker.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Installing activesupport-inflector 0.1.0  Installing coderay 1.1.1  Installing colorize 0.8.1  Installing diskcached 1.1.2  Installing unf_ext 0.0.7.2 with native extensions  Installing require_all 1.3.3  Installing excon 0.54.0  Installing multipart-post 2.0.0  Installing hashie 3.4.6  Installing httpclient 2.8.2.4  Installing i18n 0.7.0  Installing json 2.0.2 with native extensions  Installing method_source 0.8.2  Installing mime-types-data 3.2016.0521  Installing mini_portile2 2.1.0  Installing netrc 0.11.0  Installing open-uri-cached 0.0.5  Installing slop 3.6.0  Installing sqlite3 1.3.12 with native extensions  Using wikisnakker 0.7.0 from https://github.com/everypolitician/wikisnakker.git (at master@cc55a4f)  Using bundler 1.11.2  Installing unf 0.1.4  Installing everypolitician-popolo 0.8.0  Installing faraday 0.9.2  Installing mime-types 3.1  Installing nokogiri 1.6.8.1 with native extensions  Installing pry 0.10.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Installing domain_name 0.5.20160826  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Installing faraday_middleware 0.10.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.0  Installing mediawiki_api 0.7.0  Using wikidata-fetcher 0.19.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@1ecdefc)  Bundle complete! 13 Gemfile dependencies, 38 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (36.53s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... To fetch: 1344 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q1494468 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2469 for Q263802 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q728063 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q262742 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1053 for Q691216 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3051 for Q234182 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q390192 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3222 for Q291169 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q291169 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1899 for Q332412 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q264618 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3051 for Q192 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q266978 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2469 for Q182408 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1813 for Q19872361 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2600 for Q9559 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q9559 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q333499 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3051 for Q302244 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q391562 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1424 for Q264766 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q272670 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3222 for Q216594 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q216594 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q267105 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3051 for Q478832 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q478832 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q180589

Data

Downloaded 59 times by everypolitician octopusinvitro ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.51 MB) Use the API

rows 10 / 1344

id name__en name__en_ca name__en_gb name__sv name__es name__nl name__de name__fr name__uk name__it name__hu name__zh name wikipedia__commons wikipedia__en wikipedia__fr wikipedia__it wikipedia__sv wikipedia__uk image gender birth_date identifier__freebase given_name website identifier__journalisted identifier__parliamentDOTuk identifier__hansard identifier__publicwhip identifier__current_hansard identifier__TWFY identifier__bbc_democracy_live original_wikiname name__ko name__ga wikipedia__es wikipedia__ga wikipedia__ko wikipedia__zh name__la name__pt name__pl name__he name__fa name__ja wikipedia__de wikipedia__he wikipedia__la wikipedia__nl wikipedia__pl wikipedia__pt identifier__VIAF identifier__BNF identifier__SUDOC family_name identifier__NNDB name__fi name__nb wikipedia__fi wikipedia__no identifier__GTAA name__mg wikipedia__mg identifier__PACE name__da name__nn name__ta name__cy wikipedia__cy name__zh_hant name__sco name__ca wikipedia__ca wikipedia__sco name__vi name__eu name__gd name__br name__id name__gl name__pcd name__eo name__oc death_date identifier__Oxforddnb name__kw wikipedia__gd identifier__ISNI identifier__GND identifier__LCAuth identifier__FAST wikipedia__eo wikipedia__cswikiquote wikipedia__da wikipedia__simple twitter name__ru name__de_ch wikipedia__enwikiquote wikipedia__enwikisource wikipedia__ru name__yue name__zh_hk wikipedia__id identifier__WelshBiography name__zh_cn wikipedia__hu wikipedia__kw identifier__IMDB wikipedia__ja identifier__ULAN name__cs name__et name__hr name__lt name__ro name__sk name__sl wikipedia__eu name__el name__nds identifier__NPG honorific_suffix identifier__parliamentary_record name__af name__an name__ast name__bar name__co name__de_at name__frp name__fur name__gsw name__ia name__ie name__io name__is name__kg name__lb name__li name__lij name__min name__ms name__nap name__nds_nl name__nrm name__pms name__pt_br name__rm name__sc name__scn name__sr_el name__sw name__tr name__vec name__vls name__vo name__wa name__wo name__zu wikipedia__et wikipedia__zh_yue name__mr wikipedia__mr name__zh_hans name__zh_mo name__zh_my name__zh_sg name__zh_tw identifier__NTA identifier__CSPAN identifier__guardian_topic name__pa wikipedia__cs wikipedia__fa wikipedia__gl wikipedia__pa wikipedia__ro wikipedia__tr wikipedia__vi honorific_prefix identifier__EuroparlMEP identifier__OLID identifier__Munzinger identifier__parlement name__si wikipedia__si name__ar name__arz name__be name__bg name__bn name__hi name__lv name__pnb name__tg name__tt name__yo name__hy name__ne name__sh name__sq wikipedia__ar wikipedia__arz wikipedia__be wikipedia__bg wikipedia__bn wikipedia__hi wikipedia__hy wikipedia__io wikipedia__lv wikipedia__ms wikipedia__ne wikipedia__nn wikipedia__oc wikipedia__plwikiquote wikipedia__pnb wikipedia__sh wikipedia__sq wikipedia__tg wikipedia__tt wikipedia__yo identifier__NDL identifier__NLA identifier__MusicBrainz identifier__CANTIC identifier__wikitree identifier__national_archives name__bm name__frc name__jam name__kab name__pap name__prg name__rgn name__vmf name__yi name__sr_ec name__sr name__az name__mk name__sgs name__jv name__azb wikipedia__af wikipedia__azb wikipedia__az wikipedia__bat_smg wikipedia__br wikipedia__el wikipedia__hr wikipedia__ie wikipedia__is wikipedia__jv wikipedia__lt wikipedia__nds wikipedia__ruwikinews wikipedia__sr wikipedia__yi wikipedia__zu identifier__SBN_it identifier__NKC identifier__Britannica facebook name__bs name__ceb name__dsb name__eml name__fo name__frr name__fy name__hsb name__mt name__tl wikipedia__lb wikipedia__ruwikiquote name__pdc name__stq name__war identifier__NLI identifier__google_knowledge name__gv name__bcl name__ka name__ku name__mi name__ml name__qu name__sa name__th name__ur name__new name__ckb name__nan name__vro name__be_tarask name__mn name__uz wikipedia__an wikipedia__arwikiquote wikipedia__ast wikipedia__bcl wikipedia__be_x_old wikipedia__bgwikiquote wikipedia__bs wikipedia__bswikiquote wikipedia__ckb wikipedia__enwikinews wikipedia__eswikiquote wikipedia__fawikiquote wikipedia__fiu_vro wikipedia__fiwikiquote wikipedia__fo wikipedia__fy wikipedia__gv wikipedia__hewikiquote wikipedia__hywikiquote wikipedia__ia wikipedia__itwikiquote wikipedia__ka wikipedia__ku wikipedia__li wikipedia__mi wikipedia__mk wikipedia__ml wikipedia__mn wikipedia__new wikipedia__nlwikiquote wikipedia__nowikiquote wikipedia__pms wikipedia__ptwikiquote wikipedia__qu wikipedia__rm wikipedia__sa wikipedia__scn wikipedia__sk wikipedia__sl wikipedia__slwikiquote wikipedia__svwikiquote wikipedia__ta wikipedia__th wikipedia__tl wikipedia__trwikiquote wikipedia__ukwikiquote wikipedia__ur wikipedia__uz wikipedia__war wikipedia__zh_min_nan identifier__SELIBR identifier__BIBSYS identifier__britishmuseum identifier__discogs identifier__bigenc_ru identifier__NLAtrove wikipedia__azwikiquote noble_title name__ku_arab name__ku_latn name__tg_latn name__ilo name__xmf wikipedia__ilo wikipedia__xmf identifier__BNE identifier__AlloCine identifier__GNC identifier__allmovie identifier__SFDb identifier__elonet identifier__PORT identifier__SCOPE identifier__kinopoisk identifier__CSFD identifier__DNF name__kl identifier__N6I name__mzn wikipedia__mzn wikipedia__bar wikipedia__cawikiquote wikipedia__eowikinews identifier__TED identifier__OpenPlaques identifier__NLP name__lmo wikipedia__vo identifier__debretts_today name__fit name__ty identifier__DoUB identifier__NUKAT name__bi name__hak name__my name__os name__pam name__so name__pih name__kk name__ks name__lrc name__or wikipedia__bi wikipedia__dsb wikipedia__frwikinews wikipedia__hak wikipedia__hsb wikipedia__kk wikipedia__ks wikipedia__lrc wikipedia__my wikipedia__or wikipedia__os wikipedia__pam wikipedia__pih wikipedia__so wikipedia__thwikiquote name__szl name__gu name__ky wikipedia__gu wikipedia__ky wikipedia__lmo wikipedia__szl identifier__youtube name__rw wikipedia__rw name__wuu wikipedia__wuu identifier__ORCID wikipedia__hrwikiquote wikipedia__cywikiquote name__ht name__nov name__tpi wikipedia__afwikiquote wikipedia__als wikipedia__eswikinews wikipedia__ht wikipedia__nov wikipedia__tpi wikipedia__wo wikipedia__zhwikinews identifier__CiNii name__ksh wikipedia__ksh name__mai wikipedia__mai wikipedia__bewikiquote wikipedia__eml identifier__politifact wikipedia__hiwikiquote occupation identifier__nobel_prize identifier__BiblioNet wikipedia__gom name__gom identifier__nyt_topic identifier__nlg
Q333600
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley, Baron Wigley
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley
male
1943-04-01
/m/02l9rw
Dafydd
lords/lord-wigley/547
mr-dafydd-wigley
Dafydd Wigley
ダヴィズ・ウィグリー
Dafydd Wigley, Baron Wigley
23865266
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley
Dafydd Wigley
n96061064
376401
dafydd_wigley
Dafydd Wigley
OL502202A
politician
Q333714
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
尼爾·帕里什
Neil Parish
Neil Parish
male
1956-05-26
/m/035vdv
Neil
commons/neil-parish/4072
neil_parish
neil_parish
尼爾·帕里什
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
Neil Parish
4528
politician
Q19882875
Thangam Debbonaire
Thangam Debbonaire
Thangam Debbonaire
Thangam Debbonaire
譚甘·達本那
Thangam Debbonaire
Thangam Debbonaire
female
1966-08-03
commons/thangam-debbonaire/4433
7350030
nr2006006253
politician
Q17180679
Robert Jenrick
Robert Jenrick
Robert Jenrick
Robert Jenrick
Robert Jenrick
羅伯特·詹里克
Robert Jenrick
Robert Jenrick
male
1982-01-09
Robert
commons/robert-jenrick/4320
羅伯特·詹里克
lawyer
Q19938322
Edward Argar
Edward Argar
Edward Argar
Edward Argar
愛德華·阿格
Edward Argar
Edward Argar
male
1977-12-09
Edward
commons/edward-argar/4362
愛德華·阿格
Q19881816
Marion Fellows
Marion Fellows
Marion Fellows
Marion Fellows
Marion Fellows
Marion Fellows
Marion Fellows
female
1949-05-05
/m/0136_p76
Marion
commons/marion-fellows/4440
25277/marion_fellows/motherwell_and_wishaw
Marion Fellows
Marion Fellows
Marion Fellows
marion53f
politician
Q695257
Jack Lopresti
Jack Lopresti
Jack Lopresti
Jack Lopresti
Jack Lopresti
傑克·洛普雷斯蒂
Jack Lopresti
Jack Lopresti
male
1969-08-23
/m/0bx_h45
Jack
commons/jack-lopresti/3989
jack_lopresti
jack_lopresti
傑克·洛普雷斯蒂
politician
Q478714
Andrew Selous
Andrew Selous
Andrew Selous
Andrew Selous
Andrew Selous
Andrew Selous
Andrew Selous
安德魯·塞羅斯
Andrew Selous
Andrew Selous
male
1962-04-27
/m/029yhf
Andrew
commons/andrew-selous/1453
mr-andrew-selous
安德魯·塞羅斯
politician
Q264585
Alan Whitehead
Alan Whitehead
Alan Whitehead
Alan Whitehead
Alan Whitehead
Alan Whitehead
Alan Whitehead
Alan Whitehead
Alan Whitehead
阿倫·懷特希德
Alan Whitehead
Alan Whitehead
Alan Whitehead
male
1950-09-15
/m/02847c
Alan
commons/dr-alan-whitehead/62
dr-alan-whitehead
Alan_Whitehead
alan_whitehead
25238
阿倫·懷特希德
Alan Whitehead
Alan Whitehead
Alan Whitehead
politician
Q18921442
Ian Blackford
Ian Blackford
Ian Blackford
Ian Blackford
Ian Blackford
Ian Blackford
Ian Blackford
伊恩·布萊克福德
Ian Blackford
Ian Blackford
male
1961-05-14
/m/012nwwn1
Ian
commons/ian-blackford/4390
25361/ian_blackford/ross%2C_skye_and_lochaber
137070
伊恩·布萊克福德
Ian Blackford
Ian Blackford
Ian Blackford
IBlackfordSkye
politician

Statistics

Average successful run time: 16 minutes

Total run time: about 12 hours

Total cpu time used: about 1 hour

Total disk space used: 1.56 MB

History

  • Auto ran revision bcbd6d52 and completed successfully .
    1343 records updated in the database
    230 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1342 records updated in the database
    229 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1342 records updated in the database
    230 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1344 records updated in the database
    226 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1343 records updated in the database
    228 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1343 records updated in the database
    229 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1343 records updated in the database
    226 pages scraped
  • Auto ran revision bcbd6d52 and failed .
    nothing changed in the database
  • Auto ran revision bcbd6d52 and completed successfully .
    1344 records updated in the database
    227 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1 record added, 1342 records updated in the database
  • Auto ran revision bcbd6d52 and completed successfully .
    1343 records updated in the database
    228 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    2 records added, 1341 records updated in the database
  • Manually ran revision bcbd6d52 and completed successfully .
    nothing changed in the database
    226 pages scraped
  • Auto ran revision bcbd6d52 and completed successfully .
    1341 records updated in the database
    229 pages scraped
  • Manually ran revision bcbd6d52 and completed successfully .
    1341 records updated in the database
    227 pages scraped
  • Manually ran revision 19622867 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1339 records updated in the database
    225 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1340 records updated in the database
    222 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1340 records updated in the database
    223 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1340 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1340 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1340 records updated in the database
    223 pages scraped
  • Auto ran and failed .
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    222 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    222 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    841 records added, 500 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and failed .
    841 records removed, 500 records updated in the database
    87 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    224 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    691 records added, 650 records updated in the database
    219 pages scraped
  • Auto ran revision 19622867 and failed .
    691 records removed, 650 records updated in the database
    108 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1339 records updated in the database
    223 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    220 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1339 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    220 pages scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    220 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    nothing changed in the database
    224 pages scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    169 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    nothing changed in the database
    221 pages scraped
  • Auto ran revision 19622867 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1339 records updated in the database
    219 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1339 records updated in the database
    221 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    217 pages scraped
  • Auto ran revision 19622867 and completed successfully .
    1341 records updated in the database
    223 pages scraped
  • Auto ran revision 14b93f02 and completed successfully .
    1340 records updated in the database
    221 pages scraped
  • Manually ran revision 14b93f02 and completed successfully .
    1091 records added, 250 records updated in the database
  • Auto ran revision c66e2f5f and failed .
    1091 records removed, 250 records updated in the database
    341 pages scraped
  • Auto ran revision c66e2f5f and completed successfully .
    1341 records updated in the database
    1562 pages scraped
  • Manually ran revision c66e2f5f and completed successfully .
    1341 records added in the database
    1563 pages scraped
  • Created on morph.io