This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm ondenman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/...  Fetching dependency metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching https://github.com/everypolitician/wikisnakker.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Installing activesupport-inflector 0.1.0  Installing coderay 1.1.1  Installing colorize 0.8.1  Installing diskcached 1.1.2  Installing unf_ext 0.0.7.2 with native extensions  Installing everypolitician-popolo 0.6.1  Installing require_all 1.3.3  Installing excon 0.53.0  Installing multipart-post 2.0.0  Installing hashie 3.4.6  Installing httpclient 2.8.2.4  Installing i18n 0.7.0  Installing json 2.0.2 with native extensions  Installing method_source 0.8.2  Installing mime-types-data 3.2016.0521  Installing mini_portile2 2.1.0  Installing netrc 0.11.0  Installing open-uri-cached 0.0.5  Installing slop 3.6.0  Installing sqlite3 1.3.12 with native extensions  Using wikisnakker 0.7.0 from https://github.com/everypolitician/wikisnakker.git (at master@cc55a4f)  Using bundler 1.11.2  Installing unf 0.1.4  Using everypolitician 0.18.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@3ebe575)  Installing faraday 0.9.2  Installing mime-types 3.1  Installing nokogiri 1.6.8.1 with native extensions  Installing pry 0.10.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Installing domain_name 0.5.20160826  Installing faraday_middleware 0.10.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.0  Installing mediawiki_api 0.7.0  Using wikidata-fetcher 0.18.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@cc464f2)  Bundle complete! 13 Gemfile dependencies, 38 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (35.14s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1248 for Q1481132 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1847 for Q1481132 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2750 for Q1481132 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q3352327 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q4585238 Unknown value for P106 for Q3430608 ‼ Q14942405 is_instance_of Wikimedia list article. Skipping ‼ Q6628215 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q463724 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2287 for Q3434791 ‼ Q1711448 is_instance_of Wikimedia list article. Skipping ‼ Q1711498 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q6215090 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2287 for Q329331 ‼ Q11986385 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2287 for Q4788361 ‼ Q2792058 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2287 for Q274637 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2287 for Q709870 ‼ Q11986384 is_instance_of Wikimedia list article. Skipping ‼ Q6628216 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1248 for Q207655 ‼ Q11986383 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q947952 ‼ Q11986386 is_instance_of Wikimedia list article. Skipping ‼ Q14436947 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3222 for Q1271 ‼ Q6628214 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1248 for Q326587 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1248 for Q6515779 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1847 for Q6515779 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2750 for Q6515779 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2287 for Q3432182 ‼ Q1972267 is_instance_of Wikimedia list article. Skipping ‼ Q6628217 is_instance_of Wikimedia list article. Skipping Unknown value for P106 for Q7159099 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1138 for Q12329996 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q11066700 ‼ Q6628221 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q1682219 ‼ Q6628218 is_instance_of Wikimedia list article. Skipping ‼ Q14436945 is_instance_of Wikimedia list article. Skipping ‼ Q6628213 is_instance_of Wikimedia list article. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1248 for Q380659 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1222 for Q164346 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3222 for Q164346 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P586 for Q4579325

Data

Downloaded 49 times by everypolitician ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.09 MB) Use the API

rows 10 / 2000

id name__nn name__en name__se name__es name__de name__fr name__nb name__eo name__nl name__da name__sv name__hu name wikipedia__da wikipedia__en wikipedia__nn wikipedia__no wikipedia__se image gender birth_date identifier__freebase given_name identifier__storting original_wikiname death_date wikipedia__de wikipedia__sv name__lb name__zh name__eu name__pl name__qu name__ta name__af name__oc name__ms name__sw name__et name__el name__bcl name__ga name__ar name__pt name__is name__ru name__sr name__tr name__fi name__uk name__be_tarask name__io name__kk name__an name__ko name__he name__be name__yo name__lv name__it name__gl name__id name__ja name__vi name__sh name__ku name__ro name__ca name__la name__fo name__cs name__mr name__bg name__fa name__lt name__pt_br name__lmo name__en_gb name__ka name__sco name__ml name__hi name__az name__br name__ie name__hy wikipedia__af wikipedia__an wikipedia__ar wikipedia__az wikipedia__bcl wikipedia__be_x_old wikipedia__be wikipedia__bg wikipedia__br wikipedia__ca wikipedia__commons wikipedia__cs wikipedia__cswikiquote wikipedia__dewikiquote wikipedia__el wikipedia__enwikiquote wikipedia__eo wikipedia__es wikipedia__et wikipedia__eu wikipedia__fa wikipedia__fawikiquote wikipedia__fi wikipedia__fo wikipedia__fr wikipedia__ga wikipedia__gl wikipedia__he wikipedia__hi wikipedia__hu wikipedia__id wikipedia__ie wikipedia__io wikipedia__is wikipedia__it wikipedia__ja wikipedia__ka wikipedia__kk wikipedia__ko wikipedia__ku wikipedia__la wikipedia__lb wikipedia__lmo wikipedia__lt wikipedia__lv wikipedia__ml wikipedia__mr wikipedia__ms wikipedia__nl wikipedia__nowikiquote wikipedia__oc wikipedia__pl wikipedia__plwikiquote wikipedia__pt wikipedia__qu wikipedia__ro wikipedia__ru wikipedia__ruwikinews wikipedia__sco wikipedia__sh wikipedia__simple wikipedia__sr wikipedia__sw wikipedia__ta wikipedia__tr wikipedia__uk wikipedia__vi wikipedia__yo wikipedia__zh identifier__ISNI identifier__VIAF identifier__GND identifier__LCAuth identifier__BNF identifier__SUDOC identifier__IMDB identifier__BIBSYS identifier__NNDB identifier__Munzinger identifier__GTAA identifier__parlement twitter facebook identifier__FAST name__bs wikipedia__bswikiquote name__nds name__cy identifier__OLID identifier__polsys name__ceb name__hr name__nds_nl name__pms name__sk name__sl name__sq name__vec name__wa name__gsw website identifier__wikitree identifier__N6I wikipedia__nowikisource identifier__NTA family_name name__mg wikipedia__mg noble_title identifier__bigenc_ru identifier__PACE identifier__CERL name__ast name__bar name__bm name__co name__de_at name__de_ch name__en_ca name__frc name__frp name__fur name__gd name__ia name__jam name__kab name__kg name__li name__lij name__min name__nap name__nrm name__pap name__pcd name__prg name__rgn name__rm name__sc name__scn name__sr_el name__vls name__vmf name__vo name__wo name__zu name__bn name__mk name__pdc wikipedia__ast wikipedia__bn wikipedia__sk identifier__NSK name__ur wikipedia__nnwikiquote wikipedia__ur identifier__NLAtrove name__zh_hant name__zh_cn identifier__GNC wikipedia__enwikisource name__ty name__sr_ec name__diq identifier__MusicBrainz identifier__NKC identifier__AlloCine identifier__SFDb identifier__kinopoisk identifier__TED identifier__Gutenberg wikipedia__species wikipedia__hy name__zh_hans name__zh_hk name__zh_sg name__zh_tw identifier__Britannica name__war name__new name__sa wikipedia__new wikipedia__ptwikiquote wikipedia__sa wikipedia__war identifier__NLI identifier__NPG name__vep wikipedia__vep name__tl name__ku_arab name__ku_latn name__ne wikipedia__cy wikipedia__eswikiquote wikipedia__frwikiquote wikipedia__hr wikipedia__ia wikipedia__sl wikipedia__slwikiquote wikipedia__tl identifier__NDL identifier__NLA name__szl wikipedia__szl name__fit name__kl wikipedia__nds wikipedia__sq identifier__NUKAT name__ch name__jv name__my name__te name__zh_mo name__zh_my name__th name__arz name__pa wikipedia__arz wikipedia__bs wikipedia__jv wikipedia__my wikipedia__ne wikipedia__pa wikipedia__te wikipedia__th identifier__SELIBR wikipedia__bar name__frr name__fy name__hsb name__dsb name__eml name__as name__lad name__aa name__ak name__aln name__ang name__arn name__ay name__bi name__bjn name__brh name__cbk_zam name__cdo name__cho name__chr name__chy name__cr name__crh_latn name__csb name__dtp name__ee name__ext name__ff name__fj name__gag name__gn name__got name__ha name__hak name__haw name__hif name__hif_latn name__ho name__ht name__hz name__ig name__ik name__ike_cans name__ike_latn name__ilo name__iu name__jbo name__kaa name__ki name__kj name__kk_latn name__kk_kz name__kk_tr name__kr name__krj name__ksh name__lg name__ln name__loz name__ltg name__lus name__lzz name__map_bms name__mi name__mt name__mus name__mwl name__na name__nah name__ng name__nl_informal name__nov name__nso name__nv name__ny name__om name__pag name__pam name__pdt name__pfl name__pih name__qug name__rif name__rmy name__rn name__roa_tara name__rup name__ruq name__ruq_latn name__rw name__sat name__sdc name__sei name__sg name__sgs name__shi name__shi_latn name__sli name__sm name__sma name__sn name__so name__srn name__st name__stq name__tet name__tg_latn name__tk name__tn name__to name__tokipona name__tpi name__tru name__ts name__tt_latn name__tum name__ug_latn name__uz name__ve name__vot name__xh name__za name__zea occupation
Q7827239
Torstein Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Tvedt Solberg
Torstein Solberg
Torstein Tvedt Solberg
male
1985
Torstein
Torstein Tvedt Solberg
politician
Q4560151
Hans N. Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans Nilsen Hauge
Hans N. Hauge
Hans Nilsen Hauge
male
1853-11-03
Hans
Hans Nilsen Hauge
1931-12-17
politician
Q290960
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
Siri Hall Arnøy
https://upload.wikimedia.org/wikipedia/commons/6/67/Siri_Hall_Arnøy_(cropped).jpg
female
1978-11-28
Siri
SAR
Siri Hall Arnøy
Siri Hall Arnøy
221901323
politician
Q4993420
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
Grete Knudsen
female
1940-10-13
/m/0bcfb6
Grete
Grete Knudsen
グレテ・ヌードセン
227962847
nm2084779
2567
politician
Q11977891
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
Jakob Aano
male
1920-04-10
Jakob
JAAA
Jakob Aano
2016-02-10
雅各布·奥诺
雅各布·奥诺
273316823
n92083399
308547
Jakob Aano
politician
Q3432049
Anne T. Wøien
Anne Tingelstad Wøien
Anne Tingelstad Wøien
Anne Tingelstad Wøien
Anne Tingelstad Wøien
Anne T. Wøien
Anne Tingelstad Wøien
Anne T. Wøien
Anne T. Wøien
Anne Tingelstad Wøien
Anne Tingelstad Wøien
Anne Tingelstad Wøien
Anne T. Wøien
Anne T. Wøien
https://upload.wikimedia.org/wikipedia/commons/0/0d/Anne_Tingelstad_Wøien.jpg
female
1965-06-18
Anne
Anne Tingelstad Wøien
politician
Q4819628
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
Aud Blattmann
female
1937-09-26
Aud
AUB
Aud Blattmann
politician
Q6371925
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
Karl J. Brommeland
male
1913-01-13
Karl
KABM
Karl J. Brommeland
1999-06-19
politician
Q527177
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
Trond Giske
https://upload.wikimedia.org/wikipedia/commons/5/59/Kulturminister_Trond_Giske_på_åpningen_av_Rockheim.jpg
male
1966-11-07
/m/08dfdh
Trond
Trond Giske
Trond Giske
Trond Giske
Trond Giske
トロンド・ギスケ
Trond Giske
Trond Giske
222186258
1033342769
no2012075303
nm1435548
4022677
economist
Q8002131
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
Wilhelm Suhrke
Wilhelm Christian Suhrke
male
1863-11-02
Wilhelm
Wilhelm Christian Suhrke
1950-05-10
Category:Wilhelm Christian Suhrke
Wilhelm Christian Suhrke
politician

Statistics

Average successful run time: 16 minutes

Total run time: about 13 hours

Total cpu time used: about 2 hours

Total disk space used: 2.15 MB

History

  • Auto ran revision bceba4cf and completed successfully .
    1 record added, 1998 records updated in the database
    163 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1 record added, 1996 records updated in the database
    163 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    13 records added, 1983 records updated in the database
    163 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    8 records added, 1977 records updated in the database
  • Auto ran revision bceba4cf and completed successfully .
    nothing changed in the database
  • Auto ran revision bceba4cf and completed successfully .
    1976 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1977 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1975 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1 record added, 1976 records updated in the database
  • Auto ran revision bceba4cf and completed successfully .
    1974 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1975 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1974 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1976 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1976 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1976 records added in the database
    162 pages scraped
  • Auto ran and failed .
  • Auto ran revision bceba4cf and completed successfully .
    nothing changed in the database
    162 pages scraped
  • Auto ran revision bceba4cf and failed .
    nothing changed in the database
  • Auto ran revision bceba4cf and completed successfully .
    nothing changed in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    nothing changed in the database
    162 pages scraped
  • Auto ran revision bceba4cf and failed .
    1965 records removed in the database
    120 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1962 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1965 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1964 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1 record added, 1962 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1964 records updated in the database
    162 pages scraped
  • Auto ran revision bceba4cf and completed successfully .
    1964 records updated in the database
    162 pages scraped
  • Manually ran revision bceba4cf and completed successfully .
    1718 records added, 246 records updated in the database
  • Auto ran revision 9d76743c and failed .
    1716 records removed, 246 records updated in the database
    527 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1961 records updated in the database
    2178 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1961 records updated in the database
    2180 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    3 records added, 1959 records updated in the database
    2179 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1958 records updated in the database
    2177 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1958 records updated in the database
    2174 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1959 records updated in the database
    2174 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1959 records updated in the database
    2177 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1958 records updated in the database
    4354 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1958 records updated in the database
    2175 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1956 records updated in the database
  • Auto ran revision 9d76743c and completed successfully .
    1959 records updated in the database
  • Manually ran revision 9d76743c and completed successfully .
    1958 records updated in the database
  • Auto ran revision 9d76743c and completed successfully .
    1959 records added in the database
    2175 pages scraped
  • Auto ran revision 9d76743c and failed .
    1959 records removed in the database
    93 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1959 records updated in the database
    2175 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    969 records added, 990 records updated in the database
    2175 pages scraped
  • Auto ran revision 9d76743c and failed .
    969 records removed, 990 records updated in the database
    1267 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1464 records added, 495 records updated in the database
    2176 pages scraped
  • Auto ran revision 9d76743c and failed .
    495 records added in the database
    814 pages scraped
  • Auto ran revision 9d76743c and failed .
    1959 records removed in the database
    99 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    nothing changed in the database
    2175 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1959 records updated in the database
    2177 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1959 records updated in the database
    2175 pages scraped
  • Auto ran revision 9d76743c and completed successfully .
    1957 records updated in the database
    2176 pages scraped
  • Manually ran revision 9d76743c and completed successfully .
    1959 records added in the database
    2176 pages scraped
  • Created on morph.io