This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing ast 2.4.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Installing activesupport-inflector 0.1.0  Installing colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Fetching diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Installing diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Fetching require_all 2.0.0  Installing require_all 2.0.0  Fetching excon 0.62.0  Installing unf_ext 0.0.7.5 with native extensions  Installing excon 0.62.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.5.0.5  Installing parser 2.5.0.5  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 1.0.0  Installing i18n 1.0.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.2  Installing nokogiri 1.8.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.54.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Installing rubocop 0.54.0  Fetching faraday_middleware 0.12.2  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Installing wikidata-client 0.0.12  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@f6a205f)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (34.71s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Enn Meri, Karin Tammemägi in et ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2804 for Q620859 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4889 for Q3740790 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2600 for Q1453245 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3766 for Q334700 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3925 for Q334700 FIXME: 'monolingualtext' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. {:text=>"Ladõnskaja-Kubits", :language=>"et"} ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2561 for Q449939

Data

Downloaded 1245 times by everypolitician tmtmtmtm chrismytton MikeRalphson briatte

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (249 KB) Use the API

rows 10 / 211

id name image gender birth_date given_name identifier__IMDB identifier__MusicBrainz identifier__EuroparlMEP identifier__VIAF identifier__LCAuth identifier__GND identifier__discogs name__et name__en identifier__freebase wikipedia__et wikipedia__en identifier__ISNI twitter name__pt name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__pl name__ru name__fr name__be name__es name__ro name__ca name__oc name__fi name__uk name__lv name__it name__be_tarask name__de name__cs name__io name__lt name__nl name__sk name__sl name__da name__hr name__la name__sv name__zh name__nb name__nn name__fa name__ka name__tr wikipedia__be_x_old wikipedia__be wikipedia__ca wikipedia__commons wikipedia__cs wikipedia__da wikipedia__de wikipedia__es wikipedia__etwikiquote wikipedia__fa wikipedia__fi wikipedia__fr wikipedia__io wikipedia__it wikipedia__ka wikipedia__lt wikipedia__lv wikipedia__nl wikipedia__no wikipedia__oc wikipedia__pl wikipedia__pt wikipedia__ro wikipedia__ru wikipedia__tr wikipedia__uk wikipedia__ukwikiquote wikipedia__zh wikipedia__la name__is wikipedia__is name__ja wikipedia__ja name__en_ca name__en_gb wikipedia__sv name__ie wikipedia__ie name__id wikipedia__id wikipedia__plwikiquote name__bar name__af name__an name__ast name__br name__bs name__co name__cy name__eo name__eu name__fur name__ga name__gd name__gl name__gsw name__hu name__lb name__li name__lij name__lmo name__nap name__nds name__nds_nl name__pcd name__pms name__rm name__sc name__scn name__sco name__sq name__vec name__vls name__wa identifier__SUDOC name__ko name__fo wikipedia__ko wikipedia__nn wikipedia__sco identifier__Munzinger name__bg wikipedia__bg name__he name__az name__de_ch name__el name__vi name__ar name__ta name__mk wikipedia__ar wikipedia__ast wikipedia__az wikipedia__el wikipedia__he wikipedia__lb wikipedia__ruwikinews wikipedia__ta wikipedia__vi identifier__parlement website original_wikiname identifier__allmovie name__mn name__vro wikipedia__fiu_vro wikipedia__mn identifier__IIAF name__hy wikipedia__hy identifier__BNF wikipedia__enwikiquote wikipedia__hu wikipedia__liwikiquote death_date name__yo name__sr name__se name__pt_br wikipedia__eo wikipedia__eu wikipedia__fiwikiquote wikipedia__ga wikipedia__gl wikipedia__se wikipedia__simple wikipedia__sl wikipedia__sr wikipedia__yo identifier__NNDB identifier__GTAA identifier__NTA identifier__FAST identifier__SFDb name__de_at last_seen identifier__AlloCine identifier__elonet identifier__kinopoisk identifier__CSFD identifier__DNF identifier__PORT identifier__senate_nl identifier__PACE wikipedia__tpi wikipedia__hsb name__hsb name__tpi name__bm name__frc name__frp name__ia name__jam name__kab name__kg name__mg name__min name__ms name__nrm name__pap name__prg name__rgn name__sr_el name__sw name__vmf name__vo name__wo name__zu identifier__etis_ee family_name identifier__google_knowledge occupation identifier__snac name__tt name__ba wikipedia__myv wikipedia__af identifier__ioc_athlete name__sje name__sma name__smj facebook wikipedia__azwikiquote identifier__Britannica name__nys identifier__NUKAT identifier__BIBSYS identifier__SELIBR married_name identifier__LNB instagram identifier__riigikogu
Q438802
Kristiina Ojuland
https://upload.wikimedia.org/wikipedia/commons/6/6a/Ojuland_2014_by_Ave_Maria_Mõistlik.IMG_4740.JPG
female
1966-12-17
Kristiina
97230
39146285352115371298
1099857406
Kristiina Ojuland
Kristiina Ojuland
/m/039vv6
Kristiina Ojuland
Kristiina Ojuland
OjulandK
Kristiina Ojuland
Kristiina Ojuland
Оюланд, Кристийна
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Крістійна Оюланд
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
克里斯蒂娜·O
Kristiina Ojuland
Kristiina Ojuland
კრისტიინა ოიულანდი
Category:Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
Kristiina Ojuland
კრისტიინა ოიულანდი
Kristiina Ojuland
Kristiina Ojuland
Оюланд, Кристийна
Крістійна Оюланд
Kristiina Ojuland
Kristiina Ojuland
3557
Ojuland
politician
Q12360203
Barbi Pilvre
female
1963-04-19
Barbi Pilvre
Barbi Pilvre
Barbi Pilvre
barbipilvre
Barbi Pilvre
Barbi Pilvre
Barbi Pilvre
Barbi Pilvre
Barbi Pilvre
Barbi Pilvre
2c86be76-1b5a-4bb7-9d58-e6678892c2bd
Pilvre
journalist
barbi.pilvre
b12fce45-ee22-49c9-bfdc-cc3d8dcda5e5
Q18753049
Aivar Rosenberg
male
1962-11-14
Aivar
Aivar Rosenberg
Aivar Rosenberg
Aivar Rosenberg
Aivar Rosenberg
Aivar Rosenberg
Aivar Rosenberg
Rosenberg
politician
Q12376881
Tiina Lokk
female
1955-10-01
Tiina
Tiina Lokk
Tiina Lokk
Tiina Lokk
Tiina Lokk
Tiina Lokk
Category:Tiina Lokk
Tiina Lokk
Lokk
journalist
Q16407757
Jüri Morozov
male
1958-09-10
Jüri
39149542787400301422
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Jüri Morozov
Morozov
politician
Jüri Morozov
Jüri Morozov
Jüri Morozov
Q14191221
Lauri Luik
male
1982-04-23
Lauri
Lauri Luik
Lauri Luik
Lauri Luik
lauriluik
Лаури Луйк
Lauri Luik
Lauri Luik
Lauri Luik
Category:Lauri Luik
Lauri Luik
Luik
politician
669865682
0c8c32b6-5add-4058-acb8-c76822d1d06b
Q11869065
Kaja Kallas
female
1977-06-18
Kaja
124697
Kaja Kallas
Kaja Kallas
/m/012tvcbp
Kaja Kallas
Kaja Kallas
kajakallas
Kaja Kallas
Кая Каллас
Kaja Kallas
Kaja Kallas
Kaja Kallas
Кая Каллас
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Category:Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kaja Kallas
Кая Каллас
Kaja Kallas
Kaja Kallas
Kaja Kallas
Kallas
politician
kaja.kallas
kajakallas
Q2128576
Rait Maruste
male
1953-09-27
Rait
50710147
n86103245
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Rait Maruste
Category:Rait Maruste
Rait Maruste
Rait Maruste
author
100008839053633
e3daca91-fbe7-4157-a72c-e87cda4565e1
Q465437
Urve Palo
female
1972-07-10
Urve
Urve Palo
Urve Palo
/m/02qh65x
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Category:Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Urve Palo
Palo
politician
Urve-Palo
c91bc287-d95b-4d95-aded-f7a142c1e599
Q12369932
Martin Kukk
male
1987-08-15
Martin
Martin Kukk
Martin Kukk
Martin Kukk
Category:Martin Kukk
Martin Kukk
Kukk
politician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (249 KB) Use the API

rows 10 / 196

id last_seen
Q17446896
2016-06-05
Q12366228
2016-06-05
Q16404281
2016-06-05
Q12372254
2016-06-05
Q12379326
2016-06-05
Q11857954
2016-06-05
Q12369838
2016-06-05
Q16405450
2016-06-05
Q11869065
2016-06-05
Q1385792
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 2 hours

Total disk space used: 294 KB

History

  • Auto ran revision 744a2b23 and completed successfully .
    210 records updated in the database
  • Auto ran revision 744a2b23 and completed successfully .
    210 records updated in the database
  • Auto ran revision 744a2b23 and completed successfully .
    211 records updated in the database
    32 pages scraped
  • Auto ran revision 744a2b23 and completed successfully .
    211 records updated in the database
  • Auto ran revision 744a2b23 and completed successfully .
    210 records updated in the database
    32 pages scraped
  • ...
  • Created on morph.io

Show complete history