This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Installing activesupport-inflector 0.1.0  Fetching coderay 1.1.2  Installing ast 2.4.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Fetching unf_ext 0.0.7.5  Fetching require_all 2.0.0  Installing require_all 2.0.0  Fetching excon 0.62.0  Installing diskcached 1.1.3  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Installing unf_ext 0.0.7.5 with native extensions  Installing excon 0.62.0  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.5.0.5  Installing parser 2.5.0.5  Fetching i18n 1.0.0  Installing i18n 1.0.0  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.2  Installing nokogiri 1.8.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching rubocop 0.54.0  Installing rubocop 0.54.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Fetching faraday_middleware 0.12.2  Installing faraday_middleware 0.12.2  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching domain_name 0.5.20170404  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching wikidata-client 0.0.12  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing wikidata-client 0.0.12  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@f6a205f)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (213.61s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4342 for Q57640 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2600 for Q1453245 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4889 for Q3740790 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2561 for Q449939 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5008 for Q458003 FIXME: 'monolingualtext' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. {:text=>"Ladõnskaja-Kubits", :language=>"et"} ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2804 for Q620859 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3766 for Q334700 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3925 for Q334700

Data

Downloaded 1344 times by everypolitician tmtmtmtm chrismytton MikeRalphson briatte

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (251 KB) Use the API

rows 10 / 213

id name image gender birth_date given_name identifier__IMDB identifier__MusicBrainz identifier__EuroparlMEP identifier__VIAF identifier__LCAuth identifier__GND identifier__discogs name__et name__en identifier__freebase wikipedia__et wikipedia__en identifier__ISNI twitter name__pt name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__pl name__ru name__fr name__be name__es name__ro name__ca name__oc name__fi name__uk name__lv name__it name__be_tarask name__de name__cs name__io name__lt name__nl name__sk name__sl name__da name__hr name__la name__sv name__zh name__nb name__nn name__fa name__ka name__tr wikipedia__be_x_old wikipedia__be wikipedia__ca wikipedia__commons wikipedia__cs wikipedia__da wikipedia__de wikipedia__es wikipedia__etwikiquote wikipedia__fa wikipedia__fi wikipedia__fr wikipedia__io wikipedia__it wikipedia__ka wikipedia__lt wikipedia__lv wikipedia__nl wikipedia__no wikipedia__oc wikipedia__pl wikipedia__pt wikipedia__ro wikipedia__ru wikipedia__tr wikipedia__uk wikipedia__ukwikiquote wikipedia__zh wikipedia__la name__is wikipedia__is name__ja wikipedia__ja name__en_ca name__en_gb wikipedia__sv name__ie wikipedia__ie name__id wikipedia__id wikipedia__plwikiquote name__bar name__af name__an name__ast name__br name__bs name__co name__cy name__eo name__eu name__fur name__ga name__gd name__gl name__gsw name__hu name__lb name__li name__lij name__lmo name__nap name__nds name__nds_nl name__pcd name__pms name__rm name__sc name__scn name__sco name__sq name__vec name__vls name__wa identifier__SUDOC name__ko name__fo wikipedia__ko wikipedia__nn wikipedia__sco identifier__Munzinger name__bg wikipedia__bg name__he name__az name__de_ch name__el name__vi name__ar name__ta name__mk wikipedia__ar wikipedia__ast wikipedia__az wikipedia__el wikipedia__he wikipedia__lb wikipedia__ruwikinews wikipedia__ta wikipedia__vi identifier__parlement website original_wikiname identifier__allmovie name__mn name__vro wikipedia__fiu_vro wikipedia__mn identifier__IIAF name__hy wikipedia__hy identifier__BNF wikipedia__enwikiquote wikipedia__hu wikipedia__liwikiquote death_date name__yo name__sr name__se name__pt_br wikipedia__eo wikipedia__eu wikipedia__fiwikiquote wikipedia__ga wikipedia__gl wikipedia__se wikipedia__simple wikipedia__sl wikipedia__sr wikipedia__yo identifier__NNDB identifier__GTAA identifier__NTA identifier__FAST identifier__SFDb name__de_at last_seen identifier__AlloCine identifier__elonet identifier__kinopoisk identifier__CSFD identifier__DNF identifier__PORT identifier__senate_nl identifier__PACE wikipedia__tpi wikipedia__hsb name__hsb name__tpi name__bm name__frc name__frp name__ia name__jam name__kab name__kg name__mg name__min name__ms name__nrm name__pap name__prg name__rgn name__sr_el name__sw name__vmf name__vo name__wo name__zu identifier__etis_ee family_name identifier__google_knowledge occupation identifier__snac name__tt name__ba wikipedia__myv wikipedia__af identifier__ioc_athlete name__sje name__sma name__smj facebook wikipedia__azwikiquote identifier__Britannica name__nys identifier__NUKAT identifier__BIBSYS identifier__SELIBR married_name identifier__LNB instagram identifier__riigikogu name__lfn wikipedia__sq name__myv
Q355241
Edgar Savisaar
male
1950-05-31
Edgar
6032752
n90710009
130190969
Edgar Savisaar
Edgar Savisaar
/m/02x002
Edgar Savisaar
Edgar Savisaar
0000 0000 2803 0106
Edgar Savisaar
Edgar Savisaar
Эдгар Сависаар
Edgar Savisaar
Эдгар Савісаар
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Едгар Савісаар
Edgars Savisārs
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
埃德加·薩維薩爾
Edgar Savisaar
Edgar Savisaar
ادگار ساویسار
ედგარ სავისაარი
Edgar Savisaar
Эдгар Савісаар
Edgar Savisaar
Category:Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
ادگار ساویسار
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
ედგარ სავისაარი
Edgar Savisaar
Edgars Savisārs
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Сависаар, Эдгар
Edgar Savisaar
Едгар Савісаар
Edgar Savisaar
Edgar Savisaar
エドガル・サヴィサール
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
Edgar Savisaar
에드가르 사비사르
Edgar Savisaar
에드가르 사비사르
Edgar Savisaar
Edgar Savisaar
00000019864
אדגר סאביסאר
Edgar Savisaar
1497570
Savisaar
politician
edgar.savisaar.5
Q12358088
Aare Heinvee
male
1956-09-27
Aare
Aare Heinvee
Aare Heinvee
Aare Heinvee
Aare Heinvee
Aare Heinvee
Category:Aare Heinvee
Aare Heinvee
Heinvee
politician
Q12366112
Kaja Kreisman
female
1968-03-20
Kaja
Kaja Kreisman
Kaja Kreisman
Kaja Kreisman
Kaja Kreisman
Kaja Kreisman
Kaja Kreisman
Kreisman
politician
Q12372781
Priit Toobal
male
1983-11-01
Priit
Priit Toobal
Priit Toobal
Priit Toobal
Priit Toobal
PriitToobal
Priit Toobal
Priit Toobal
Priit Toobal
Category:Priit Toobal
Priit Toobal
Toobal
politician
Q22041600
Anneli Ott
female
1976-05-02
Anneli
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Anneli Ott
Ott
politician
anneli.viitkin
4dbb83c0-9dbe-4aa7-9d89-29cf398da20d
Q12379326
Yana Toom
female
1966-10-15
Jana
124700
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Тоом, Яна Игоревна
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Category:Yana Toom
Yana Toom
Yana Toom
Yana Toom
Yana Toom
Тоом, Яна Игоревна
Yana Toom
Yana Toom
Yana Toom
Toom
politician
Q12378637
Viktor Vassiljev
male
1953-04-09
Viktor
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Category:Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
Vassiljev
politician
Viktor Vassiljev
Viktor Vassiljev
Viktor Vassiljev
100000507924540
bbbcacb7-c34f-48b7-a2ba-1680c93ff810
Q13605609
Tõnu Juul
https://upload.wikimedia.org/wikipedia/commons/f/f0/RE_Tõnu_Juul.jpg
male
1958-04-21
Tõnu
Tõnu Juul
Tõnu Juul
Tõnu Juul
Tõnu Juul
Tõnu Juul
Category:Tõnu Juul
Tõnu Juul
Juul
physician
Q618349
Rein Aidma
male
1950-09-28
Rein
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Rein Aidma
Category:Rein Aidma
Rein Aidma
Rein Aidma
Aidma
head teacher
Q12371725
Oudekki Loone
female
1979-02-05
Oudekki
Oudekki Loone
Oudekki Loone
Oudekki Loone
oudekkiloone
Oudekki Loone
Oudekki Loone
Oudekki Loone
Oudekki Loone
Oudekki Loone
Kerstin Oudekki_Loone
Loone
politician
oudekki
5472f8ce-5ad8-432a-b4a6-5ae523e7c8f7

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (251 KB) Use the API

rows 10 / 196

id last_seen
Q17446896
2016-06-05
Q12366228
2016-06-05
Q16404281
2016-06-05
Q12372254
2016-06-05
Q12379326
2016-06-05
Q11857954
2016-06-05
Q12369838
2016-06-05
Q16405450
2016-06-05
Q11869065
2016-06-05
Q1385792
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 2 hours

Total disk space used: 296 KB

History

  • Auto ran revision 744a2b23 and completed successfully .
    212 records updated in the database
  • Auto ran revision 744a2b23 and completed successfully .
    211 records updated in the database
  • Auto ran revision 744a2b23 and completed successfully .
    211 records updated in the database
    32 pages scraped
  • Auto ran revision 744a2b23 and completed successfully .
    213 records updated in the database
  • Auto ran revision 744a2b23 and completed successfully .
    213 records updated in the database
  • ...
  • Created on morph.io

Show complete history