This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Installing rake 12.0.0  Fetching colorize 0.8.1  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Installing colorize 0.8.1  Fetching unf_ext 0.0.7.4  Fetching require_all 1.4.0  Installing coderay 1.1.1  Installing require_all 1.4.0  Fetching excon 0.55.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing excon 0.55.0  Fetching hashie 3.5.5  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Fetching http-cookie 1.0.3  Installing rubocop 0.48.1  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (36.75s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P803 for Q26897753 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P803 for Q31031224 Unknown value for P734 for Q9286002 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P803 for Q256650 Unknown value for P734 for Q14918481 Unknown value for P734 for Q9336209 Unknown value for P734 for Q11712387 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P803 for Q3919972 Unknown value for P734 for Q9348622 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P803 for Q31031236 Unknown value for P734 for Q9336219 Unknown value for P734 for Q9370084 Unknown value for P734 for Q14917844 Unknown value for P734 for Q9391301 Unknown value for P734 for Q9371375 Unknown value for P734 for Q11780622 Unknown value for P734 for Q14393799 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P803 for Q63113982 Unknown value for P734 for Q14422105 Unknown value for P734 for Q14866893 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3766 for Q434537 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3884 for Q434537 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3925 for Q434537 Unknown value for P734 for Q14394031 Unknown value for P734 for Q26897718 Unknown value for P734 for Q9144071 ‼ Q13134148 is_instance_of Wikimedia list article. Skipping Unknown value for P734 for Q14421992 Unknown value for P734 for Q14918190 ‼ Q26868980 is_instance_of Wikimedia list article. Skipping

Data

Downloaded 1680 times by everypolitician MikeRalphson tmtmtmtm octopusinvitro

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (96 KB) Use the API

rows 10 / 152

id name__en name name__be name__ru name__pl image gender birth_date identifier__freebase given_name identifier__IIAF family_name wikipedia__en wikipedia__be wikipedia__ru wikipedia__pl name__pt name__fr name__fi name__uk name__it name__be_tarask name__et name__de name__ja name__sv name__nl name__es name__nb wikipedia__be_x_old wikipedia__de wikipedia__et wikipedia__fi wikipedia__fr wikipedia__it wikipedia__ja wikipedia__nl wikipedia__no wikipedia__pt wikipedia__sv wikipedia__uk wikipedia__plwikiquote name__af name__an name__ast name__bar name__br name__bs name__ca name__co name__cs name__cy name__da name__eo name__eu name__fur name__ga name__gd name__gl name__gsw name__hr name__hu name__is name__lb name__li name__lij name__lmo name__lt name__nap name__nds name__nds_nl name__nn name__pcd name__pms name__rm name__ro name__sc name__scn name__sco name__sk name__sl name__sq name__tr name__vec name__vls name__wa original_wikiname last_seen name__ar wikipedia__ar name__kana name__ko wikipedia__ko occupation wikipedia__commons wikipedia__es wikipedia__bewikiquote identifier__VIAF name__zh name__sr wikipedia__hu wikipedia__sr website facebook identifier__ioc_athlete identifier__LNB identifier__LCAuth wikipedia__cy identifier__ISNI
Q26897707
Ілья Аляксандравіч Мурашка
Ілья Аляксандравіч Мурашка
male
1981-06-17
Ілья Аляксандравіч Мурашка
Ілья Аляксандравіч Мурашка
politician
Q26897692
Леанід Паўлавіч Мажэйка
Леанід Паўлавіч Мажэйка
male
1954-03-18
Леанід Паўлавіч Мажэйка
Леанід Паўлавіч Мажэйка
politician
Q26897735
Halina Filipovich
Halina Filipovich
Галіна Васільеўна Філіповіч
Галина Васильевна Филиппова
female
1966-11-12
Galina
Галіна Васільеўна Філіповіч
Halina Filipowitsch
Halina Filipovich
Halina Filipovich
Галіна Васільеўна Філіповіч
politician
Q26897722
Віктар Уладзіміравіч Русак
Віктар Уладзіміравіч Русак
male
1955-05-04
Віктар Уладзіміравіч Русак
Віктар Уладзіміравіч Русак
politician
Q31031238
Людміла Мікалаеўна Канановіч
Людміла Мікалаеўна Канановіч
female
1966-12-03
Людміла Мікалаеўна Канановіч
Людміла Мікалаеўна Канановіч
Q26897753
Вольга Мікалаеўна Папко
Вольга Мікалаеўна Папко
female
1976-07-24
Вольга Мікалаеўна Папко
Вольга Мікалаеўна Папко
historian
Q31031242
Леанід Іванавіч Качына
Леанід Іванавіч Качына
male
1967-11-15
Леанід Іванавіч Качына
Леанід Іванавіч Качына
Q26897728
Эдуард Аляксандравіч Сенькевіч
Эдуард Аляксандравіч Сенькевіч
male
1952-04-15
Эдуард Аляксандравіч Сенькевіч
Эдуард Аляксандравіч Сенькевіч
politician
Q11753400
Leanid Apanasyuk
Leanid Apanasyuk
Леанід Апанасюк
Апанасюк, Леонид Николаевич
Leanid Apanasiuk
male
1956-01-08
Leonid
Apanasyuk
Леанід Мікалаевіч Апанасюк
Leanid Apanasiuk
Leanid Apanasyuk
Леанід Апанасюк
Leanid Apanasyuk
Leanid Apanasyuk
Leanid Apanasyuk
Leanid Apanasiuk
politician
Q14918570
Viktar Valyushytski
Viktar Valyushytski
Віктар Іванавіч Валюшыцкі
Виктор Иванович Валюшицкий
Wiktar Waluszycki
male
1962-02-04
Viktar
Valyushytski
Віктар Іванавіч Валюшыцкі
Wiktar Waluszycki
Віктар Іванавіч Валюшыцкі
Viktar Valyushytski
Wiktar Waluszycki
economist

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (96 KB) Use the API

rows 10 / 32

id last_seen
Q9367697
2016-06-05
Q9144087
2016-06-05
Q9371375
2016-06-05
Q14421992
2016-06-05
Q9348622
2016-06-05
Q14917844
2016-06-05
Q9373951
2016-06-05
Q14394031
2016-06-05
Q2029677
2016-06-05
Q9375489
2016-06-05

Statistics

Average successful run time: less than a minute

Total run time: about 16 hours

Total cpu time used: about 1 hour

Total disk space used: 132 KB

History

  • Auto ran revision 0f24274b and completed successfully .
    152 records updated in the database
  • Auto ran revision 0f24274b and completed successfully .
    149 records updated in the database
  • Auto ran revision 0f24274b and completed successfully .
    151 records updated in the database
  • Auto ran revision 0f24274b and completed successfully .
    152 records updated in the database
  • Auto ran revision 0f24274b and completed successfully .
    151 records updated in the database
  • ...
  • Created on morph.io

Show complete history