This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing ast 2.4.0  Installing activesupport-inflector 0.1.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.1.3  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Fetching require_all 2.0.0  Installing concurrent-ruby 1.1.3  Installing require_all 2.0.0  Fetching excon 0.62.0  Installing unf_ext 0.0.7.5 with native extensions  Installing excon 0.62.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.6.0  Installing hashie 3.6.0  Fetching httpclient 2.8.3  Fetching jaro_winkler 1.5.1  Installing httpclient 2.8.3  Installing jaro_winkler 1.5.1 with native extensions  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.2  Installing method_source 0.9.2  Fetching mime-types-data 3.2018.0812  Installing mime-types-data 3.2018.0812  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.2  Installing powerpack 0.1.2  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.10.0  Installing ruby-progressbar 1.10.0  Fetching unicode-display_width 1.4.0  Installing unicode-display_width 1.4.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.4.1  Installing yajl-ruby 1.4.1 with native extensions  Fetching parser 2.5.3.0  Installing parser 2.5.3.0  Fetching everypolitician-popolo 0.9.0  Installing everypolitician-popolo 0.9.0  Fetching i18n 1.1.1  Installing i18n 1.1.1  Fetching faraday 0.15.3  Installing faraday 0.15.3  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching pry 0.12.2  Installing pry 0.12.2  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.8.5  Installing nokogiri 1.8.5 with native extensions  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.60.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@f85e4b6)  Installing rubocop 0.60.0  Fetching faraday_middleware 0.12.2  Fetching domain_name 0.5.20180417  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20180417  Installing wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.22.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@9427382)  Bundle complete! 14 Gemfile dependencies, 48 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (38.20s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 1586 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (39 KB) Use the API

rows 10 / 63

id name__en name__nl name__de name__it name__fr name wikipedia__en gender birth_date given_name name__pl wikipedia__pl image name__et name__ja name__el name__es name__tr name__yo name__ar name__nb wikipedia__ar wikipedia__de wikipedia__el wikipedia__es wikipedia__et wikipedia__fr wikipedia__ja wikipedia__no wikipedia__tr wikipedia__yo identifier__freebase name__bi name__ko name__ru name__id name__tpi name__sv name__da name__nn wikipedia__bi wikipedia__da wikipedia__id wikipedia__it wikipedia__ko wikipedia__nl wikipedia__ru wikipedia__sv wikipedia__tpi name__he wikipedia__he identifier__IIAF name__zh_hans name__zh_hant name__zh_hk name__hu name__fi name__zh wikipedia__fi wikipedia__hu wikipedia__zh death_date name__mr wikipedia__mr wikipedia__commons name__cy identifier__Britannica original_wikiname last_seen occupation name__pt wikipedia__pt name__uk wikipedia__uk name__fo name__kl name__la wikipedia__la identifier__VIAF name__bar identifier__ISNI family_name name__ca name__gl name__tt name__ast identifier__LCAuth wikipedia__ruwikinews
Q7407679
Sam Iduri
Sam Iduri
Sam Iduri
Sam Iduri
Sam Iduri
male
Sam
Sam Iduri
politician
Sam Iduri
Q939825
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
male
1965-08-28
Gordon
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
ゴードン・ダルシー・リロ
Gordon Darcy Lilo
Gordon Darcy Lilo
غوردون دارسي ليلو
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
Gordon Darcy Lilo
/m/04yb3hf
Гордон Дарси Лило
Лило, Гордон Дарси
גורדון דארסי לילו
גורדון דארסי לילו
Gordon Darcy Lilo
戈登·達西·里諾
Category:Gordon Darcy Lilo
politician
Гордон Дарсі Ліло
Гордон Дарсі Ліло
Gordon Darcy Lilo
Q2791876
Dickson Mua
Dickson Mua
Dickson Mua
Dickson Mua
Dickson Mua
male
1972-11-04
Dickson
Dickson Mua Panakitasi
Dickson Mua Panakitasi
Dickson Mua
civil servant
Q16751224
Connelly Sadakabatu
Connelly Sadakabatu
Connelly Sadakabatu
Connelly Sadakabatu
male
1956-06-11
Connelly Sadakabatu
civil servant
Connelly Sadakabatu
Q6144355
James Tora
James Tora
James Tora
James Tora
James Tora
James Tora
male
1956-07-16
James
James Tora
civil servant
Tora
James Tora
Q7456493
Seth Gukuna
Seth Gukuna
Seth Gukuna
Seth Gukuna
Seth Gukuna
Seth Gukuna
male
1961-08-21
Seth
Seth Gukuna
politician
Seth Gukuna
Q6200666
Jimmy Lusibaea
Jimmy Lusibaea
Jimmy Lusibaea
Jimmy Lusibaea
Jimmy Lusibaea
male
1970-07-07
Jimmy
Jimmy Lusibaea
Jimmy Lusibaea
Jimmy Lusibaea
civil servant
Jimmy Lusibaea
Q5129896
Clay Forau Soalaoi
Clay Forau Soalaoi
Clay Forau Soalaoi
Clay Forau Soalaoi
Clay Forau Soalaoi
Clay Forau Soalaoi
male
1976-10-10
Clay
Clay Forau Soalaoi
civil servant
Clay Forau Soalaoi
Q3314404
Milner Tozaka
Milner Tozaka
Milner Tozaka
Milner Tozaka
Milner Tozaka
Milner Tozaka
male
1951-10-21
ミルナー・トザカ
Milner Tozaka
ميلنر توزاكا
George Milner Tozaka
Milner Tozaka
Category:Milner Tozaka
diplomat
Milner Tozaka
Milner Tozaka
46164427
0000 0000 4119 8528
Milner Tozaka
n2005006681
Q7177338
Peter Tom
Peter Tom
Peter Tom
Peter Tom
Peter Tom
Peter Tom (politician)
male
1964
Peter
Peter Tom
Peter Tom (homme politique)
2018-11-05
politician
Peter Tom

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (39 KB) Use the API

rows 10 / 41

id last_seen
Q6915778
2016-06-04
Q9295534
2016-06-04
Q5129896
2016-06-04
Q7915752
2016-06-04
Q6962085
2016-06-04
Q7407679
2016-06-04
Q6555508
2016-06-04
Q4954443
2016-06-04
Q6144355
2016-06-04
Q7176876
2016-06-04

Statistics

Average successful run time: less than a minute

Total run time: about 21 hours

Total cpu time used: about 1 hour

Total disk space used: 75.6 KB

History

  • Auto ran revision 649ae634 and completed successfully .
    60 records updated in the database
  • Auto ran revision 649ae634 and completed successfully .
    61 records updated in the database
  • Auto ran revision 649ae634 and completed successfully .
    63 records updated in the database
  • Auto ran revision 649ae634 and completed successfully .
    62 records updated in the database
  • Auto ran revision 649ae634 and completed successfully .
    63 records updated in the database
  • ...
  • Created on morph.io

Show complete history