This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Installing activesupport-inflector 0.1.0  Fetching colorize 0.8.1  Installing coderay 1.1.1  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Installing diskcached 1.1.3  Fetching require_all 1.4.0  Fetching excon 0.55.0  Installing require_all 1.4.0  Fetching multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Installing multipart-post 2.0.0  Fetching hashie 3.5.5  Installing excon 0.55.0  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing httpclient 2.8.3  Installing i18n 0.8.1  Fetching json 2.1.0  Fetching method_source 0.8.2  Installing json 2.1.0 with native extensions  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching rubocop 0.48.1  Installing faraday_middleware 0.11.0.1  Fetching wikidata-client 0.0.10  Installing domain_name 0.5.20170404  Installing rubocop 0.48.1  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (31.98s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ‼ Q6869252 is_instance_of . Skipping ‼ Q6738431 is_instance_of . Skipping

Data

Downloaded 992 times by everypolitician MikeRalphson ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (15 KB) Use the API

rows 10 / 37

id name__en name__it name wikipedia__en gender original_wikiname name__de name__es name__nl wikipedia__de birth_date given_name name__fr name__ie name__ru wikipedia__commons wikipedia__ie image death_date name__cy name__hu last_seen name__ja occupation wikipedia__fr identifier__freebase name__la wikipedia__la name__zh
Q27057633
Abena Osei Asare
Abena Osei Asare
Abena Osei Asare
female
Abena Osei Asare
Abena Osei Asare
1979-01-16
Q5721427
Henry Ford Kamel
Henry Ford Kamel
Henry Ford Kamel
male
Henry Ford Kamel
Henry Ford Kamel
Henry Ford Kamel
Henry Ford Kamel
1961-12-21
Henry
Henry Ford Kamel
2012-12-25
Henry Ford Kamel
economist
Q42304491
Emmanuel Aboagye Didieye
Emmanuel Aboagye Didieye
Emmanuel Aboagye Didieye
male
Emmanuel Aboagye Didieye
1976-11-23
Emmanuel
2017-10-14
politician
Q5341508
Edward Adjaho
Edward Adjaho
Edward Adjaho
male
Edward Adjaho
Edward Adjaho
Edward Adjaho
Edward Adjaho
1957-01-03
Edward
Edward Adjaho
politician
Q1409254
Joseph Amenowode
Joseph Amenowode
Joseph Amenowode
male
Joseph Amenowode
Joseph Amenowode
Joseph Amenowode
Joseph Amenowode
Joseph Amenowode
Joseph
Joseph Amenowode
Joseph Amenowode
ジョセフ・アムノウォード
politician
/m/0cp19sv
Q5379334
Enoch Teye Mensah
Enoch Teye Mensah
Enoch Teye Mensah
male
Enoch Teye Mensah
Enoch Teye Mensah
Enoch Teye Mensah
1956-05-17
Enoch
Enoch Teye Mensah
politician
Q26923790
Della Sowah
Della Sowah
Della Sowah
female
Della Sowah
Della Sowah
1959-11-23
Della
politician
Q1708293
Joseph Yieleh Chireh
Joseph Yieleh Chireh
Joseph Yieleh Chireh
male
Joseph Yieleh Chireh
Joseph Yieleh Chireh
Joseph Yieleh Chireh
Joseph Yieleh Chireh
Joseph Yieleh Chireh
1954-07-08
Joseph
Joseph Yieleh Chireh
diplomat
Q16146239
Alhassan Bashir Fuseini
Alhassan Bashir Fuseini
Alhassan Bashir Fuseini
Alhassan Bashir Fuseini
male
Alhassan Bashir Fuseini
Alhassan Bashir Fuseini
Alhassan Bashir Fuseini
Alhassan Bashir Fuseini
politician
Q26210996
Gifty Klenam
Gifty Klenam
Gifty Klenam
female
Gifty Klenam
Gifty Klenam
1970-07-12
Gifty
politician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (15 KB) Use the API

rows 10 / 28

id last_seen
Q16148840
2016-06-05
Q4888931
2016-06-05
Q4665233
2016-06-05
Q5504853
2016-06-05
Q5379334
2016-06-05
Q5648740
2016-06-05
Q1409254
2016-06-05
Q4724464
2016-06-05
Q2637206
2016-06-05
Q7106472
2016-06-05

Statistics

Average successful run time: 1 minute

Total run time: about 14 hours

Total cpu time used: 28 minutes

Total disk space used: 48.8 KB

History

  • Auto ran revision 3b18c4a9 and completed successfully .
    36 records updated in the database
    6 pages scraped
  • Auto ran revision 3b18c4a9 and failed .
    nothing changed in the database
  • Auto ran revision 3b18c4a9 and failed .
    nothing changed in the database
  • Auto ran revision 3b18c4a9 and completed successfully .
    35 records updated in the database
    6 pages scraped
  • Auto ran revision 3b18c4a9 and completed successfully .
    35 records updated in the database
    6 pages scraped
  • ...
  • Created on morph.io

Show complete history