This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing activesupport-inflector 0.1.0  Installing rake 12.0.0  Installing ast 2.3.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Installing coderay 1.1.1  Fetching colorize 0.8.1  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Installing diskcached 1.1.3  Fetching require_all 1.4.0  Fetching excon 0.55.0  Installing require_all 1.4.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching multipart-post 2.0.0  Installing excon 0.55.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.5  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Installing domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing rubocop 0.48.1  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (41.10s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ‼ Q13521888 is_instance_of Kuwaiti general election. Skipping ‼ Q16128252 is_instance_of Wikimedia list article. Skipping

Data

Downloaded 1313 times by everypolitician tmtmtmtm MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18 KB) Use the API

rows 10 / 25

id name__fr name__ar name__en name__pl name__sv name__es name wikipedia__ar wikipedia__en wikipedia__fr wikipedia__pl wikipedia__sv gender birth_date identifier__freebase name__nl given_name name__de image original_wikiname name__hu last_seen name__ja identifier__GND name__it name__he wikipedia__he occupation name__nds name__ru identifier__ISNI identifier__VIAF identifier__LCAuth death_date identifier__EGAXA name__fa name__pt wikipedia__fa wikipedia__hu wikipedia__it wikipedia__pt identifier__FIFA wikipedia__es wikipedia__ca name__ca wikipedia__lad name__lad name__ko wikipedia__ko wikipedia__de name__uk wikipedia__uk wikipedia__azb name__ast name__azb wikipedia__bn name__bn
Q7403899
Saleh Ashour
صالح عاشور
Saleh Ashour
Saleh Ashour
صالح عاشور
صالح عاشور
Saleh Ashour
male
1952
Saleh Ashour
Saleh
Saleh Ashour
صالح عاشور
politician
Saleh Ashour
Q6781875
مرزوق الغانم
Marzouq Al-Ghanim
Marzouq Al-Ghanim
مرزوق الغانم
مرزوق الغانم
Marzouq Al-Ghanim
male
1968-11-03
Marzouq Al-Ghanim
مرزوق الغانم
politician
Marzouq Al-Ghanim
Q3603412
Abdullah Mayouf
عبد الله معيوف
Abdullah Mayouf
Abdullah Mayouf
Abdullah Mayouf
عبد الله معيوف
عبد الله معيوف
Abdullah Mayouf
Abdullah Mayouf
Abd Allah Majuf
male
1953-12-03
/m/0h64z7_
Abdullah Mayouf
Abdullah
Abdullah Mayouf
عبد الله معيوف
Abdullah Mayouf
Abdullah Mayouf
association football player
عبدالله معیوف
Abdullah Mayouf
عبدالله معیوف
Abdullah Mayouf
Abdullah Mayouf
Abdullah Mayouf
Абдулла Маюф
Абдулла Маюф
عبدالله معیوف
Abdullah Mayouf
عبدالله معیوف
Q16124633
راكان النصف
Rakan Al-Nisf
Rakan Al-Nisf
راكان النصف
راكان النصف
Rakan Al-Nisf
male
1980-05-25
راكان النصف
politician
Rakan Al-Nisf
Q37640827
عبد الكريم الكندري
Abdulkarim Al-Kanderi
Abdulkarim Al-Kanderi
عبد الكريم الكندري
عبد الكريم الكندري
Abdulkarim Al-Kanderi
male
1981
Abdulkarim Al-Kanderi
عبد الكريم الكندري
Abdulkarim Al-Kanderi
Q12215893
سعد الخنفور
سعد الخنفور
سعد الخنفور
male
1965
سعد الخنفور
politician
Q12231638
فيصل الدويسان
فيصل الدويسان
فيصل الدويسان
male
1964
فيصل الدويسان
politician
Q12241088
محمد هادي الحويلة
محمد هادي الحويلة
محمد هادي الحويلة
male
Mohammed
محمد هادي الحويلة
politician
Q6399230
Khalaf Al-Enezi
خلف دميثير
Khalaf Al-Enezi
Khalaf Al-Enezi
خلف دميثير
خلف دميثير
Khalaf Al-Enezi
female
1952
Khalaf Al-Enezi
خلف دميثير
politician
Khalaf Al-Enezi
Q4807126
Askar Al-Enezi
عسكر العنزي
Askar Al-Enezi
Askar Al-Enezi
عسكر العنزي
عسكر العنزي
Askar Al-Enezi
male
1971
Askar Al-Enezi
Askar
عسكر العنزي
politician
Askar Al-Enezi

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18 KB) Use the API

rows 10 / 19

id last_seen
Q4724623
2016-06-04
Q22688792
2016-06-04
Q16124633
2016-06-04
Q4807126
2016-06-04
Q12231638
2016-06-04
Q12238483
2016-06-04
Q2385060
2016-06-04
Q6781875
2016-06-04
Q7370752
2016-06-04
Q7398031
2016-06-04

Statistics

Average successful run time: half a minute

Total run time: about 12 hours

Total cpu time used: 41 minutes

Total disk space used: 50.5 KB

History

  • Auto ran revision 70fd265c and completed successfully .
    25 records updated in the database
  • Auto ran revision 70fd265c and completed successfully .
    22 records updated in the database
  • Auto ran revision 70fd265c and completed successfully .
    25 records updated in the database
  • Auto ran revision 70fd265c and completed successfully .
    24 records updated in the database
  • Auto ran revision 70fd265c and completed successfully .
    25 records updated in the database
  • ...
  • Created on morph.io

Show complete history