This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0.pre.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler --pre`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.3.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Installing rake 12.3.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Fetching colorize 0.8.1  Installing colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Installing unf_ext 0.0.7.4 with native extensions  Installing coderay 1.1.2  Fetching require_all 1.4.0  Installing concurrent-ruby 1.0.5  Installing require_all 1.4.0  Fetching excon 0.59.0  Installing excon 0.59.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.6  Installing hashie 3.5.6  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.0  Installing parallel 1.12.0  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.4.0.2  Installing parser 2.4.0.2  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 0.9.1  Installing i18n 0.9.1  Fetching faraday 0.13.1  Installing faraday 0.13.1  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Fetching rubocop 0.51.0  Installing faraday_middleware 0.12.2  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.11  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing rubocop 0.51.0  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing wikidata-client 0.0.11  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@a2938a6)  Bundle complete! 14 Gemfile dependencies, 48 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (36.57s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0.pre.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler --pre`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2987 for Q3543427 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1580 for Q1285526 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1225 for Q285536 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2094 for Q486359

Data

Downloaded 733 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (124 KB) Use the API

rows 10 / 133

id name__nl name__en name__tl name__es name__de name__fr name__hu name__ja name wikipedia__en wikipedia__nl wikipedia__tl gender identifier__VIAF birth_date given_name original_wikiname wikipedia__de name__pl name__ru name__it name__nb name__da name__nn name__sv name__id wikipedia__es wikipedia__fr wikipedia__id wikipedia__it wikipedia__pl wikipedia__ru image identifier__ISNI identifier__GND identifier__LCAuth identifier__SUDOC identifier__freebase identifier__NTA identifier__Munzinger twitter identifier__FAST name__bcl name__ilo name__zh wikipedia__bcl wikipedia__commons wikipedia__ilo name__zh_hans name__zh_hant name__zh_hk name__pam name__pag name__qu name__ko name__he name__uz name__ceb name__cbk_zam name__lv name__vi name__el name__ia name__ga name__ar name__pt name__ro name__th name__fi name__la name__war name__cs name__az name__hr name__ca name__af name__an name__br name__eo name__et name__eu name__gl name__is name__lb name__lmo name__lt name__nds_nl name__pms name__sk name__sl name__sq name__tr name__wa name__gsw name__fa name__uk name__kk name__ms name__sr name__my wikipedia__ar wikipedia__az wikipedia__ca wikipedia__cbk_zam wikipedia__ceb wikipedia__cs wikipedia__da wikipedia__el wikipedia__enwikiquote wikipedia__eswikiquote wikipedia__et wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__ga wikipedia__gl wikipedia__he wikipedia__hr wikipedia__ia wikipedia__itwikiquote wikipedia__ja wikipedia__kk wikipedia__ko wikipedia__la wikipedia__lv wikipedia__ms wikipedia__my wikipedia__no wikipedia__pag wikipedia__pam wikipedia__pt wikipedia__qu wikipedia__ro wikipedia__sr wikipedia__sv wikipedia__th wikipedia__tr wikipedia__uk wikipedia__ukwikiquote wikipedia__uz wikipedia__vi wikipedia__war wikipedia__zh identifier__BNF identifier__IMDB website identifier__NNDB death_date name__nan name__zh_cn name__zh_sg name__zh_tw name__jv name__ml name__bg name__co name__de_ch name__en_ca name__en_gb name__fo name__fy name__haw name__io name__ksh name__mg name__nds name__oc name__pap name__pdc name__pih name__pt_br name__scn name__sco name__sc name__yo name__ta name__hy name__bn name__am name__be name__gu name__ha name__ht name__ig name__km name__ku name__ur wikipedia__af wikipedia__als wikipedia__am wikipedia__be wikipedia__bg wikipedia__bgwikiquote wikipedia__bn wikipedia__co wikipedia__dewikiquote wikipedia__eo wikipedia__fo wikipedia__fy wikipedia__ha wikipedia__haw wikipedia__ht wikipedia__ig wikipedia__io wikipedia__is wikipedia__jv wikipedia__km wikipedia__ksh wikipedia__ku wikipedia__lb wikipedia__mg wikipedia__ml wikipedia__nds wikipedia__nn wikipedia__oc wikipedia__pap wikipedia__pdc wikipedia__pih wikipedia__plwikiquote wikipedia__pms wikipedia__scn wikipedia__sco wikipedia__sc wikipedia__simple wikipedia__sq wikipedia__ta wikipedia__ur wikipedia__yo wikipedia__zh_min_nan identifier__CiNii identifier__NDL identifier__GTAA name__ast name__bar name__cy name__de_at name__frp name__fur name__gd name__ie name__kg name__li name__lij name__min name__nap name__nrm name__pcd name__rm name__sr_el name__sw name__vec name__vls name__vo name__wo name__zu name__mk name__yue name__mr name__ka wikipedia__br wikipedia__enwikisource wikipedia__hy wikipedia__ka wikipedia__lt wikipedia__mk wikipedia__mr wikipedia__sk wikipedia__sw wikipedia__zh_yue identifier__NLA family_name identifier__AlloCine identifier__allmovie identifier__SFDb identifier__CSFD occupation identifier__wikitree wikipedia__fawikiquote facebook wikipedia__bi name__bi identifier__nyt_topic wikipedia__enwikinews identifier__snac name__ty identifier__quora wikipedia__thwikiquote identifier__dialnet identifier__BNE wikipedia__an wikipedia__ie wikipedia__sh name__sh identifier__Britannica wikipedia__cy
Q5279602
Diosdado Macapagal–Arroyo
Diosdado Macapagal–Arroyo
Diosdado Macapagal–Arroyo
Diosdado Macapagal–Arroyo
Diosdado Macapagal–Arroyo
Diosdado Macapagal Arroyo
male
1974-09-04
Dato Arroyo
Диосдадо Макапагал-Арройо
Դիոսդադո Մակապագալ Առոյո
Q6081048
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
male
1961-05-08
Isidro
Isidro Ungab
Isidro Ungab
politician
Q22007288
Samuel Pagdilao, Jr.
Samuel Pagdilao, Jr.
Samuel Pagdilao, Jr.
Samuel Pagdilao
male
1957-02-13
Samuel
Samuel Pagdilao
Q6706718
Luzviminda Ilagan
Luzviminda Ilagan
Luzviminda Ilagan
Luzviminda Ilagan
Luzviminda Ilagan
Luzviminda Ilagan
Luzviminda Ilagan
Luzviminda Ilagan
female
Luzviminda Ilagan
politician
Q12970122
Ronaldo Zamora
Ronaldo Zamora
Ronaldo Zamora
Ronaldo Zamora
Ronaldo Zamora
male
1944-12-04
Ronaldo
Ronaldo Zamora
Ronaldo Zamora
politician
Q12962647
Celso Lobregat
Celso Lobregat
Celso Lobregat
Celso Lobregat
Celso Lobregat
Celso Lobregat
Celso Lobregat
Celso Lobregat
male
1948-03-20
Celso
Celso Lobregat
Q4887876
Benhur Salimbangon
Benhur Salimbangon
Benhur Salimbangon
Benhur Salimbangon
Benhur Salimbangon
Benhur Salimbangon
Benhur Salimbangon
Benhur Salimbangon
male
1945-06-03
Benhur Salimbangon
Benhur Salimbangon
politician
Q7926469
Victor Yu
Victor Yu
Victor Yu
Victor Yu
Victor Yu
Victor Yu
male
Victor
Victor Yu
politician
Q2163117
Rolando Andaya, Jr.
Rolando Andaya, Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya, Jr.
Rolando Andaya Jr.
Rolando Andaya, Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
male
1969-03-10
Rolando
Rolando Andaya, Jr.
Rolando Andaya, Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
Rolando Andaya Jr.
politician
Rolando Andaya Jr.
Q7289824
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
Ramon Durano VI
male
1969-02-07
Ramon
Ramon Durano VI
https://upload.wikimedia.org/wikipedia/commons/1/1e/Ramon_"RED"_H-_Durano_VI_2013-07-20_10-15.jpg
politician

Statistics

Average successful run time: 3 minutes

Total run time: about 23 hours

Total cpu time used: 34 minutes

Total disk space used: 167 KB

History

  • Auto ran revision 9cdb7e0c and completed successfully .
    133 records updated in the database
    20 pages scraped
  • Auto ran revision 9cdb7e0c and completed successfully .
    133 records updated in the database
    20 pages scraped
  • Auto ran revision 9cdb7e0c and completed successfully .
    132 records updated in the database
    20 pages scraped
  • Auto ran revision 9cdb7e0c and completed successfully .
    133 records updated in the database
    20 pages scraped
  • Auto ran revision 9cdb7e0c and completed successfully .
    133 records updated in the database
    20 pages scraped
  • ...
  • Created on morph.io

Show complete history