This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0.pre.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler --pre`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.3.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Installing rake 12.3.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Installing concurrent-ruby 1.0.5  Fetching diskcached 1.1.3  Installing coderay 1.1.2  Installing colorize 0.8.1  Fetching unf_ext 0.0.7.4  Installing diskcached 1.1.3  Fetching require_all 1.4.0  Fetching excon 0.59.0  Installing require_all 1.4.0  Fetching multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Installing multipart-post 2.0.0  Installing excon 0.59.0  Fetching hashie 3.5.6  Installing hashie 3.5.6  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.0  Installing parallel 1.12.0  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.4.0.2  Installing parser 2.4.0.2  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching i18n 0.9.1  Installing i18n 0.9.1  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.13.1  Installing faraday 0.13.1  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.12.2  Fetching rubocop 0.51.0  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.12.2  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing domain_name 0.5.20170404  Fetching wikidata-client 0.0.11  Installing rubocop 0.51.0  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing wikidata-client 0.0.11  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@a2938a6)  Bundle complete! 14 Gemfile dependencies, 48 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (37.45s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0.pre.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler --pre`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2987 for Q3543427 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2094 for Q486359 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1225 for Q285536 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1580 for Q1285526

Data

Downloaded 825 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (124 KB) Use the API

rows 10 / 133

id name__nl name__en name__tl name__es name__de name__fr name__hu name__ja name wikipedia__en wikipedia__nl wikipedia__tl gender identifier__VIAF birth_date given_name original_wikiname wikipedia__de name__pl name__ru name__it name__nb name__da name__nn name__sv name__id wikipedia__es wikipedia__fr wikipedia__id wikipedia__it wikipedia__pl wikipedia__ru image identifier__ISNI identifier__GND identifier__LCAuth identifier__SUDOC identifier__freebase identifier__NTA identifier__Munzinger twitter identifier__FAST name__bcl name__ilo name__zh wikipedia__bcl wikipedia__commons wikipedia__ilo name__zh_hans name__zh_hant name__zh_hk name__pam name__pag name__qu name__ko name__he name__uz name__ceb name__cbk_zam name__lv name__vi name__el name__ia name__ga name__ar name__pt name__ro name__th name__fi name__la name__war name__cs name__az name__hr name__ca name__af name__an name__br name__eo name__et name__eu name__gl name__is name__lb name__lmo name__lt name__nds_nl name__pms name__sk name__sl name__sq name__tr name__wa name__gsw name__fa name__uk name__kk name__ms name__sr name__my wikipedia__ar wikipedia__az wikipedia__ca wikipedia__cbk_zam wikipedia__ceb wikipedia__cs wikipedia__da wikipedia__el wikipedia__enwikiquote wikipedia__eswikiquote wikipedia__et wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__ga wikipedia__gl wikipedia__he wikipedia__hr wikipedia__ia wikipedia__itwikiquote wikipedia__ja wikipedia__kk wikipedia__ko wikipedia__la wikipedia__lv wikipedia__ms wikipedia__my wikipedia__no wikipedia__pag wikipedia__pam wikipedia__pt wikipedia__qu wikipedia__ro wikipedia__sr wikipedia__sv wikipedia__th wikipedia__tr wikipedia__uk wikipedia__ukwikiquote wikipedia__uz wikipedia__vi wikipedia__war wikipedia__zh identifier__BNF identifier__IMDB website identifier__NNDB death_date name__nan name__zh_cn name__zh_sg name__zh_tw name__jv name__ml name__bg name__co name__de_ch name__en_ca name__en_gb name__fo name__fy name__haw name__io name__ksh name__mg name__nds name__oc name__pap name__pdc name__pih name__pt_br name__scn name__sco name__sc name__yo name__ta name__hy name__bn name__am name__be name__gu name__ha name__ht name__ig name__km name__ku name__ur wikipedia__af wikipedia__als wikipedia__am wikipedia__be wikipedia__bg wikipedia__bgwikiquote wikipedia__bn wikipedia__co wikipedia__dewikiquote wikipedia__eo wikipedia__fo wikipedia__fy wikipedia__ha wikipedia__haw wikipedia__ht wikipedia__ig wikipedia__io wikipedia__is wikipedia__jv wikipedia__km wikipedia__ksh wikipedia__ku wikipedia__lb wikipedia__mg wikipedia__ml wikipedia__nds wikipedia__nn wikipedia__oc wikipedia__pap wikipedia__pdc wikipedia__pih wikipedia__plwikiquote wikipedia__pms wikipedia__scn wikipedia__sco wikipedia__sc wikipedia__simple wikipedia__sq wikipedia__ta wikipedia__ur wikipedia__yo wikipedia__zh_min_nan identifier__CiNii identifier__NDL identifier__GTAA name__ast name__bar name__cy name__de_at name__frp name__fur name__gd name__ie name__kg name__li name__lij name__min name__nap name__nrm name__pcd name__rm name__sr_el name__sw name__vec name__vls name__vo name__wo name__zu name__mk name__yue name__mr name__ka wikipedia__br wikipedia__enwikisource wikipedia__hy wikipedia__ka wikipedia__lt wikipedia__mk wikipedia__mr wikipedia__sk wikipedia__sw wikipedia__zh_yue identifier__NLA family_name identifier__AlloCine identifier__allmovie identifier__SFDb identifier__CSFD occupation identifier__wikitree wikipedia__fawikiquote facebook wikipedia__bi name__bi identifier__nyt_topic wikipedia__enwikinews identifier__snac name__ty identifier__quora wikipedia__thwikiquote identifier__dialnet identifier__BNE wikipedia__an wikipedia__ie wikipedia__sh name__sh identifier__Britannica wikipedia__cy name__lfn identifier__bigenc_ru
Q23303083
Harry Roque
Harry Roque
Harry Roque
Harry Roque
male
1966-10-21
Harry
politician
Q7363162
Romero Quimbo
Romero Quimbo
Romero Quimbo
Romero Quimbo
Romero Quimbo
Romero Quimbo
Miro Quimbo
Romero Quimbo
male
1969
Romero
Miro Quimbo
Romero Quimbo
politician
Q12967978
Mercedes Alvarez
Mercedes Alvarez
Mercedes Alvarez
Mercedes Alvarez (politician)
Mercedes Alvarez
female
Mercedes
Mercedes Alvarez (politician)
Mercedes Alvarez
Alvarez
politician
Q4666167
Abdulmunir Mundoc Arbison
Abdulmunir Mundoc Arbison
Abdulmunir Mundoc Arbison
Abdulmunir Mundoc Arbison
Abdulmunir Mundoc Arbison
Abdulmunir Mundoc Arbison
male
1957-11-12
Abdulmunir Mundoc Arbison
Abdulmunir Mundoc Arbison
Q7927073
Victoria Sy-Alvarado
Victoria Sy-Alvarado
Ma. Victoria Sy-Alvarado
Victoria Sy-Alvarado
Victoria Sy-Alvarado
Victoria Sy-Alvarado
Ma. Victoria Sy-Alvarado
female
1957-03-23
Victoria
Ma. Victoria Sy-Alvarado
politician
Q6081048
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
Isidro Ungab
male
1961-05-08
Isidro
Isidro Ungab
Isidro Ungab
politician
Q6701308
Luisa Lloren Cuaresma
Luisa Lloren Cuaresma
Luisa Lloren Cuaresma
Luisa Lloren Cuaresma
Luisa Lloren Cuaresma
Luisa Lloren Cuaresma
female
1955-01-18
Luisa
Luisa Lloren Cuaresma
Luisa Lloren Cuaresma
politician
Q7926469
Victor Yu
Victor Yu
Victor Yu
Victor Yu
Victor Yu
Victor Yu
male
Victor
Victor Yu
politician
Q2720262
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
female
1955-10-12
Gwendolyn
Gwendolyn Garcia
Gwendolyn Garcia
Gwendolyn Garcia
/m/02rc_yy
Category:Gwendolyn Garcia
Gwen Garcia
Gwen Garcia
politician
Q17371286
Josephine Sato
Josephine Sato
Josephine Sato
Josephine Sato
Josephine Sato
Josephine Sato
female
1954-04-29
Josephine
Josephine Sato
Sato
politician

Statistics

Average successful run time: 3 minutes

Total run time: 1 day

Total cpu time used: 39 minutes

Total disk space used: 167 KB

History

  • Auto ran revision 9cdb7e0c and completed successfully .
    133 records updated in the database
  • Auto ran revision 9cdb7e0c and completed successfully .
    132 records updated in the database
    20 pages scraped
  • Auto ran revision 9cdb7e0c and failed .
    nothing changed in the database
  • Auto ran revision 9cdb7e0c and completed successfully .
    131 records updated in the database
    112 pages scraped
  • Auto ran revision 9cdb7e0c and completed successfully .
    132 records updated in the database
    20 pages scraped
  • ...
  • Created on morph.io

Show complete history