This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Installing activesupport-inflector 0.1.0  Fetching colorize 0.8.1  Fetching diskcached 1.1.3  Installing coderay 1.1.1  Installing colorize 0.8.1  Fetching unf_ext 0.0.7.4  Installing diskcached 1.1.3  Fetching require_all 1.4.0  Installing require_all 1.4.0  Fetching excon 0.58.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching hashie 3.5.6  Installing excon 0.58.0  Installing hashie 3.5.6  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing domain_name 0.5.20170404  Installing rubocop 0.48.1  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@69ea1ee)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (41.22s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4548 for Q19876617

Data

Downloaded 1036 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14 KB) Use the API

rows 10 / 13

id name__en name__de name wikipedia__en gender given_name original_wikiname name__fr birth_date wikipedia__fr name__nl name__it name__el name__es name__pl name__tr name__ru name__fi name__zh wikipedia__de wikipedia__el wikipedia__es wikipedia__fi wikipedia__it wikipedia__nl wikipedia__pl wikipedia__ru wikipedia__tr wikipedia__zh image identifier__freebase name__be wikipedia__be family_name name__hu wikipedia__ja name__ja name__zh_hant name__zh_cn name__af name__an name__ast name__bar name__bm name__br name__ca name__co name__cs name__cy name__da name__de_at name__de_ch name__en_ca name__en_gb name__eo name__et name__eu name__frc name__frp name__fur name__ga name__gd name__gl name__gsw name__hr name__ia name__id name__ie name__io name__jam name__kab name__kg name__lb name__li name__lij name__lt name__lv name__mg name__min name__ms name__nap name__nb name__nds name__nds_nl name__nn name__nrm name__oc name__pap name__pcd name__pms name__prg name__pt name__pt_br name__rgn name__rm name__ro name__sc name__scn name__sco name__sk name__sv name__sw name__vec name__vi name__vls name__vmf name__vo name__wa name__wo name__zu occupation name__fo name__kl name__sl wikipedia__no
Q5377251
Enetama Lipitoa
Enetama Lipitoa
Enetama Lipitoa
Enetama Lipitoa
male
Jack Willie Lipitoa
Enetama Lipitoa
Enetama Lipitoa
politician
Q508830
Young Vivian
Young Vivian
Young Vivian
Young Vivian
male
Young
Young Vivian
Young Vivian
1935-11-12
Young Vivian
Young Vivian
Young Vivian
Γιανγκ Βίβιαν
Young Vivian
Young Vivian
Young Vivian
Янг Вивиан
Young Vivian
Young Vivian
Γιανγκ Βίβιαν
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Вивиан, Янг
/m/027bp3
Янг Вівіан
Янг Вівіян
Vivian
Young Vivian
ヤング・ヴィヴィアン
揚·維維安
扬·维维安
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
Young Vivian
politician
Q16886221
Va'aiga Tukuitonga
Va'aiga Tukuitonga
Va'aiga Tukuitonga
Va'aiga Tukuitonga
female
Va'aiga Tukuitonga
politician
Q19876617
Dalton Tagelagi
Dalton Tagelagi
Dalton Tagelagi
male
Dalton Tagelagi
1968-06-05
Dalton Tagelagi
Q16645937
Joan Tahafa-Viliamu
Joan Viliamu
Joan Tahafa-Viliamu
Joan Viliamu
female
Joan
Joan Tahafa-Viliamu
Joan Tahafa-Viliamu
1966-03-22
Joan Tahafa-Viliamu
Joan Tahafa-Viliamu
ジョアン・ビリアム
politician
Joan Tahafa-Viliamu
Q785548
Toke Talagi
Toke Talagi
Toke Talagi
Toke Talagi
male
Toke
Toke Talagi
Toke Tufukia Talagi
1960-12-06
Toke Talagi
Toke Talagi
Toke Talagi
Τόκε Ταλάγκι
Toke Talagi
Toke Talagi
Toke Talagi
Талаги, Токе
Toke Talagi
托克基·塔拉尼
Toke Talagi
Τόκε Ταλάγκι
Toke Talagi
Toke Talagi
Toke Talagi
Toke Talagi
Toke Talagi
Талаги, Токе
Toke Talagi
托克基·塔拉尼
/m/047mqxm
トケ・タランギ
トケ・タランギ
Toke Talagi
diplomat
Toke Talagi
Toke Talagi
Toke Talagi
Q4911209
Bill Vakaafi Motufoou
Bill Vakaafi Motufoou
Bill Vakaafi Motufoou
Bill Vakaafi Motufoou
male
Bill
Bill Vakaafi Motufoou
Bill Vakaafi Motufoou
politician
Q7071866
O'Love Jacobsen
O'Love Jacobsen
O'Love Jacobsen
female
O'Love Jacobsen
O'love Jacobsen
O'love Jacobsen
diplomat
Q7704226
Terry Coe
Terry Coe
Terry Coe
Terry Coe
male
Terry
Terry Coe
Terry Coe
Terry Coe
Terry Coe
politician
Q42704251
Mona Ainuu
Mona Ainuu
Mona Ainuu
female
Mona Ainu'u
politician

Statistics

Average successful run time: less than a minute

Total run time: 3 days

Total cpu time used: 25 minutes

Total disk space used: 46.5 KB

History

  • Auto ran revision 1787dce2 and completed successfully .
    12 records updated in the database
  • Auto ran revision 1787dce2 and completed successfully .
    13 records updated in the database
    111 pages scraped
  • Auto ran revision 1787dce2 and completed successfully .
    11 records updated in the database
  • Auto ran revision 1787dce2 and completed successfully .
    13 records updated in the database
    6 pages scraped
  • Auto ran revision 1787dce2 and completed successfully .
    10 records updated in the database
    6 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

niue-election-2014 / scraper.rb