everypolitician-scrapers / png-parliament-wikidata

Scrapes fr.wikipedia.org, en.wikipedia.org, de.wikipedia.org, and 4 other domains

Wikipédia, l'encyclopédie libre


Contributors tmtmtmtm ondenman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing coderay 1.1.2  Installing ast 2.4.0  Installing activesupport-inflector 0.1.0  Fetching colorize 0.8.1  Installing colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Fetching require_all 1.5.0  Installing require_all 1.5.0  Installing concurrent-ruby 1.0.5  Fetching excon 0.60.0  Installing unf_ext 0.0.7.5 with native extensions  Installing excon 0.60.0  Fetching multipart-post 2.0.0  Fetching hashie 3.5.7  Installing multipart-post 2.0.0  Fetching httpclient 2.8.3  Installing hashie 3.5.7  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.5.0.3  Installing parser 2.5.0.3  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 1.0.0  Installing i18n 1.0.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.2  Installing nokogiri 1.8.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.53.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Fetching faraday_middleware 0.12.2  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Installing rubocop 0.53.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Installing wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@bbbd482)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (50.62s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ‼ Q1074656 is_instance_of public office. Skipping ‼ Q16147033 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4464 for Q28974649 ‼ Q3002715 is_instance_of . Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4464 for Q28911725

Data

Downloaded 996 times by everypolitician tmtmtmtm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (76 KB) Use the API

rows 10 / 134

id name__de name__en name__sv name__es name__fr name__nl name__hu name wikipedia__de wikipedia__en wikipedia__sv gender birth_date given_name original_wikiname name__zh_hans name__zh_hant name__zh_hk name__id name__pl name__el name__he name__ru name__ms name__fi name__zh name__cy name__zh_cn wikipedia__el wikipedia__fi wikipedia__fr wikipedia__he wikipedia__id wikipedia__ms wikipedia__pl wikipedia__ru wikipedia__zh identifier__VIAF identifier__LCAuth death_date identifier__freebase identifier__Britannica name__eu name__tr name__yo name__uk name__et name__nb name__ja wikipedia__es wikipedia__et wikipedia__eu wikipedia__ja wikipedia__no wikipedia__tr wikipedia__uk wikipedia__yo image identifier__NLAtrove identifier__FAST identifier__SUDOC name__zh_sg name__zh_tw name__ko name__gl name__pt name__bi name__sr_el name__sr_ec name__war name__tpi name__da name__bn name__sr name__nn wikipedia__bi wikipedia__bn wikipedia__da wikipedia__gl wikipedia__ko wikipedia__nl wikipedia__pt wikipedia__sr wikipedia__tpi wikipedia__war name__ca name__oc identifier__ISNI identifier__GND identifier__NTA identifier__BNF identifier__catholic_hierarchy name__it name__sh wikipedia__sh family_name identifier__Munzinger name__cs name__vi wikipedia__cs wikipedia__vi name__bg wikipedia__bg name__ro wikipedia__ro name__en_ca name__en_gb wikipedia__commons identifier__AuDB name__ar wikipedia__ar name__th name__is name__fa wikipedia__fa wikipedia__is wikipedia__it wikipedia__simple wikipedia__th occupation wikipedia__hi name__hi name__qu wikipedia__qu name__la wikipedia__la identifier__snac wikipedia__srwikinews name__hy wikipedia__hy wikipedia__zh_min_nan name__nan identifier__NDL wikipedia__tl name__tl name__sl name__ta wikipedia__ta wikipedia__io identifier__GTAA wikipedia__uz
Q28967931
Komun Joe Koim
Komun Joe Koim
Komun Joe Koim
Komun Joe Koim
male
Komun Joe Koim
Q28967737
Byron Chan
Byron Chan
Byron Chan
Byron Chan
male
Byron Chan
Q316264
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
male
1936-04-09
Michael
Michael Somare
迈克尔·索马雷
邁克爾·索馬雷
米高·索馬雷
Michael Somare
Michael Somare
Μάικλ Σομάρε
Майкл Томас Сомаре
Michael Somare
Michael Somare
迈克尔·索马雷
迈克尔·索马雷
Μάικλ Σομάρε
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Michael Somare
Сомаре, Майкл Томас
迈克尔·索马雷
63595418
no95050985
/m/01xzgk
biography/Michael-Somare
Michael Somare
Майкл Сомаре
Michael Somare
Michael Somare
マイケル・ソマレ
Michael Somare
Michael Somare
マイケル・ソマレ
Michael Somare
Майкл Сомаре
Michael Somare
1524389
16431198X
迈克尔·索马雷
麥可·索馬雷
마이클 소마레
Michael Somare
Michael Somare
Michael Somare
Majkl Somare
Мајкл Сомаре
Michael Somare
Michael Somare
Michael Somare
মাইকেল সোমারে
Мајкл Сомаре
Michael Somare
Michael Somare
মাইকেল সোমারে
Michael Somare
Michael Somare
마이클 소마레
Michael Somare
Michael Somare
Мајкл Сомаре
Michael Somare
Michael Somare
0000 0000 4180 0152
068846177
Category:Michael Somare
politician
Michael Somare
Michael Somare
w6v16hk1
Michael Somare
Michael Somare
156067
Q28925119
Mai Dop
Mai Dop
Mai Dop
Mai Dop
male
Mai Dop
Q957271
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
male
1932-03-16
Kingsford Dibela
Kingsford Dibela
Дибела, Кингсфорд
金斯福德·迪貝拉
Kingsford Dibela
Kingsford Dibela
Kingsford Dibela
Дибела, Кингсфорд
2002-03-22
/m/09plrd
Kingsford Dibela
サー・キングスフォード・ディベラ
Kingsford Dibela
Kingsford Dibela
politician
किंग्सफोर्ड डिबेला
किंग्सफोर्ड डिबेला
Q7823216
Tony Puana
Tony Puana
Tony Puana
Tony Puana
male
Tony
Tony Puana
Q29583256
Peter Isoaimo
Peter Isoaimo
Peter Isoaimo
Peter Isoaimo
male
Peter
Peter Isoaimo
Q567469
Ano Pala
Ano Pala
Ano Pala
Ano Pala
Ano Pala
Ano Pala
Ano Pala
Ano Pala
Ano Pala
Ano Pala
male
Ano
Ano Pala
/m/0bxztr8
Ano Pala
Ano Pala
Ano Pala
politician
Q7174843
Peter Iwei
Peter Iwei
Peter Iwei
Peter Iwei
Peter Iwei
male
Peter
Peter Iwei
Q28940953
Aide Ganasi
Aide Ganasi
Aide Ganasi
Aide Ganasi
male
Aide Ganasi
2016-11-08

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (76 KB) Use the API

rows 10 / 48

id last_seen
Q1381425
2016-06-04
Q471229
2016-06-04
Q466818
2016-06-04
Q5482225
2016-06-04
Q1686476
2016-06-04
Q2007264
2016-06-04
Q7177402
2016-06-04
Q16728478
2016-06-04
Q1288522
2016-06-04
Q1070420
2016-06-04

Statistics

Average successful run time: 2 minutes

Total run time: 4 days

Total cpu time used: 43 minutes

Total disk space used: 108 KB

History

  • Auto ran revision 974f4d84 and completed successfully .
    3 records removed, 134 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    137 records updated in the database
    23 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    137 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    137 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    135 records updated in the database
    21 pages scraped
  • ...
  • Created on morph.io

Show complete history