everypolitician-scrapers / png-parliament-wikidata

Scrapes fr.wikipedia.org, en.wikipedia.org, de.wikipedia.org, and 4 other domains

Wikipédia, l'encyclopédie libre


Contributors tmtmtmtm ondenman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing activesupport-inflector 0.1.0  Installing ast 2.4.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Fetching require_all 1.5.0  Installing require_all 1.5.0  Fetching excon 0.60.0  Installing unf_ext 0.0.7.5 with native extensions  Installing excon 0.60.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.5.0.3  Installing parser 2.5.0.3  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 1.0.0  Installing i18n 1.0.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.2  Installing nokogiri 1.8.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.53.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Installing rubocop 0.53.0  Fetching faraday_middleware 0.12.2  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Installing wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Fetching mediawiki_api 0.7.1  Installing rest-client 2.0.2  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@bbbd482)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (37.03s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ‼ Q16147033 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4464 for Q28974649 ‼ Q29583409 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4464 for Q28911725 ‼ Q1074656 is_instance_of public office. Skipping

Data

Downloaded 913 times by everypolitician tmtmtmtm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (75 KB) Use the API

rows 10 / 138

id name__de name__en name__sv name__es name__fr name__nl name__hu name wikipedia__de wikipedia__en wikipedia__sv gender birth_date given_name original_wikiname name__zh_hans name__zh_hant name__zh_hk name__id name__pl name__el name__he name__ru name__ms name__fi name__zh name__cy name__zh_cn wikipedia__el wikipedia__fi wikipedia__fr wikipedia__he wikipedia__id wikipedia__ms wikipedia__pl wikipedia__ru wikipedia__zh identifier__VIAF identifier__LCAuth death_date identifier__freebase identifier__Britannica name__eu name__tr name__yo name__uk name__et name__nb name__ja wikipedia__es wikipedia__et wikipedia__eu wikipedia__ja wikipedia__no wikipedia__tr wikipedia__uk wikipedia__yo image identifier__NLAtrove identifier__FAST identifier__SUDOC name__zh_sg name__zh_tw name__ko name__gl name__pt name__bi name__sr_el name__sr_ec name__war name__tpi name__da name__bn name__sr name__nn wikipedia__bi wikipedia__bn wikipedia__da wikipedia__gl wikipedia__ko wikipedia__nl wikipedia__pt wikipedia__sr wikipedia__tpi wikipedia__war name__ca name__oc identifier__ISNI identifier__GND identifier__NTA identifier__BNF identifier__catholic_hierarchy name__it name__sh wikipedia__sh family_name identifier__Munzinger name__cs name__vi wikipedia__cs wikipedia__vi name__bg wikipedia__bg name__ro wikipedia__ro name__en_ca name__en_gb wikipedia__commons identifier__AuDB name__ar wikipedia__ar name__th name__is name__fa wikipedia__fa wikipedia__is wikipedia__it wikipedia__simple wikipedia__th occupation wikipedia__hi name__hi name__qu wikipedia__qu name__la wikipedia__la identifier__snac wikipedia__srwikinews name__hy wikipedia__hy wikipedia__zh_min_nan name__nan identifier__NDL wikipedia__tl name__tl name__sl name__ta wikipedia__ta wikipedia__io identifier__GTAA
Q28911703
Robert Atiyafa
Robert Atiyafa
Robert Atiyafa
Robert Atiyafa
male
1959
Robert
Robert Atiyafa
Q17318820
Rimbink Pato
Rimbink Pato
Rimbink Pato
Rimbink Pato
Rimbink Pato
male
1961-05-04
Rimbink Pato
Rimbink Pato
リンビンク・パト
Category:Rimbink Pato
Rimbink Pato
Rimbink Pato
Q42631708
Julie Soso
Julie Soso
Julie Soso
female
Julie Soso
politician
Q2443854
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
Tore Lokoloko
male
1930-09-21
Tore
Tore Lokoloko
托爾·洛科洛科
Локолоко, Торе
Tore Lokoloko
托尔·洛科洛科
Tore Lokoloko
Локолоко, Торе
94004931
2013-03-13
/m/09pl_9
サー・トレ・ロコロコ
politician
तोरे लोकोलोको
तोरे लोकोलोको
Q29583256
Peter Isoaimo
Peter Isoaimo
Peter Isoaimo
Peter Isoaimo
male
Peter
Peter Isoaimo
Q1239419
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
male
1967-02-01
Don
Don Polye
Don Polye
唐·波利耶
Don Polye
Don Polye
/m/02rvdpr
Don Polye
Don Polye
Don Polye
Don Polye
Don Polye
politician
Q28974377
Paul Isikiel
Paul Isikiel
Paul Isikiel
Paul Isikiel
male
Paul
Paul Isikiel
Q22953338
Steven Pirika Kama
Steven Pirika Kama
Steven Pirika Kama
Steven Pirika Kama
male
1962
Steven
Steven Pirika Kama
2016-02-20
Steven Pirika Kama
Steven Pirika Kama
Q17318841
John Pundari
John Pundari
John Pundari
John Pundari
John Pundari
male
1967
John
John Pundari
John Pundari
Q28925023
Francis Awesa
Francis Awesa
Francis Awesa
Francis Awesa
male
Francis Awesa

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (75 KB) Use the API

rows 10 / 48

id last_seen
Q1381425
2016-06-04
Q471229
2016-06-04
Q466818
2016-06-04
Q5482225
2016-06-04
Q1686476
2016-06-04
Q2007264
2016-06-04
Q7177402
2016-06-04
Q16728478
2016-06-04
Q1288522
2016-06-04
Q1070420
2016-06-04

Statistics

Average successful run time: 2 minutes

Total run time: 4 days

Total cpu time used: 39 minutes

Total disk space used: 107 KB

History

  • Auto ran revision 974f4d84 and completed successfully .
    136 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    137 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    137 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    138 records updated in the database
    21 pages scraped
  • Auto ran revision 974f4d84 and completed successfully .
    137 records updated in the database
    21 pages scraped
  • ...
  • Created on morph.io

Show complete history