tmtmtmtm / poland-sejm-wikidata

Scrapes api.morph.io, query.wikidata.org, pl.wikipedia.org, and 2 other domains

Get structured data out of the web. Code collaboration through GitHub. Run your scrapers in the cloud.


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing activesupport-inflector 0.1.0  Installing ast 2.3.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching require_all 1.5.0  Installing require_all 1.5.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching excon 0.60.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing excon 0.60.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.4.0.2  Installing parser 2.4.0.2  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 0.9.3  Installing i18n 0.9.3  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.52.1  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Installing rubocop 0.52.1  Fetching faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.12.2  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing wikidata-client 0.0.12  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@a2938a6)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (37.03s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5058 for Q4973946 Unknown value for P734 for Q16562186 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3725 for Q651170 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4259 for Q651170 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q55922 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5058 for Q1683076 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q55927 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q55758 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4534 for Q1737511 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5058 for Q1737511 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3542 for Q3808085 Unknown value for P734 for Q21281999 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2533 for Q218319 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4431 for Q218319 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3762 for Q11267906 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4534 for Q1584789 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3509 for Q9151911 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3520 for Q434933 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3766 for Q434933 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3925 for Q434933 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q157282 Unknown value for P734 for Q11749176 Unknown value for P106 for Q1495765 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4534 for Q6185386 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5058 for Q6185386 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q55743 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3655 for Q269275 Unknown value for P734 for Q633807 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q2757 Unknown value for P734 for Q9296914 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2777 for Q24840 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3987 for Q6185563

Data

Downloaded 1242 times by everypolitician tmtmtmtm MikeRalphson chrismytton ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.35 MB) Use the API

rows 10 / 2190

id name__pl name__en name__de name__fr name wikipedia__pl gender birth_date given_name original_wikiname name__pt name__nl name__eo name__et name__it wikipedia__commons wikipedia__en wikipedia__et wikipedia__fr wikipedia__pt image identifier__VIAF name__es name__nb name__da name__nn name__sv name__en_ca name__en_gb name__pt_br wikipedia__de identifier__freebase identifier__EuroparlMEP wikipedia__plwikiquote name__de_ch name__sk wikipedia__sk identifier__NUKAT name__lt wikipedia__lt name__af name__an name__ast name__bar name__br name__bs name__ca name__co name__cs name__cy name__eu name__fi name__fur name__ga name__gd name__gl name__gsw name__hr name__hu name__is name__lb name__li name__lij name__lmo name__nap name__nds name__nds_nl name__pcd name__pms name__rm name__ro name__sc name__scn name__sco name__sl name__sq name__tr name__vec name__vls name__wa name__ru wikipedia__es identifier__ISNI identifier__BNF identifier__SUDOC identifier__IMDB name__zh_hans name__zh_hant name__zh_hk name__uk name__fa name__zh wikipedia__fa wikipedia__fi wikipedia__it wikipedia__ro wikipedia__ru wikipedia__sv wikipedia__uk wikipedia__zh wikipedia__eo identifier__LCAuth name__mg wikipedia__ca wikipedia__mg wikipedia__nl wikipedia__tr website identifier__FIFA name__ka name__be name__bg name__vi name__la name__ie name__szl name__ko name__el name__io name__hy name__ja name__mk name__sr name__mr wikipedia__be wikipedia__bg wikipedia__cs wikipedia__cswikiquote wikipedia__da wikipedia__el wikipedia__hu wikipedia__ie wikipedia__io wikipedia__is wikipedia__ja wikipedia__ka wikipedia__ko wikipedia__la wikipedia__lb wikipedia__mr wikipedia__no wikipedia__simple wikipedia__szl wikipedia__vi wikipedia__eu wikipedia__gl name__ksh wikipedia__ksh name__oc identifier__GND name__he name__sr_el name__sr_ec name__be_tarask name__th wikipedia__be_x_old wikipedia__he wikipedia__sr wikipedia__th identifier__NKC facebook wikipedia__sl wikipedia__oc twitter name__id wikipedia__dewikiquote wikipedia__id wikipedia__itwikiquote wikipedia__ukwikiquote identifier__NTA identifier__GTAA name__csb wikipedia__csb name__az name__hsb name__lv name__ms name__sh name__uz name__yo name__yue name__ar wikipedia__ar wikipedia__az wikipedia__br wikipedia__hr wikipedia__hsb wikipedia__lv wikipedia__ms wikipedia__nn wikipedia__sco wikipedia__sh wikipedia__uz wikipedia__yo wikipedia__zh_yue name__mwl wikipedia__mwl identifier__NLP wikipedia__af wikipedia__mk family_name identifier__Munzinger name__fo wikipedia__fo name__hi name__kk wikipedia__ast wikipedia__kk name__dsb name__ht name__qu name__zh_cn name__mn name__ta name__crh_latn name__ne wikipedia__crh wikipedia__cy wikipedia__dsb wikipedia__enwikiquote wikipedia__ht wikipedia__hy wikipedia__lmo wikipedia__mn wikipedia__qu wikipedia__scn death_date name__sgs wikipedia__bat_smg identifier__AlloCine name__ia name__na name__os name__zh_tw name__zh_sg name__zh_mo name__zh_my name__kaa wikipedia__an wikipedia__eowikiquote wikipedia__ia wikipedia__kaa wikipedia__na wikipedia__os identifier__LNB name__tl wikipedia__tl name__fy wikipedia__fy wikipedia__bgwikiquote name__vo wikipedia__vo name__cv name__jv name__mrj name__sah name__se name__tt name__nan name__ckb wikipedia__ckb wikipedia__cv wikipedia__fur wikipedia__ga wikipedia__gd wikipedia__hewikiquote wikipedia__hi wikipedia__jv wikipedia__ltwikiquote wikipedia__mrj wikipedia__nds wikipedia__plwikisource wikipedia__sah wikipedia__se wikipedia__sq wikipedia__ta wikipedia__tt wikipedia__zh_min_nan identifier__PTBNP identifier__parlement identifier__NDL identifier__NLA identifier__NLI identifier__BNE identifier__BAV name__diq wikipedia__bs name__simple name__mo wikipedia__mo identifier__catholic_hierarchy wikipedia__xmf name__xmf name__bm name__de_at name__frc name__frp name__jam name__kab name__kg name__min name__nrm name__pap name__prg name__rgn name__sw name__vmf name__wo name__zu identifier__IIAF identifier__MusicBrainz identifier__discogs identifier__MGP identifier__allmovie identifier__OLID identifier__SFDb identifier__NNDB identifier__FAST identifier__CSPAN identifier__moviemeter last_seen wikipedia__ba identifier__Britannica name__ba identifier__elonet identifier__PORT identifier__kinopoisk identifier__CSFD identifier__dialnet identifier__senate_nl identifier__PACE wikipedia__bn name__bn name__pdc name__stq name__war identifier__wikitree identifier__bigenc_ru identifier__google_knowledge wikipedia__dewikinews wikipedia__plwikinews wikipedia__ruwikinews wikipedia__srwikinews occupation identifier__polish_scientist identifier__ne_se identifier__ULAN identifier__quora wikipedia__enwikinews identifier__snac wikipedia__frwikinews wikipedia__bewikiquote identifier__persee identifier__filmpolski name__ext pseudonym identifier__songkick identifier__ioc_athlete instagram name__ty name__ceb identifier__BIBSYS identifier__EGAXA identifier__CONOR identifier__GNC name__bat_smg identifier__flickr identifier__youtube wikipedia__ruwikiquote wikipedia__enwikisource wikipedia__ruwikisource identifier__Gutenberg wikipedia__myv name__lfn
Q6799391
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
female
1975-12-03
Małgorzata
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Category:Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
https://upload.wikimedia.org/wikipedia/commons/7/78/Małgorzata_Sadurska_2008.jpg
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
Małgorzata Sadurska
politician
Q1782861
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
male
1964-09-19
Konstanty
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Category:Konstanty Oświęcimski
https://upload.wikimedia.org/wikipedia/commons/f/f9/Konstanty_Oświęcimski.jpg
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Konstanty Oświęcimski
Q6532156
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
male
1955-01-01
Leszek
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
Leszek Korzeniowski
politician
Q7599268
Stanisława Okularczyk
Stanisława Anna Okularczyk
Stanisława Anna Okularczyk
Stanisława Anna Okularczyk
Stanisława Okularczyk
Stanisława Okularczyk
female
1943-05-12
Stanisława
Stanisława Okularczyk
Stanisława Anna Okularczyk
Stanisława Anna Okularczyk
Stanisława Anna Okularczyk
Stanisława Anna Okularczyk
162422457
n96203288
Stanisława Anna Okularczyk
Okularczyk
politician
54471
Q11725631
Jerzy Wierchowicz
Jerzy Wierchowicz
Jerzy Wierchowicz
Jerzy Wierchowicz
male
1951-08-04
Jerzy
Jerzy Wierchowicz
Jerzy Wierchowicz
Jerzy Wierchowicz
lawyer
Q9168752
Benedykt Suchecki
Benedykt Suchecki
Benedykt Suchecki
Benedykt Suchecki
male
1945-04-13
Benedykt
Benedykt Suchecki
Benedykt Suchecki
Benedykt Suchecki
politician
Q9165325
Barbara Czaplicka
Barbara Czaplicka
Barbara Czaplicka
Barbara Czaplicka
female
1948-11-22
Barbara
Barbara Czaplicka
Barbara Czaplicka
Q11814180
Paweł Kotlarski
Paweł Kotlarski
Paweł Kotlarski
male
1961-04-14
Paweł
Paweł Kotlarski
physician
Q6799393
Małgorzata Stryjska
Małgorzata Stryjska
Małgorzata Stryjska
Małgorzata Stryjska
Małgorzata Stryjska
female
1953-08-03
Małgorzata
Małgorzata Stryjska
Małgorzata Stryjska
Małgorzata Stryjska
Małgorzata Stryjska
Małgorzata Stryjska
politician
Q9353240
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
male
1944-08-29
Sławomir
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
Sławomir Szatkowski
2009-03-07
farmer

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.35 MB) Use the API

rows 10 / 2179

id last_seen
Q6758910
2016-06-05
Q9153771
2016-06-05
Q9370836
2016-06-05
Q11731082
2016-06-05
Q9296324
2016-06-05
Q364643
2016-06-05
Q9296865
2016-06-05
Q9153852
2016-06-05
Q21282093
2016-06-05
Q2387309
2016-06-05

Statistics

Average successful run time: 24 minutes

Total run time: 14 days

Total cpu time used: about 15 hours

Total disk space used: 2.4 MB

History

  • Auto ran revision 90132677 and completed successfully .
    2190 records updated in the database
    138 pages scraped
  • Auto ran revision 90132677 and completed successfully .
    2189 records updated in the database
  • Auto ran revision 90132677 and completed successfully .
    2188 records updated in the database
    138 pages scraped
  • Auto ran revision 90132677 and completed successfully .
    2189 records updated in the database
  • Auto ran revision 90132677 and completed successfully .
    2187 records updated in the database
    138 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

poland-sejm-wikidata / scraper.rb