This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing activesupport-inflector 0.1.0  Installing ast 2.4.0  Fetching colorize 0.8.1  Installing coderay 1.1.2  Fetching concurrent-ruby 1.1.3  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Installing colorize 0.8.1  Fetching require_all 2.0.0  Installing require_all 2.0.0  Installing unf_ext 0.0.7.5 with native extensions  Fetching excon 0.62.0  Installing concurrent-ruby 1.1.3  Installing excon 0.62.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.6.0  Fetching httpclient 2.8.3  Installing hashie 3.6.0  Fetching jaro_winkler 1.5.1  Installing jaro_winkler 1.5.1 with native extensions  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.2  Installing method_source 0.9.2  Fetching mime-types-data 3.2018.0812  Installing mime-types-data 3.2018.0812  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.2  Installing powerpack 0.1.2  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.10.0  Installing ruby-progressbar 1.10.0  Fetching unicode-display_width 1.4.0  Installing unicode-display_width 1.4.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.4.1  Installing yajl-ruby 1.4.1 with native extensions  Fetching parser 2.5.3.0  Installing parser 2.5.3.0  Fetching everypolitician-popolo 0.9.0  Installing everypolitician-popolo 0.9.0  Fetching i18n 1.1.1  Installing i18n 1.1.1  Fetching faraday 0.15.3  Installing faraday 0.15.3  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching pry 0.12.2  Installing pry 0.12.2  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.8.5  Installing nokogiri 1.8.5 with native extensions  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.60.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@f85e4b6)  Installing rubocop 0.60.0  Fetching faraday_middleware 0.12.2  Fetching domain_name 0.5.20180417  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing wikidata-client 0.0.12  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.22.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@9427382)  Bundle complete! 14 Gemfile dependencies, 48 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (36.44s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2094 for Q16355377 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3538 for Q1932838 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3726 for Q1932838 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1225 for Q60106 ‼ Q20574427 is_instance_of Wikimedia list article. Skipping ‼ Q11020849 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3365 for Q57630 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4521 for Q57630 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2094 for Q18342826 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3520 for Q2451422 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2962 for Q4392612 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3314 for Q4392612 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3315 for Q4392612 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3316 for Q4392612 Unknown value for P734 for Q54321872 ‼ Q4992560 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P945 for Q4240297

Data

Downloaded 1891 times by everypolitician MikeRalphson tmtmtmtm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (340 KB) Use the API

rows 10 / 235

id name__lv name__en name__de name__af name__an name__ast name__bar name__br name__bs name__ca name__co name__cs name__cy name__da name__eo name__es name__et name__eu name__fi name__fr name__fur name__ga name__gd name__gl name__gsw name__hr name__hu name__is name__it name__lb name__li name__lij name__lmo name__lt name__nap name__nb name__nds name__nds_nl name__nl name__nn name__pcd name__pl name__pms name__pt name__rm name__ro name__sc name__scn name__sco name__sk name__sl name__sq name__sv name__tr name__vec name__vls name__wa name wikipedia__lv image gender birth_date original_wikiname wikipedia__commons wikipedia__pl given_name twitter name__ru wikipedia__ru identifier__VIAF wikipedia__en identifier__freebase wikipedia__plwikiquote website wikipedia__ca wikipedia__et identifier__ISNI identifier__LCAuth identifier__LNB name__az wikipedia__az wikipedia__fr name__he name__ko name__be name__oc name__id name__la name__be_tarask name__io name__ka name__zh name__uk name__fa name__tt name__ar wikipedia__ar wikipedia__be_x_old wikipedia__be wikipedia__cs wikipedia__da wikipedia__de wikipedia__es wikipedia__fa wikipedia__fi wikipedia__he wikipedia__id wikipedia__io wikipedia__it wikipedia__ka wikipedia__ko wikipedia__la wikipedia__lt wikipedia__nl wikipedia__no wikipedia__oc wikipedia__pt wikipedia__sv wikipedia__tt wikipedia__uk wikipedia__zh identifier__GND identifier__Munzinger identifier__FAST wikipedia__tr name__ltg wikipedia__ltg identifier__SUDOC name__sgs wikipedia__bat_smg identifier__EuroparlMEP identifier__BNF name__en_ca name__en_gb name__kk name__de_ch name__ja name__el name__pt_br name__bg name__vi name__tl wikipedia__bg wikipedia__el wikipedia__eo wikipedia__hu wikipedia__ja wikipedia__kk wikipedia__lb wikipedia__ruwikiquote wikipedia__tl wikipedia__vi name__fo wikipedia__fo identifier__NLP wikipedia__ukwikiquote wikipedia__ro name__ie wikipedia__ie wikipedia__sk identifier__parlement name__yo name__hy name__sr wikipedia__hy wikipedia__lmo wikipedia__ruwikinews wikipedia__sco wikipedia__sr wikipedia__yo name__vmf name__pdc identifier__MusicBrainz identifier__NTA identifier__IMDB name__th name__sh wikipedia__nn wikipedia__sh wikipedia__th identifier__moviemeter identifier__allmovie identifier__elonet identifier__PORT identifier__CSFD name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__tg_latn name__sr_el name__sr_ec name__ilo name__mr name__tg name__nov wikipedia__co wikipedia__gl wikipedia__ilo wikipedia__mr wikipedia__nov wikipedia__sl wikipedia__tg wikipedia__hsb name__hsb occupation identifier__snac wikipedia__itwikiquote identifier__persee identifier__GTAA identifier__google_knowledge identifier__NNDB name__bm name__de_at name__frc name__frp name__ia name__jam name__kab name__kg name__mg name__min name__ms name__nrm name__pap name__prg name__rgn name__sw name__vo name__wo name__zu name__kl wikipedia__eu identifier__Britannica wikipedia__ast identifier__NUKAT name__ace identifier__SELIBR identifier__BIBSYS family_name wikipedia__cy facebook identifier__bigenc_ru identifier__FIFA name__lfn wikipedia__af wikipedia__uz name__uz identifier__ioc_athlete wikipedia__ur name__ur wikipedia__wuu name__wuu identifier__whoswho_france identifier__NKC identifier__NLI identifier__PACE
Q11711456
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igor Mielnikow
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
Igors Meļņikovs
https://upload.wikimedia.org/wikipedia/commons/7/74/Flickr_-_Saeima_-_10.Saeimas_deputāts_Igors_Meļņikovs.jpg
male
1969-06-26
Igor Mielnikow
Category:Igors Meļņikovs
Igors Meļņikovs
Igor
IMelnikovs
politician
Igors Meļņikovs
Q16350717
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
Ringolds Balodis
https://upload.wikimedia.org/wikipedia/commons/7/71/12.Saeimas_deputāts_Ringolds_Balodis_(15382065574).jpg
male
1966-01-09
Ringolds Balodis
Category:Ringolds Balodis
Ringolds
9800137
Ringolds Balodis
0000 0000 5233 6500
nr2005002585
129732184
298737957
scientist
Q56087971
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
Aldis Gobzems
male
1978-10-10
Aldis Gobzems
Aldis Gobzems
Aldis
47151110673037060034
Aldis Gobzems
Aldis Gobzems
lawyer
Q58371501
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
Ralfs Nemiro
male
1981
Ralfs Nemiro
Ralfs Nemiro
Ralfs
Ralfs Nemiro
politician
Q4529992
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
Rihards Eigims
https://upload.wikimedia.org/wikipedia/commons/0/0c/Flickr_-_Saeima_-_10.Saeimas_deputāts_Rihards_Eigims.jpg
male
1962-05-01
Rihards Eigims
Category:Rihards Eigims
Rihards Eigims
Rihards
Рихард Леонович Эйгим
Эйгим, Рихард Леонович
Рихардс Эйгимс
politician
Q24639958
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
Anda Čakša
https://upload.wikimedia.org/wikipedia/commons/3/31/Anda_Čakša.jpg
female
1974-07-11
Anda Čakša
Category:Anda Čakša
Anda Čakša
Anda
andacaksa
Анда Чакша
Чакша, Анда
Anda Čakša
Anda Čakša
Анда Чакша
Анда Чакша
physician
Q5337607
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
Edgars Zalāns
https://upload.wikimedia.org/wikipedia/commons/6/6e/Flickr_-_Saeima_-_10.Saeimas_deputāts_Edgars_Zalāns.jpg
male
1967-09-03
Edgars Zalāns
Category:Edgars Zalāns
Edgars Zalāns
Edgars
Edgars Zalāns
/m/05p1htl
politician
Q9248925
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
Dzintars Zaķis
https://upload.wikimedia.org/wikipedia/commons/c/c3/Flickr_-_Saeima_-_10.Saeimas_deputāts_Dzintars_Zaķis.jpg
male
1970-05-26
Dzintars Zaķis
Category:Dzintars Zaķis
Dzintars Zaķis
Dzintars
politician
Q6031730
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
Inga Bite
https://upload.wikimedia.org/wikipedia/commons/f/fa/11.Saeimas_deputāte_Inga_Bite.jpg
female
1981-07-06
Inga Bite
Category:Inga Bite
Inga Bite
Inga
IngaBit
314818896
Inga Bite
/m/0j9mvc0
politician
Q34592098
Askolds Kļaviņš
Askolds Kļaviņš
Askolds Kļaviņš
Askolds Kļaviņš
Askolds Kļaviņš
Askolds Kļaviņš
Askolds Kļaviņš
Askolds Kļaviņš
male
1966
Askolds
politician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (340 KB) Use the API

rows 10 / 182

id last_seen
Q16350881
2016-06-05
Q11119664
2016-06-05
Q9374035
2016-06-05
Q9368990
2016-06-05
Q11702908
2016-06-05
Q465725
2016-06-05
Q9368835
2016-06-05
Q15912476
2016-06-05
Q11731917
2016-06-05
Q4210266
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: 3 days

Total cpu time used: about 2 hours

Total disk space used: 386 KB

History

  • Auto ran revision de2aad91 and completed successfully .
    234 records updated in the database
  • Auto ran revision de2aad91 and completed successfully .
    235 records updated in the database
  • Auto ran revision de2aad91 and completed successfully .
    234 records updated in the database
  • Auto ran revision de2aad91 and completed successfully .
    234 records updated in the database
  • Auto ran revision de2aad91 and completed successfully .
    234 records updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

latvia-saeima-wikidata / scraper.rb