tmtmtmtm / malta-parliament-wikidata

Scrapes en.wikipedia.org, mt.wikipedia.org, query.wikidata.org, and 2 other domains

Wikipedia, the free encyclopedia


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing activesupport-inflector 0.1.0  Installing ast 2.4.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Installing concurrent-ruby 1.0.5  Installing unf_ext 0.0.7.5 with native extensions  Installing diskcached 1.1.3  Fetching require_all 2.0.0  Fetching excon 0.62.0  Installing require_all 2.0.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing excon 0.62.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.5.0.5  Installing parser 2.5.0.5  Fetching i18n 1.0.0  Installing i18n 1.0.0  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.2  Installing nokogiri 1.8.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.54.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Installing rubocop 0.54.0  Fetching faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.12.2  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing wikidata-client 0.0.12  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@f6a205f)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (37.41s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Chris Said in en Can't find Wikidata IDs for: Anthony Zammit, Leo Brincat in mt ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q167307 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q167307 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1599 for Q333979 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3794 for Q333979 ‼ Q1817866 is_instance_of bicameral legislature & unicameral legislature. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q250177 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q1043593 ‼ Q13828291 is_instance_of cabinet. Skipping

Data

Downloaded 1300 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (136 KB) Use the API

rows 10 / 141

id name__en name__mt name__nl name__pl name__de name__it name wikipedia__en wikipedia__it wikipedia__mt wikipedia__pl gender birth_date given_name name__fr name__es wikipedia__de wikipedia__fr identifier__freebase name__pt name__sv wikipedia__nl wikipedia__pt wikipedia__sv identifier__VIAF identifier__GND identifier__IMDB name__da wikipedia__da identifier__LCAuth website identifier__EuroparlMEP name__la wikipedia__la name__az wikipedia__az name__ga name__ro name__ru name__hu name__pt_br name__tr name__eo name__lb name__cs name__et name__de_ch name__el name__en_ca name__en_gb name__nb name__lmo name__uk name__zh name__io name__fi name__lt name__fa name__nn name__id name__ja name__be name__ko wikipedia__be wikipedia__cs wikipedia__el wikipedia__eo wikipedia__es wikipedia__et wikipedia__fa wikipedia__fi wikipedia__ga wikipedia__hu wikipedia__id wikipedia__io wikipedia__ja wikipedia__ko wikipedia__lb wikipedia__lmo wikipedia__lt wikipedia__no wikipedia__ro wikipedia__ru wikipedia__tr wikipedia__uk wikipedia__zh image identifier__parlement name__ka wikipedia__ka wikipedia__commons identifier__BNF wikipedia__ar name__ar wikipedia__plwikiquote death_date name__he name__oc name__yo name__gl name__sr name__ca wikipedia__ca wikipedia__gl wikipedia__he wikipedia__oc wikipedia__sr wikipedia__yo twitter facebook identifier__SUDOC original_wikiname last_seen wikipedia__be_x_old name__be_tarask name__af name__an name__ast name__bar name__bm name__br name__co name__cy name__de_at name__eu name__frc name__frp name__fur name__gd name__gsw name__hr name__ia name__ie name__jam name__kab name__kg name__li name__lij name__lv name__mg name__min name__ms name__nap name__nds name__nds_nl name__nrm name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__scn name__sco name__sk name__sr_el name__sw name__vec name__vi name__vls name__vmf name__vo name__wa name__wo name__zu identifier__italian_cod wikipedia__scn identifier__ISNI identifier__FAST name__bg name__zh_hk name__zh_cn name__is wikipedia__bg wikipedia__is wikipedia__lv name__zh_hans name__zh_hant name__zh_sg name__zh_tw name__ilo wikipedia__ilo family_name identifier__britishmuseum identifier__NTA identifier__NLAtrove identifier__Oxforddnb identifier__NPG identifier__AuDB identifier__hansard wikipedia__nn identifier__Munzinger name__sl name__uz wikipedia__sl wikipedia__uz identifier__Britannica name__mr wikipedia__an wikipedia__ast wikipedia__cy wikipedia__mr name__hi wikipedia__hi identifier__GNC identifier__GTAA identifier__PACE wikipedia__hsb name__hsb occupation name__dsb name__jv name__pdc name__sh name__stq name__tl name__war name__qu wikipedia__qu name__tt identifier__snac identifier__youtube identifier__wikitree wikipedia__simple name__fo name__kl name__egl name__eml wikipedia__br wikipedia__itwikiquote identifier__BAV name__kn identifier__national_archives identifier__catholic_hierarchy wikipedia__eu identifier__ne_se identifier__SELIBR wikipedia__sk identifier__google_plus instagram identifier__bigenc_ru identifier__OLID name__ty identifier__rush
Q23881652
Silvio Schembri
Silvio Schembri
Silvio Schembri
Silvio Schembri
male
1985-05-21
Silvio
Silvio Schembri
Schembri
Silvio Schembri
politician
Q18536902
Karmenu Vassallo
Karmenu Vassallo
Karmenu Vassallo
male
Karmenu Vassallo
politician
Q25688004
Godfrey Farrugia
Godfrey Farrugia
Godfrey Farrugia
Godfrey Farrugia
Godfrey Farrugia
Godfrey Farrugia
Godfrey Farrugia
male
Godfrey
Godfrey Farrugia
Category:Godfrey Farrugia
Godfrey Farrugia
Farrugia
Godfrey Farrugia
politician
Q37861005
Clayton Bartolo
Clayton Bartolo
Clayton Bartolo
Clayton Bartolo
Clayton Bartolo
male
Clayton
Clayton Bartolo
Clayton Bartolo
Clayton Bartolo
Bartolo
Clayton Bartolo
politician
Q1871727
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
male
1947-03-22
Louis
Louis Grech
Louis Grech
Louis Grech
Louis Grech
/m/0546j6
Louis Grech
Louis Grech
28123
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Louis Grech
Category:Louis Grech
Louis Grech
Louis Grech
politician
Q18206002
Chris Fearne
Chris Fearne
Chris Fearne
Chris Fearne
Chris Fearne
Chris Fearne
Chris Fearne
Chris Fearne
male
1963-03-12
Chris
Chris Fearne
Chris Fearne
Chris Fearne
Fearne
Chris Fearne
politician
Q7351526
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Roberta Metsola
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Roberta Metsola
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Roberta Metsola
female
1979-01-18
Roberta
Roberta Metsola
Roberta Metsola Tedesco Triccas
Roberta Metsola
Roberta Metsola
/m/04yb7wg
Roberta Metsola
Roberta Metsola Tedesco Triccas
118859
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Roberta Metsola Tedesco Triccas
Category:Roberta Metsola
robertametsola
Roberta Metsola Tedesco Triccas
Roberta Metsola
Metsola
Roberta Metsola Tedesco Triccas
politician
Q57620
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
male
1953-07-01
Lawrence
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
/m/02rfy0
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
311774563
Lawrence Gonzi
Lawrence Gonzi
nb2014026177
Lawrence Gonzi
Гонци, Лоуренс
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Λόρενς Γκόνζι
Lawrence Gonzi
Лоренс Гонзі
劳伦斯·贡齐
Lawrence Gonzi
Lawrence Gonzi
لاورنس گونزی
Lawrence Gonzi
Lawrence Gonzi
ローレンス・ゴンズィ
로런스 곤지
Лорэнс Гонзі
Lawrence Gonzi
Λόρενς Γκόνζι
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
لاورنس گونزی
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
로런스 곤지
Lawrence Gonzi
Lawrence Gonzi
Гонзи, Лоренс
Lawrence Gonzi
Лоренс Гонзі
劳伦斯·贡齐
vhyzn0rv43za
ლოურენს გონცი
Category:Lawrence Gonzi
لورانس غونزي
لورانس غونزي
לורנס גונצי
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
Лоренс Гонзи
Lawrence Gonzi
Lawrence Gonzi
Lawrence Gonzi
לורנס גונצי
Lawrence Gonzi
Лоренс Гонзи
Lawrence Gonzi
Lawrence_Gonzi
lawrencegonzi
Lawrence Gonzi
Лорэнс Гонзі
Лорэнс Гонзі
Lawrence Gonzi
Lawrence Gonzi
biography/Lawrence-Gonzi
economist
Lawrence Gonzi
Lawrence Gonzi
Q1572200
Mikiel Gonzi
Mikiel Gonzi
Mikiel Gonzi
Mikiel Gonzi
Mikiel Gonzi
Michael Gonzi
Mikiel Gonzi
Mikiel Gonzi
Michael Gonzi
Mikiel Gonzi
Mikiel Gonzi
male
1885-05-13
Michael
Mikiel Gonzi
Michael Gonzi
Mikiel Gonzi
1984-01-22
Mikiel Gonzi
Mikiel Gonzi
priest
gonzi
Q37860840
Robert Abela
Robert Abela
Robert Abela
Robert Abela
Robert Abela
male
Robert
Robert Abela
Robert Abela
Robert Abela
Роберт Абела
Abela
Robert Abela
politician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (136 KB) Use the API

rows 10 / 37

id last_seen
Q20983473
2016-06-05
Q173958
2016-06-05
Q1363583
2016-06-05
Q2980429
2016-06-05
Q5497307
2016-06-05
Q15711259
2016-06-05
Q7341603
2016-06-05
Q16199692
2016-06-05
Q1508402
2016-06-05
Q5043368
2016-06-05

Statistics

Average successful run time: 1 minute

Total run time: about 17 hours

Total cpu time used: about 1 hour

Total disk space used: 173 KB

History

  • Auto ran revision 94233d26 and completed successfully .
    140 records updated in the database
    19 pages scraped
  • Auto ran revision 94233d26 and completed successfully .
    138 records updated in the database
    19 pages scraped
  • Auto ran revision 94233d26 and completed successfully .
    141 records updated in the database
  • Auto ran revision 94233d26 and completed successfully .
    139 records updated in the database
    19 pages scraped
  • Auto ran revision 94233d26 and completed successfully .
    139 records updated in the database
    19 pages scraped
  • ...
  • Created on morph.io

Show complete history