tmtmtmtm / malta-parliament-wikidata

Scrapes en.wikipedia.org, mt.wikipedia.org, query.wikidata.org, and 2 other domains

Wikipedia, the free encyclopedia


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing ast 2.4.0  Installing activesupport-inflector 0.1.0  Fetching colorize 0.8.1  Installing coderay 1.1.2  Fetching concurrent-ruby 1.0.5  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.5  Installing unf_ext 0.0.7.5 with native extensions  Installing colorize 0.8.1  Fetching require_all 2.0.0  Installing require_all 2.0.0  Installing concurrent-ruby 1.0.5  Fetching excon 0.62.0  Installing excon 0.62.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing httpclient 2.8.3  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.5.0.5  Installing parser 2.5.0.5  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 1.0.0  Installing i18n 1.0.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.2  Installing nokogiri 1.8.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching rubocop 0.54.0  Installing rubocop 0.54.0  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Fetching faraday_middleware 0.12.2  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing faraday_middleware 0.12.2  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing wikidata-client 0.0.12  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@f6a205f)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (34.97s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Anthony Zammit, Leo Brincat in mt ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q167307 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q167307 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1599 for Q333979 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3794 for Q333979 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4471 for Q333979 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q250177 ‼ Q13828291 is_instance_of Cabinet of Malta. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q1043593 ‼ Q1817866 is_instance_of bicameral legislature & unicameral legislature. Skipping

Data

Downloaded 1206 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (133 KB) Use the API

rows 10 / 140

id name__en name__mt name__nl name__pl name__de name__it name wikipedia__en wikipedia__it wikipedia__mt wikipedia__pl gender birth_date given_name name__fr name__es wikipedia__de wikipedia__fr identifier__freebase name__pt name__sv wikipedia__nl wikipedia__pt wikipedia__sv identifier__VIAF identifier__GND identifier__IMDB name__da wikipedia__da identifier__LCAuth website identifier__EuroparlMEP name__la wikipedia__la name__az wikipedia__az name__ga name__ro name__ru name__hu name__pt_br name__tr name__eo name__lb name__cs name__et name__de_ch name__el name__en_ca name__en_gb name__nb name__lmo name__uk name__zh name__io name__fi name__lt name__fa name__nn name__id name__ja name__be name__ko wikipedia__be wikipedia__cs wikipedia__el wikipedia__eo wikipedia__es wikipedia__et wikipedia__fa wikipedia__fi wikipedia__ga wikipedia__hu wikipedia__id wikipedia__io wikipedia__ja wikipedia__ko wikipedia__lb wikipedia__lmo wikipedia__lt wikipedia__no wikipedia__ro wikipedia__ru wikipedia__tr wikipedia__uk wikipedia__zh image identifier__parlement name__ka wikipedia__ka wikipedia__commons identifier__BNF wikipedia__ar name__ar wikipedia__plwikiquote death_date name__he name__oc name__yo name__gl name__sr name__ca wikipedia__ca wikipedia__gl wikipedia__he wikipedia__oc wikipedia__sr wikipedia__yo twitter facebook identifier__SUDOC original_wikiname last_seen wikipedia__be_x_old name__be_tarask name__af name__an name__ast name__bar name__bm name__br name__co name__cy name__de_at name__eu name__frc name__frp name__fur name__gd name__gsw name__hr name__ia name__ie name__jam name__kab name__kg name__li name__lij name__lv name__mg name__min name__ms name__nap name__nds name__nds_nl name__nrm name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__scn name__sco name__sk name__sr_el name__sw name__vec name__vi name__vls name__vmf name__vo name__wa name__wo name__zu identifier__italian_cod wikipedia__scn identifier__ISNI identifier__FAST name__bg name__zh_hk name__zh_cn name__is wikipedia__bg wikipedia__is wikipedia__lv name__zh_hans name__zh_hant name__zh_sg name__zh_tw name__ilo wikipedia__ilo family_name identifier__britishmuseum identifier__NTA identifier__NLAtrove identifier__Oxforddnb identifier__NPG identifier__AuDB identifier__hansard wikipedia__nn identifier__Munzinger name__sl name__uz wikipedia__sl wikipedia__uz identifier__Britannica name__mr wikipedia__an wikipedia__ast wikipedia__cy wikipedia__mr name__hi wikipedia__hi identifier__GNC identifier__GTAA identifier__PACE wikipedia__hsb name__hsb occupation name__dsb name__jv name__pdc name__sh name__stq name__tl name__war name__qu wikipedia__qu name__tt identifier__snac identifier__youtube identifier__wikitree wikipedia__simple name__fo name__kl name__egl name__eml wikipedia__br wikipedia__itwikiquote identifier__BAV name__kn identifier__national_archives identifier__catholic_hierarchy wikipedia__eu identifier__ne_se identifier__SELIBR wikipedia__sk identifier__google_plus instagram identifier__bigenc_ru identifier__OLID name__ty
Q18536896
Wenzu Mintoff
Wenzu Mintoff
Wenzu Mintoff
Wenzu Mintoff
Wenzu Mintoff
Wenzu Mintoff
male
1959-12-11
Wenzu Mintoff
Wenzu Mintoff
Wenzu Mintoff
lawyer
Q37861132
Maria Deguara
Maria Deguara
Maria Deguara
Maria Deguara
Maria Deguara
female
Maria
Maria Deguara
Maria Deguara
Maria Deguara
Deguara
Maria Deguara
politician
Q18536879
Kalċidon Agius
Kalċidon Agius
Kalċidon Agius
male
Kalċidon Agius
Q37861230
Silvio Grixti
Silvio Grixti
Silvio Grixti
Silvio Grixti
Silvio Grixti
male
Silvio
Silvio Grixti
Silvio Grixti
Silvio Grixti
Grixti
Silvio Grixti
politician
Q4762878
Angelo Farrugia
Anġlu Farrugia
Angelo Farrugia
Angelo Farrugia
Angelo Farrugia
Angelo Farrugia
Angelo Farrugia
Angelo Farrugia
Angelo Farrugia
Anġlu Farrugia
Angelo Farrugia
male
1955-12-29
Angelo
Angelo Farrugia
安傑洛·法魯賈
Anġlu Farrugia
Angelo Farrugia
politician
Q7149445
Paul Borg Olivier
Paul Borg Olivier
Paul Borg Olivier
Paul Borg Olivier
Paul Borg Olivier
Paul Borg Olivier
Paul Borg Olivier
male
1969-09-01
Paul
Paul Borg Olivier
Paul Borg Olivier
Paul Borg Olivier
politician
Q47537506
Chris Said
Chris Said
Chris Said
male
Chris Said
politician
Q4771963
Anthony Abela
Anthony Abela
Anthony Abela
Anthony Abela
Anthony Abela
Anthony Abela
male
1954
Anthony
Anthony Abela
Anthony Abela
292662085
13998657X
15500489d
2006-04-04
Anthony Abela
0000 0003 9932 4787
Anthony Abela
philosopher
Q18536886
Ġużè Cassar
Ġużè Cassar
Ġużè Cassar
Ġużè Cassar
male
1918-01-22
Ġużè Cassar
2001-11-27
Ġużè Cassar
Q5537111
George Borg
George Borg
George Borg
George Borg
George Borg
George Borg (judge)
George Borg
male
1887-04-23
George
George Borg
1954-06-29
George Borg
George Borg
judge

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (133 KB) Use the API

rows 10 / 37

id last_seen
Q20983473
2016-06-05
Q173958
2016-06-05
Q1363583
2016-06-05
Q2980429
2016-06-05
Q5497307
2016-06-05
Q15711259
2016-06-05
Q7341603
2016-06-05
Q16199692
2016-06-05
Q1508402
2016-06-05
Q5043368
2016-06-05

Statistics

Average successful run time: 1 minute

Total run time: about 16 hours

Total cpu time used: about 1 hour

Total disk space used: 170 KB

History

  • Auto ran revision 94233d26 and completed successfully .
    136 records updated in the database
    18 pages scraped
  • Auto ran revision 94233d26 and completed successfully .
    140 records updated in the database
  • Auto ran revision 94233d26 and completed successfully .
    139 records updated in the database
    143 pages scraped
  • Auto ran revision 94233d26 and completed successfully .
    139 records updated in the database
    18 pages scraped
  • Auto ran revision 94233d26 and completed successfully .
    140 records updated in the database
    18 pages scraped
  • ...
  • Created on morph.io

Show complete history