This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Installing rake 12.0.0  Fetching colorize 0.8.1  Installing colorize 0.8.1  Installing coderay 1.1.1  Fetching diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching require_all 1.4.0  Installing unf_ext 0.0.7.4 with native extensions  Installing diskcached 1.1.3  Fetching excon 0.55.0  Installing require_all 1.4.0  Fetching multipart-post 2.0.0  Installing excon 0.55.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.5  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Installing domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.3  Fetching wikidata-client 0.0.10  Installing rubocop 0.48.1  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Installing wikidata-client 0.0.10  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (38.85s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q202002 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333520 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q1929744 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q1175613 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3884 for Q514743 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4548 for Q514743 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6722 for Q467112 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q467112 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4342 for Q467112 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P973 for Q24039769 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333807 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q132040 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4342 for Q132040 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q511689 FIXME: Unhandled 'time' precision: 8 Unknown value for P569 for Q24052665 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3762 for Q333847 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333847 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1225 for Q1519985 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6005 for Q512681 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q1700483 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q542330 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5034 for Q542330 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q559022 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333903 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q334376 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333158 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q1339371 Unknown value for P569 for Q24034371 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2959 for Q983174 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q983174 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333630 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q1418512 FIXME: Unhandled 'time' precision: 8 Unknown value for P569 for Q24026044 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q1738042 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333953 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4159 for Q333795 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3280 for Q333795 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q333795 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q10652 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5019 for Q10652 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6722 for Q334015 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7349 for Q334015

Data

Downloaded 81 times by loudspeek-bot mashedkeyboard

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (273 KB) Use the API

rows 10 / 238

id name name__en name__gd name__ja name__nl name__bn name__es name__ast name__sco name__sl wikipedia__en wikipedia__gd wikipedia__sco occupation gender given_name image twitter family_name identifier__democracyclub original_wikiname name__de name__fr name__nb name__da name__nn name__sv name__hu name__ru name__ca wikipedia__commons wikipedia__de birth_date name__it identifier__hansard identifier__freebase identifier__rush name__ar wikipedia__ar name__tr name__zh wikipedia__tr name__az wikipedia__az wikipedia__ca name__ga wikipedia__ga identifier__snac name__cy name__zh_hant name__zh_cn name__zh_hans wikipedia__es identifier__VIAF identifier__LCAuth death_date identifier__FAST identifier__ISNI identifier__Oxforddnb identifier__national_archives name__fa name__nds name__en_ca name__en_gb wikipedia__fr website wikipedia__hu name__af name__an name__bar name__br name__co name__cs name__de_at name__de_ch name__eo name__et name__eu name__fi name__frp name__fur name__gl name__gsw name__hr name__ia name__id name__ie name__io name__is name__kg name__lb name__li name__lij name__mg name__min name__ms name__nap name__nds_nl name__nrm name__oc name__pcd name__pl name__pms name__pt name__pt_br name__rm name__ro name__sc name__scn name__sk name__sr_el name__sw name__vec name__vi name__vls name__vo name__wa name__wo name__zu identifier__parliamentDOTuk identifier__ukparliamentid name__he name__la name__mk name__el name__uk name__yue name__fy name__ko name__ka name__zh_hk name__zh_mo name__zh_my name__zh_sg name__zh_tw name__eml name__or name__hy name__te wikipedia__af wikipedia__bar wikipedia__br wikipedia__cs wikipedia__cy wikipedia__da wikipedia__el wikipedia__eml wikipedia__enwikinews wikipedia__enwikiquote wikipedia__eo wikipedia__et wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__fy wikipedia__gl wikipedia__he wikipedia__id wikipedia__ie wikipedia__is wikipedia__it wikipedia__ja wikipedia__ka wikipedia__ko wikipedia__la wikipedia__nl wikipedia__nlwikinews wikipedia__no wikipedia__oc wikipedia__pl wikipedia__plwikiquote wikipedia__pt wikipedia__ro wikipedia__ru wikipedia__ruwikinews wikipedia__simple wikipedia__sv wikipedia__te wikipedia__uk wikipedia__zh_yue wikipedia__zh identifier__GND identifier__guardian_topic identifier__ne_se identifier__BBC_things identifier__quora identifier__Britannica identifier__GTAA name__bm name__frc name__jam name__kab name__lt name__lv name__pap name__prg name__rgn name__vmf name__azb wikipedia__azb facebook wikipedia__mg identifier__publicwhip identifier__TWFY identifier__NPG name__fo name__kl name__kn identifier__EuroparlMEP identifier__wikitree identifier__google_knowledge identifier__bbc_democracy_live honorific_prefix identifier__NTA noble_title name__sh name__bg name__be name__be_tarask name__ext wikipedia__an wikipedia__be_x_old wikipedia__be wikipedia__bewikiquote wikipedia__bg wikipedia__cawikiquote wikipedia__eowikinews wikipedia__sh wikipedia__vi identifier__PACE name__sr_ec name__sr wikipedia__sr wikipedia__hy name__ty identifier__NNDB identifier__BIBSYS identifier__NUKAT name__qu wikipedia__ast wikipedia__io wikipedia__qu wikipedia__ms identifier__current_hansard identifier__journalisted name__sq name__ta wikipedia__ta name__ang name__nys wikipedia__bat_smg wikipedia__itwikiquote name__sgs wikipedia__ia
Q1655380
Iain Smith
Iain Smith
Iain Smith
Iain Smith
Iain Smith
Iain Smith
Iain Smith (Scottish politician)
politician
male
Iain
Smith
Iain Smith (Scottish politician)
Iain Smith
Iain Smith
Iain Smith
Иэн Смит
Iain Smith
Category:Iain Smith
Iain Smith (Politiker)
1960-05-01
/m/01_npv
لاين سميث
لاين سميث
Q1953855
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
politician
male
Murray
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
Murray Tosh
1950-09-01
Q1538053
Gordon MacDonald
Gordon MacDonald
Gòrdan Dòmhnallach
ゴードン・マクドナルド
Gordon MacDonald
Gordon MacDonald
Gordon MacDonald
Gordon MacDonald
Gordon MacDonald
Gordon MacDonald (Scottish politician)
Gòrdan Dòmhnallach
Gordon MacDonald (Scots politeecian)
politician
male
Gordon
GMacdonaldMSP
MacDonald
8210
Gordon MacDonald (Scottish politician)
Gordon MacDonald
Gordon MacDonald
Gordon MacDonald
Гордон МакДональд
Gordon MacDonald
Gordon MacDonald (Politiker, 1960)
1960-01-02
/m/0gmgmzl
غوردون ماكدونالد
غوردون ماكدونالد
105194266
0000 0000 7443 8321
Q24045406
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
アレックス・コール=ハミルトン
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
politician
male
Alex
agcolehamilton
8283
Alex Cole-Hamilton
Alex Cole-Hamilton
Alex Cole-Hamilton
Category:Alex Cole-Hamilton
1977-07-22
Q1174169
David Davidson
David Davidson
David Davidson
David Davidson
David Davidson
David Davidson
David Davidson (Scottish politician)
politician
male
David
Davidson
David Davidson (Scottish politician)
David Davidson
David Davidson
David Davidson
David Davidson
David Davidson (Politiker)
1943-01-25
/m/0b11c3
16716006
nb98001142
0000 0001 1438 7080
138018154
067599362
Q467097
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
politician
female
Linda
LindaFabianiSNP
Fabiani
9245
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Linda Fabiani
Category:Linda Fabiani
Linda Fabiani
1956-12-14
Linda Fabiani
/m/02p8lv
Linda Fabiani
Q1344022
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
politician
female
Karen
Whitefield
4334
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
Karen Whitefield
1970-01-08
/m/0bklgv
Q202002
Robin Harper
Robin Harper
Robin Harper
Robin Harper
Robin Harper
Robin Harper
Robin Harper
Robin Harper
Robin Harper
politician
male
Robin
Harper
Robin Harper
Robin Harper
Robin Harper
Robin Harper
Робин Харпер
Robin Harper
Category:Robin Harper
Robin Harper
1940-08-04
/m/03t1c3
روبن هاربر
روبن هاربر
172705753
no2011102056
0000 0001 2304 4370
14393404X
Q862234
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
politician
male
Bill
BillKiddSNP
8332
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
Bill Kidd
1956-07-24
/m/02r4ng0
بيل كيد
بيل كيد
Q333520
David Mundell
David Mundell
Dàibhidh Mundell
デイヴィッド・マンデル
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
Dàibhidh Mundell
David Mundell
politician
male
David
DavidMundellDCT
Mundell
1592
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
Дэвид Манделл
David Mundell
Category:David Mundell
David Mundell
1962-05-27
David Mundell
mr-david-mundell
/m/062r04
9496
戴维·蒙戴尔
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
David Mundell
commons/david-mundell/1512
Xx3pGa0q
דייוויד מאנדל
Девід Манделл
蒙德爾
Դևիդ Մանդել
David Mundell
David Mundell
דייוויד מאנדל
David Mundell
David Mundell
Манделл, Дэвид
David Mundell
Девід Манделл
蒙德爾
戴维·蒙戴尔
DavidMundellMP
David_Mundell
11970
32679
Դևիդ Մանդել

Statistics

Average successful run time: 2 minutes

Total run time: about 4 hours

Total cpu time used: 14 minutes

Total disk space used: 308 KB

History

  • Auto ran revision 0b29a059 and completed successfully .
    236 records updated in the database
  • Auto ran revision 0b29a059 and completed successfully .
    236 records updated in the database
  • Auto ran revision 0b29a059 and completed successfully .
    237 records updated in the database
  • Auto ran revision 0b29a059 and completed successfully .
    237 records updated in the database
  • Auto ran revision 0b29a059 and completed successfully .
    238 records updated in the database
  • ...
  • Created on morph.io

Show complete history