Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Fetching colorize 0.8.1  Installing coderay 1.1.1  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Installing activesupport-inflector 0.1.0  Fetching unf_ext 0.0.7.4  Fetching require_all 1.4.0  Fetching excon 0.55.0  Installing require_all 1.4.0  Fetching multipart-post 2.0.0  Installing excon 0.55.0  Installing multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching hashie 3.5.5  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Fetching nokogiri 1.7.1  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Installing faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Installing rubocop 0.48.1  Installing nokogiri 1.7.1 with native extensions  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing wikidata-client 0.0.10  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Installing mime-types 3.1  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (40.65s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting configuration and compiling... Injecting scraper and running... Can't find Wikidata IDs for: List of members of the Parliament of Syria, 2016-2020 in en ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6404 for Q420743 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2950 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1225 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4359 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2888 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6723 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6404 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5905 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7314 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5034 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5019 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P6058 for Q42013 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7704 for Q4840646 ‼ Q11795049 is_instance_of position. Skipping ‼ Q6628223 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2031 for Q984486 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P7704 for Q984486

Data

Downloaded 1418 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (76 KB) Use the API

rows 10 / 61

id name__ar name__de name__ce name__fr name__en name__nl name wikipedia__ar wikipedia__ce wikipedia__de gender occupation identifier__VIAF identifier__BNF identifier__SUDOC birth_date death_date original_wikiname name__pt name__zh_hans name__zh_hant name__zh_hk name__es name__zh name__nb name__nn name__cy name__hu name__eu name__ja wikipedia__en wikipedia__pt wikipedia__zh identifier__freebase given_name name__fa name__he wikipedia__fa image name__ca name__tr name__it name__zh_cn wikipedia__ca wikipedia__es wikipedia__fr wikipedia__it wikipedia__nl wikipedia__tr name__hy wikipedia__hy wikipedia__hywikisource identifier__ISNI name__ka wikipedia__ka identifier__google_knowledge name__ru name__id name__pl wikipedia__id wikipedia__pl wikipedia__ru name__ko name__yo name__ms name__fi name__gl name__el name__bg name__sv wikipedia__bg wikipedia__el wikipedia__fi wikipedia__gl wikipedia__he wikipedia__hu wikipedia__ko wikipedia__ms wikipedia__sv wikipedia__yo name__lb name__jv name__qu name__gd name__bs name__ta name__et name__sq name__bcl name__pnb name__eo name__is name__yi name__new name__sr name__uk name__be_tarask name__io name__hr name__az name__da name__kk name__arz name__be name__lv name__ml name__vi name__yue name__sh name__sa name__hi name__sk name__ku name__ro name__th name__la name__sl name__cs name__mr name__ur name__war name__ga name__mg name__ckb name__li name__uz name__pa name__bn name__sco name__si name__ky name__lrc name__br name__sw wikipedia__arwikiquote wikipedia__arwikisource wikipedia__arz wikipedia__az wikipedia__bcl wikipedia__be_x_old wikipedia__be wikipedia__bn wikipedia__br wikipedia__bs wikipedia__ckb wikipedia__commons wikipedia__cs wikipedia__cswikiquote wikipedia__da wikipedia__eo wikipedia__et wikipedia__eu wikipedia__fawikiquote wikipedia__ga wikipedia__gd wikipedia__hewikiquote wikipedia__hi wikipedia__hr wikipedia__io wikipedia__is wikipedia__itwikiquote wikipedia__ja wikipedia__jv wikipedia__kk wikipedia__ku wikipedia__ky wikipedia__la wikipedia__lb wikipedia__liwikiquote wikipedia__lrc wikipedia__lv wikipedia__mg wikipedia__ml wikipedia__mr wikipedia__new wikipedia__nn wikipedia__no wikipedia__pa wikipedia__plwikiquote wikipedia__pnb wikipedia__ptwikiquote wikipedia__qu wikipedia__ro wikipedia__ruwikiquote wikipedia__sa wikipedia__sco wikipedia__sh wikipedia__simple wikipedia__si wikipedia__sk wikipedia__sl wikipedia__sq wikipedia__sr wikipedia__srwikinews wikipedia__sw wikipedia__ta wikipedia__th wikipedia__uk wikipedia__ur wikipedia__uz wikipedia__vi wikipedia__war wikipedia__yi wikipedia__zh_yue identifier__GND identifier__LCAuth identifier__IMDB identifier__NDL identifier__NLA identifier__MusicBrainz identifier__OLID identifier__NKC website identifier__SELIBR identifier__BNE identifier__NTA identifier__NNDB identifier__AlloCine identifier__Munzinger identifier__EGAXA identifier__NLAtrove identifier__N6I identifier__discogs identifier__FAST identifier__kinopoisk identifier__wikitree identifier__nobel_prize identifier__quora identifier__snac name__mzn name__pt_br wikipedia__mzn identifier__GNC name__zh_sg name__zh_tw identifier__bigenc_ru identifier__persee identifier__Britannica wikipedia__af name__af wikipedia__fo wikipedia__ast name__ast name__fo wikipedia__cy name__aeb_arab identifier__CONOR wikipedia__an wikipedia__lfn name__lfn name__an wikipedia__tl identifier__GTAA name__tl wikipedia__wuu wikipedia__ne name__wuu name__ne wikipedia__nov name__nov wikipedia__tg name__tg name__te wikipedia__hyw family_name name__hyw wikipedia__azb name__azb wikipedia__enwikiquote name__ary wikipedia__ha name__ha identifier__youtube
Q16117638
حماد عبود السعود
حماد عبود السعود
حماد عبود السعود
male
politician
حماد عبود السعود
Q12252042
يوسف السعدون
Yusuf al-Sa'dun
Yusuf al-Sa'dun
يوسف السعدون
يوسف السعدون
male
military personnel
1888
1980
يوسف السعدون
Yusuf al-Sa'dun
Yusuf al-Sa'dun
Yusuf
Yusuf al-Sa'dun
Q1751022
صبري العسلي
Sabri al-Asali
Sabri al Assali
Sabri al-Asali
Sabri al-Asali
صبري العسلي
صبري العسلي
Sabri al-Asali
male
politician
1903
1976-04-13
Sabri al-Asali
Sabri al-Asali
Sabri al-Asali
Sabri al-Asali
/m/05mz0r7
صبری العسلی
صبری العسلی
Sabri al Assali
Сабри Асали
Sabri al-Assali
Sabri al-Asali
Sabri al-Assali
Sabri al-Asali
Асали, Сабри
Sabri al-Asali
Sabri al-Asali
Category:Sabri al-Asali
120221665X
صبري العسلي
Q169841
ناظم القدسي
Nazem Koudsi
Nazem Koudsi
Nazim al-Kudsi
Nazim al-Kudsi
ناظم القدسي
ناظم القدسي
Nazim al-Qudsi
male
diplomat
122372778
1906-02-14
1998-02-06
Nazim al-Kudsi
Nazim al-Kudsi
Nazim al-Kudsi
ナーズィム・アル=クドゥシー
Nazim al-Kudsi
Nazim al-Kudsi
/m/04gz61
Nazim
ناظم القدسی
נאזם אל-קודסי
ناظم قدسی
Nazim al-Kudsi
Nazım el Kutsi
Nazim al-Kudsi
Nazim al-Kudsi
Nazem Koudsi
0000 0000 8075 6801
Назим аль-Кудси
Nazim al-Kudsi
Nazim al-Kudsi
Nazim al-Kudsi
Nazim al-Kudsi
Назим аль-Кудси
Nazim al-Kudsi
Nazim al-Kudsi
Category:Nazim al-Kudsi
Nazim al-Kudsi
173277047
ناظم القدسی
Nazim al-Kudsi
ناظم القدسی
biography/Nazim-al-Kudsi
Nazim al-Kudsi
Nazim al-Kudsi
ناظم القدسي
Q24572906
هدية عباس
Hadiya Khalaf Abbas
Hadiya Khalaf Abbas
هدية عباس
هدية عباس
female
politician
1958
Hadiya Khalaf Abbas
Hadiya Khalaf Abbas
哈迪娅哈拉夫阿巴斯
Hadiya Khalaf Abbas
哈迪亚·哈拉夫·阿巴斯
هدیه عباس
هدیه عباس
Hadiya Khalaf Abbas
ჰადია ხალაფ აბასი
ჰადია ხალაფ აბასი
/g/11bzs54ct3
Hadiya Khalaf Abbas
हादिया खालेफ अब्बास
Hadiya Khalaf Abbas
हादिया खालेफ अब्बास
Hadiya Khalaf Abbas
هدية عباس
Q6751904
منصور الأطرش
Mansur al-Atrash
Mansur al-Atrash
Mansur al-Atrash
منصور الأطرش
منصور الأطرش
male
politician
31530547
1925-02-03
2006-11-14
Mansur al-Atrash
Mansur al-Atrash
Mansur al-Atrash
מנסור אל-אטרש
0000 0001 1963 6170
Mansur al-Atrash
Mansur al-Atrasz
Mansur al-Atrash
Mansur al-Atrasz
منصور الأطرش
Category:Mansur Al-Atrash
nb2008016528
Al-Atrash-2
Q1352670
حسني البرازي
Housni al-Barazi
Housni al-Barazi
Husni al-Barazi
Housni al-Barazi
حسني البرازي
حسني البرازي
Housni al-Barazi
male
politician
313286486
1895
1975
Husni al-Barazi
Husni al-Barazi
Husni al-Barazi
Husni al-Barazi
/m/080gg38
حسنی البرازی
حسنی البرازی
Housni al-Barazi
Хусни аль-Барази
Хусни аль-Барази
Husni al-Barazi
n2014203977
حسني البرازي
Q2688982
سعيد الغزي
Said al-Ghazzi
Said al-Ghazzi
Said al-Ghazzi
سعيد الغزي
سعيد الغزي
Said al-Ghazzi
male
diplomat
1893-06-11
1967-09-18
Said al-Ghazzi
Said al-Ghazzi
Said al-Ghazzi
/m/0bmd5bp
Sa'id
سعید الغزی
سعید الغزی
Саид Гази
Said al-Ghazzi
Said al-Ghazzi
Гази, Саид
Said al-Ghazzi
Said al-Ghazzi
Said al-Ghazzi
سعيد الغزي
Q79240567
Maria Saadeh
Maria Saadeh
female
politician
1974-01-01
Maria Saadeh
Maria Saadeh
Maria
Maria Saadeh
Saadeh
UCff1c8t9WK5eT9MBFYRjAqw
Q7398853
صفوان القدسي
Safwan al-Qudsi
صفوان القدسي
صفوان القدسي
male
politician
39790595
1940
Safwan al-Qudsi
Safwan al-Qudsi
Safwan al-Qudsi
0000 0000 0759 2169
n78074932
Safwan al-Qudsi

Statistics

Average successful run time: less than a minute

Total run time: about 15 hours

Total cpu time used: about 1 hour

Total disk space used: 102 KB

History

  • Auto ran revision 79507e80 and completed successfully .
    61 records updated in the database
  • Auto ran revision 79507e80 and completed successfully .
    58 records updated in the database
  • Auto ran revision 79507e80 and failed .
    nothing changed in the database
  • Auto ran revision 79507e80 and completed successfully .
    61 records updated in the database
  • Auto ran revision 79507e80 and completed successfully .
    61 records updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

syria-council-wikidata / scraper.rb