tmtmtmtm / azerbaijan-national-assembly-wikidata

Scrapes api.morph.io, az.wikipedia.org, www.wikidata.org, and 1 other domain

Get structured data out of the web. Code collaboration through GitHub. Run your scrapers in the cloud.


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing activesupport-inflector 0.1.0  Installing ast 2.3.0  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Fetching colorize 0.8.1  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Installing colorize 0.8.1  Fetching require_all 1.4.0  Installing coderay 1.1.1  Fetching excon 0.55.0  Installing unf_ext 0.0.7.4 with native extensions  Installing require_all 1.4.0  Installing excon 0.55.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.5  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Fetching nokogiri 1.7.1  Installing mime-types 3.1  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Installing domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching rubocop 0.48.1  Fetching wikidata-client 0.0.10  Installing rubocop 0.48.1  Installing wikidata-client 0.0.10  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Installing nokogiri 1.7.1 with native extensions  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (35.33s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Hikmət Məmmədov, Adil Əliyev, Tahir Süleymanov, Müslüm Məmmədov, Nəriman Əliyev, Elmira Axundova, Elxan Süleymanov, Nizami Cəfərov, İsmayıl Hacıyev (səhifə mövcud deyil), Əli Əhmədov (millət vəkili), Rövşən Rzayev (siyasətçi) in az ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2031 for Q2507445

Data

Downloaded 955 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (80 KB) Use the API

rows 10 / 155

id name__az name name__en gender birth_date given_name identifier__PACE identifier__VIAF image identifier__freebase website identifier__LCAuth death_date wikipedia__az wikipedia__en name__ru name__hy name__pl wikipedia__commons wikipedia__ru name__fr name__it name__de name__tr name__es name__nl wikipedia__azwikiquote wikipedia__tr name__cs name__fa name__id name__ka name__ms name__sv name__zh name__be wikipedia__be wikipedia__cs wikipedia__fa wikipedia__fr wikipedia__hy wikipedia__id wikipedia__it wikipedia__ka wikipedia__ms wikipedia__pl wikipedia__sv wikipedia__zh name__ro wikipedia__de wikipedia__ro name__ca name__oc name__en_gb wikipedia__azwikibooks wikipedia__es name__uk wikipedia__uk wikipedia__gag name__gag original_wikiname identifier__BNF identifier__SUDOC identifier__ISNI identifier__NUKAT identifier__LNB identifier__FAST name__hu last_seen name__da name__fo name__is name__kl name__nb name__nn name__ja name__eu name__tg identifier__google_knowledge name__ko wikipedia__ko occupation facebook name__el name__he wikipedia__ruwikinews wikipedia__tg wikipedia__pt wikipedia__vi name__pt wikipedia__he name__sk name__vi wikipedia__sk wikipedia__uz name__en_ca wikipedia__el name__uz name__ar wikipedia__ar wikipedia__bg name__bg family_name identifier__GND identifier__SELIBR name__ba name__lb
Q57549
Vasif Talıbov
Vasif Talıbov
Vasif Talibov
male
1960-01-14
Vasif
/m/02qj45k
Vasif Talıbov
Vasif Talibov
Талыбов, Васиф Юсиф оглы
Category:Vasif Talıbov
Талыбов, Васиф Юсиф оглы
Vasif Talibov
Vasif Talıbov
Vasif Talıbov
Vasif Talibov
Vasif Talibov
Vasıf Talibov
وصیف طالبوف
واصف طالبوف
Vasif Talıbov
Vasif Talıbov
Vasif Talibov
Vasif Talibov
Vasif Talıbov
Vasif Talibov
ヴァジフ・タリボフ
politician
Q20556703
Aslan Cəfərov
Aslan Cəfərov
male
Aslan Cəfərov
Aslan Cəfərov
Q16366024
Cavanşir Paşazadə
Cavanşir Paşazadə
male
1953
Cavanşir Paşazadə
Cavanşir Paşazadə
Q28527854
Elşən Musayev
Elşən Musayev
Elşən Musayev
male
Elşən Musayev
Elşən Musayev
Elşən Musayev
politician
Q12846308
Səttar Mehbalıyev
Səttar Mehbalıyev
male
1955
Səttar Mehbalıyev
Səttar Mehbalıyev
Q28527868
Pərvin Kərimzadə
Pərvin Kərimzadə
Pərvin Kərimzadə
Pərvin Kərimzadə
Pərvin Kərimzadə
Pərvin Kərimzadə
politician
Q12850308
Ərəstun Cavadov
Ərəstun Cavadov
male
Ərəstun Cavadov
Ərəstun Cavadov
Q16373861
Sahib Alıyev
Sahib Alıyev
male
1964-08-24
Sahib Alıyev
Sahib Alıyev
journalist
Q12836332
Azər Kərimli
Azər Kərimli
male
Azər Kərimli
Azər Kərimli
Q12842413
Mübariz Qurbanlı
Mübariz Qurbanlı
Mubariz Gurbanli
male
1954-01-07
https://upload.wikimedia.org/wikipedia/commons/4/4c/DQİDK_sədri_Mübariz_Qurbanlının_"Amerikanın_Səsi"nə_müsahibəsi_-_2.jpg
Mübariz Qurbanlı
Mubariz Gurbanli
Мубариз Гурбанлы
Category:Mübariz Qurbanlı
Гурбанлы, Мубариз
Mübariz Qurbanlı

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (80 KB) Use the API

rows 10 / 138

id last_seen
Q4054393
2016-06-05
Q16370502
2016-06-05
Q12836332
2016-06-05
Q12839470
2016-06-05
Q12842011
2016-06-05
Q12841562
2016-06-05
Q4071351
2016-06-05
Q12842330
2016-06-05
Q12839099
2016-06-05
Q12835439
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 116 KB

History

  • Auto ran revision cf28b0a5 and completed successfully .
    155 records updated in the database
    16 pages scraped
  • Auto ran revision cf28b0a5 and completed successfully .
    154 records updated in the database
    16 pages scraped
  • Auto ran revision cf28b0a5 and completed successfully .
    155 records updated in the database
    16 pages scraped
  • Auto ran revision cf28b0a5 and completed successfully .
    153 records updated in the database
    16 pages scraped
  • Auto ran revision cf28b0a5 and completed successfully .
    153 records updated in the database
    16 pages scraped
  • ...
  • Created on morph.io

Show complete history