tmtmtmtm / jordan-house-of-representatives-wikidata

Scrapes api.morph.io, query.wikidata.org, en.wikipedia.org, and 2 other domains

Get structured data out of the web. Code collaboration through GitHub. Run your scrapers in the cloud.


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Fetching colorize 0.8.1  Installing coderay 1.1.1  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching require_all 1.4.0  Installing require_all 1.4.0  Fetching excon 0.55.0  Installing rake 12.0.0  Installing unf_ext 0.0.7.4 with native extensions  Installing excon 0.55.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.5  Installing hashie 3.5.5  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching i18n 0.8.1  Fetching json 2.1.0  Installing i18n 0.8.1  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Installing domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing rubocop 0.48.1  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.20.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@6cbd151)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (35.58s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Unknown value for P214 for Q34426 Unknown value for P735 for Q12222829

Data

Downloaded 762 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (41 KB) Use the API

rows 10 / 72

id name__ar name wikipedia__ar name__en wikipedia__en gender death_date given_name birth_date identifier__VIAF identifier__LCAuth name__de name__fr name__it name__cy name__nl original_wikiname name__pl name__el name__nb name__tr name__uz name__es name__ca name__oc name__ru name__et name__he name__ko name__ja name__vi name__da name__nn name__sv wikipedia__de wikipedia__el wikipedia__enwikiquote wikipedia__es wikipedia__et wikipedia__fr wikipedia__he wikipedia__it wikipedia__ja wikipedia__ko wikipedia__pl wikipedia__ru wikipedia__tr wikipedia__vi image identifier__freebase identifier__FAST identifier__EGAXA name__pt wikipedia__pt name__zh name__fi wikipedia__fi wikipedia__zh name__zh_hans name__zh_hant name__zh_hk name__hu identifier__ISNI last_seen twitter wikipedia__mg name__mg identifier__GND name__ast wikipedia__ast wikipedia__simple name__zh_cn wikipedia__fa name__fa wikipedia__commons occupation facebook wikipedia__ce name__ce wikipedia__id name__id name__an name__ext name__gl wikipedia__ml name__ml wikipedia__th name__th
Q12223240
عبد الكريم الدغمي
عبد الكريم الدغمي
male
Abdul Karim
politician
Q307623
عبد الله الريماوي
Abdullah Rimawi
عبد الله الريماوي
Abdullah Rimawi
Abdullah Rimawi
male
1980-03-05
Abdullah
1920
172798533
Abdallah ar-Rimawi
Abdullah Rimawi
Abdullah Rimawi
Abdullah Rimawi
עבדאללה רימאוי
Abdallah ar-Rimawi
עבדאללה רימאוי
/m/0gtvqrb
001441868
Abdullah Rimawi
عبدالله الریماوی
عبدالله الریماوی
politician
Abdullah Rimawi
Abdullah Rimawi
Q2067199
عبد الرؤوف الروابدة
Abdelraouf al-Rawabdeh
عبد الرؤوف الروابدة
Abdelraouf al-Rawabdeh
Abdelraouf Al-Rawabdeh
male
1939
Abdelraouf al-Rawabdeh
Abdelraouf al-Rawabdeh
Abdelraouf al-Rawabdeh
Abd ar-Ra’uf ar-Rawabida
Abdelraouf al-Rawabdeh
Абдельрауф аль-Равабде
עבד א-ראוף א-רוואבדה
Abdelraouf al-Rawabdeh
עבד א-ראוף א-רוואבדה
Abd ar-Ra’uf ar-Rawabida
Абдуррауф ар-Равабде
/m/0dk_7g
Abdelraouf al-Rawabdeh
politician
Q613191
أنور نسيبة
Anwar Nusseibeh
أنور نسيبة
Anwar Nusseibeh
Anwar Nusseibeh
male
1986-11-24
Anwar
1913
211149366025385600766
Anwar Nusseibeh
Anwar Nusseibeh
Anwar Nusseibeh
Anwar Nusseibeh
אנוואר נוסייבה
Anwar Nusseibeh
אנוואר נוסייבה
/m/02w9rnw
Anwar Nusseibeh
انور نسیبه
انور نسیبه
diplomat
Q12223396
عبد الله العكايلة
عبد الله العكايلة
male
Abdullah
politician
Q20425837
هند حاكم الفايز
هند حاكم الفايز
female
politician
Q12221493
طارق خوري
Tareq Khouri
طارق خوري
Tareq Khouri
Tareq Khouri
male
1967-12-01
Tareq Khouri
Q7409504
Samir Habashneh
Samir Habashneh
Samir Habashneh
male
Samir
1951
Samir Habashneh
Samir Habashneh
Samir Habashneh
Samir Habashneh
Samir Habashneh
Samir Habashneh
politician
Q4072991
أحمد اللوزي
Ahmad Lozi
أحمد اللوزي
Ahmad Lozi
Ahmad Lozi
male
2014-11-18
Ahmad
1925
Ahmad Lozi
Ahmad Lozi
Ahmad Lozi
Ahmad Lozi
Ahmad al-Lauzi
Ahmad Lozi
Ахмад аль-Лавзи
אחמד א-לווזי
Ahmad al-Lawzi
אחמד א-לווזי
Ahmad al-Lauzi
Ахмад аль-Лавзи
Ahmad Lozi
Ahmad Lozi
politician
Q21997854
Eteiwi Majali
Eteiwi Majali
Eteiwi Majali
male
2015-10-24
1950
Eteiwi Majali
Eteiwi Majali

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (41 KB) Use the API

rows 10 / 33

id last_seen
Q15993146
2016-05-15
Q15429215
2016-05-15
Q4664651
2016-06-05
Q2509606
2016-06-05
Q16929790
2016-06-05
Q15993101
2016-06-05
Q4831460
2016-06-05
Q17070373
2016-06-05
Q16730808
2016-06-05
Q4818087
2016-06-05

Statistics

Average successful run time: 1 minute

Total run time: about 17 hours

Total cpu time used: 33 minutes

Total disk space used: 74.9 KB

History

  • Auto ran revision 641952f2 and completed successfully .
    71 records updated in the database
    8 pages scraped
  • Auto ran revision 641952f2 and completed successfully .
    72 records updated in the database
    9 pages scraped
  • Auto ran revision 641952f2 and completed successfully .
    72 records updated in the database
    8 pages scraped
  • Auto ran revision 641952f2 and completed successfully .
    71 records updated in the database
    8 pages scraped
  • Auto ran revision 641952f2 and completed successfully .
    72 records updated in the database
    8 pages scraped
  • ...
  • Created on morph.io

Show complete history