Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikidata-area.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.3.2  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing ast 2.4.0  Installing coderay 1.1.2  Installing rake 12.3.2  Fetching unf_ext 0.0.7.6  Fetching require_all 2.0.0  Fetching excon 0.64.0  Installing require_all 2.0.0  Fetching multipart-post 2.0.0  Installing excon 0.64.0  Installing multipart-post 2.0.0  Installing unf_ext 0.0.7.6 with native extensions  Fetching hashie 3.6.0  Installing hashie 3.6.0  Fetching httpclient 2.8.3  Fetching jaro_winkler 1.5.2  Installing jaro_winkler 1.5.2 with native extensions  Installing httpclient 2.8.3  Fetching json 2.2.0  Installing json 2.2.0 with native extensions  Fetching method_source 0.9.2  Installing method_source 0.9.2  Fetching mime-types-data 3.2019.0331  Installing mime-types-data 3.2019.0331  Fetching mini_portile2 2.4.0  Installing mini_portile2 2.4.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching parallel 1.17.0  Installing parallel 1.17.0  Fetching psych 3.1.0  Installing psych 3.1.0 with native extensions  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.10.0  Installing ruby-progressbar 1.10.0  Fetching unicode-display_width 1.5.0  Installing unicode-display_width 1.5.0  Fetching sqlite3 1.4.0  Installing sqlite3 1.4.0 with native extensions  Using wikidata-area 0.1.1 from https://github.com/everypolitician/wikidata-area.git (at master@408ec86)  Fetching yajl-ruby 1.4.1  Installing yajl-ruby 1.4.1 with native extensions  Fetching parser 2.6.2.1  Installing parser 2.6.2.1  Fetching everypolitician-popolo 0.9.0  Installing everypolitician-popolo 0.9.0  Fetching faraday 0.15.4  Installing faraday 0.15.4  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching pry 0.12.2  Installing pry 0.12.2  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.3  Installing nokogiri 1.10.3 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching rubocop 0.67.2  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@f85e4b6)  Installing rubocop 0.67.2  Fetching faraday_middleware 0.13.1  Installing faraday_middleware 0.13.1  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Fetching mediawiki_api 0.7.1  Installing wikidata-client 0.0.12  Installing rest-client 2.0.2  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.24.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@cb919d1)  Bundle complete! 8 Gemfile dependencies, 44 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from rubocop:  Performance Cops will be removed from RuboCop 0.68. Use rubocop-performance gem instead.  Put this in your Gemfile.  gem 'rubocop-performance'  And then execute:  $ bundle install  Put this into your .rubocop.yml.  require: rubocop-performance  More information: https://github.com/rubocop-hq/rubocop-performance  Bundle completed (41.74s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1204.map Unknown property for Q5095299: P3896 = Unknown property for Q5878130: P1342 = 8 Unknown property for Q6452102: P1001 = Sakyō-ku Unknown property for Q6452106: P1001 = Fushimi-ku Unknown property for Q6452111: P1001 = Fukuchiyama Unknown property for Q7570062: P1342 = 22 Unknown property for Q7814046: P1342 = 17 Unknown property for Q11375290: P1001 = Kita-ku Unknown property for Q11375291: P1001 = Ukyō-ku Unknown property for Q11375292: P1001 = Uji Unknown property for Q49913: P1342 = 13 FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1212.map Unknown property for Q11406378: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1213.map Unknown property for Q11406379: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1210.map Unknown property for Q11406376: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1211.map Unknown property for Q11406377: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1203.map Unknown property for Q11406383: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1201.map Unknown property for Q11406380: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1202.map Unknown property for Q11406381: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1205.map Unknown property for Q11406386: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1206.map Unknown property for Q11406387: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1209.map Unknown property for Q11406390: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1208.map Unknown property for Q11406388: P3896 = FIXME: 'geo-shape' is not implemented yet in Wikisnakker::Snak#value. Defaulting to empty string. Data:Japan/election/2017/shuin1207.map Unknown property for Q11406389: P3896 = Unknown property for Q11547386: P1342 = 19 Unknown property for Q11547387: P1342 = 11 Unknown property for Q11547385: P1342 = 20 Unknown property for Q11547389: P1342 = 21

Data

Downloaded 1721 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (81 KB) Use the API

rows 10 / 328

id type name__ja name__en name__zh name__fr name__ko start_date end_date name__zh_cn name__zh_hans name__ca identifier__freebase name__zh_hant name__es
Q251994
district of the House of Representatives of Japan
長崎県第3区
Nagasaki 3rd district
長崎縣第3區
troisième circonscription de la préfecture de Nagasaki
Q376715
district of the House of Representatives of Japan
大阪府第12区
Osaka 12th district
大阪府第12區
Douzième circonscription d'Ōsaka
Q4356088
district of the House of Representatives of Japan
山梨県第1区
Yamanashi 1st district
山梨縣第1區
première circonscription de la préfecture de Yamanashi
야마나시현 제1구
Q4696554
district of the House of Representatives of Japan
愛知県第5区
Aichi 5th district
愛知縣第5區
cinquième circonscription de la préfecture d'Aichi
아이치현 제5구
Q4696552
district of the House of Representatives of Japan
愛知県第6区
Aichi 6th district
愛知縣第6區
sixième circonscription de la préfecture d'Aichi
Q4778663
district of the House of Representatives of Japan
青森県第1区
Aomori 1st district
青森縣第1區
première circonscription de la préfecture d'Aomori
아오모리현 제1구
Q5095299
district of the House of Representatives of Japan
千葉県第4区
Chiba 4th district
千葉縣第4區
quatrième circonscription de la préfecture de Chiba
지바현 제4구
Q5095297
district of the House of Representatives of Japan
千葉県第1区 (中選挙区)
Chiba 1st district
千葉縣第1區 (中選舉區)
première circonscription de la préfecture de Chiba
1947
1993
Q5507680
district of the House of Representatives of Japan
福岡県第8区
Fukuoka 8th district
福岡縣第8區
huitième circonscription de la préfecture de Fukuoka
후쿠오카현 제8구
Q5507720
district of the House of Representatives of Japan
福島県第3区
Fukushima 3rd district
福島縣第3區
troisième circonscription de la préfecture de Fukushima
후쿠시마현 제3구

Statistics

Average successful run time: 1 minute

Total run time: about 16 hours

Total cpu time used: 32 minutes

Total disk space used: 112 KB

History

  • Auto ran revision 30df83a0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 30df83a0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 30df83a0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 30df83a0 and completed successfully .
    128 records updated in the database
  • Auto ran revision 30df83a0 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

japan-constituencies / scraper.rb