everypolitician-scrapers / korean-assembly-members-wikidata

Scrapes ko.wikipedia.org, www.wikidata.org, raw.githubusercontent.com, and 1 other domain

위키백과, 우리 모두의 백과사전


Contributors tmtmtmtm chrismytton

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/...  Fetching dependency metadata from https://rubygems.org/..  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching https://github.com/everypolitician/wikisnakker  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Installing coderay 1.1.1  Installing colorize 0.8.1  Installing diskcached 1.1.2  Installing unf_ext 0.0.7.2 with native extensions  Installing excon 0.53.0  Installing multipart-post 2.0.0  Installing hashie 3.4.6  Installing httpclient 2.8.2.4  Installing json 2.0.2 with native extensions  Installing method_source 0.8.2  Installing mime-types-data 3.2016.0521  Installing mini_portile2 2.1.0  Installing netrc 0.11.0  Installing open-uri-cached 0.0.5  Installing slop 3.6.0  Installing require_all 1.3.3  Installing sqlite3 1.3.12 with native extensions  Using wikisnakker 0.7.0 from https://github.com/everypolitician/wikisnakker (at master@cc55a4f)  Using bundler 1.11.2  Installing unf 0.1.4  Installing faraday 0.9.2  Installing mime-types 3.1  Installing nokogiri 1.6.8.1 with native extensions  Installing pry 0.10.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Installing domain_name 0.5.20160826  Installing faraday_middleware 0.10.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.0  Installing mediawiki_api 0.7.0  Using wikidata-fetcher 0.18.2 from https://github.com/everypolitician/wikidata-fetcher.git (at master@cc464f2)  Bundle complete! 10 Gemfile dependencies, 34 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (33.44s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3045 for Q4934381 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1942 for Q138048 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2001 for Q138048 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3373 for Q138048 ‼ Q12611663 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q58765 is_instance_of literary work. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2987 for Q352840 ‼ Q12603065 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q22971797 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q12611526 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q12589211 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q23001013 is_instance_of Wikimedia list article. Skipping ‼ Q12613041 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q16181809 is_instance_of . Skipping ‼ Q16163428 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q12614767 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q16069002 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q24856317 is_instance_of . Skipping ‼ Q16067606 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q18140746 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q16070396 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q16067617 is_instance_of Wikimedia disambiguation page. Skipping ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P468 for Q484698 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2805 for Q484698

Data

Downloaded 58 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (214 KB) Use the API

rows 10 / 489

id name__ko name wikipedia__ko original_wikiname name__zh birth_date name__en gender occupation family_name name__ja wikipedia__en name__pt name__fr name__nl wikipedia__ja wikipedia__pt wikipedia__zh twitter name__en_ca name__en_gb name__es name__hu name__zh_hant name__zh_cn name__it image identifier__IMDB identifier__KMDb name__de given_name identifier__kinopoisk name__sv name__fa name__nb wikipedia__de wikipedia__es wikipedia__fa wikipedia__fr wikipedia__no wikipedia__sv identifier__freebase name__zh_hans name__zh_tw name__ca name__oc name__ru name__lt name__vi name__id name__mg name__ar name__th wikipedia__ar wikipedia__commons wikipedia__id wikipedia__it wikipedia__kowikiquote wikipedia__kowikisource wikipedia__lt wikipedia__mg wikipedia__ru wikipedia__ruwikinews wikipedia__th wikipedia__vi name__yue name__zh_hk name__zh_mo name__zh_my name__zh_sg name__kana identifier__VIAF identifier__LCAuth identifier__SUDOC website facebook name__eo wikipedia__eo wikipedia__simple identifier__NDL identifier__FAST death_date name__pl wikipedia__pl name__tr instagram name__ka name__he name__bg name__bn name__cs name__cy name__da name__de_ch name__fi name__lb name__lv name__ml name__mn name__ms name__my name__pt_br name__ro name__sco name__sh name__sr name__uk name__xmf name__yo name__nn name__la name__tl name__mr name__et name__az name__hr name__kk name__af name__fo name__io name__nan name__arz name__sgs name__hy name__el name__qu name__hak name__ne name__cdo name__ast name__sk name__wuu name__ie name__eu name__ga wikipedia__af wikipedia__arz wikipedia__ast wikipedia__az wikipedia__bat_smg wikipedia__bg wikipedia__bn wikipedia__ca wikipedia__cdo wikipedia__cs wikipedia__cy wikipedia__da wikipedia__el wikipedia__et wikipedia__fi wikipedia__fo wikipedia__ga wikipedia__hak wikipedia__he wikipedia__hu wikipedia__hy wikipedia__ie wikipedia__io wikipedia__ka wikipedia__kk wikipedia__la wikipedia__lb wikipedia__lv wikipedia__ml wikipedia__mn wikipedia__mr wikipedia__ms wikipedia__my wikipedia__ne wikipedia__nl wikipedia__nn wikipedia__plwikiquote wikipedia__qu wikipedia__ro wikipedia__sco wikipedia__sh wikipedia__sk wikipedia__sr wikipedia__tl wikipedia__tr wikipedia__uk wikipedia__wuu wikipedia__xmf wikipedia__yo wikipedia__zh_min_nan wikipedia__zh_yue wikipedia__zhwikiquote identifier__GND name__gl name__bcl wikipedia__bcl wikipedia__gl weblog wikipedia__oc identifier__CiNii identifier__google_knowledge identifier__ISNI wikipedia__bi name__bi identifier__nyt_topic wikipedia__cawikiquote
Q12611623
이상규
이상규
이상규 (1965년)
이상규 (1965년)
1965-01-07
Q4934381
김을동
김을동
김을동
김을동
1945-09-05
Kim Eul-dong
female
film actor
キム・ウルドン
Kim Eul-dong
Kim Eul-dong
Kim Eul-dong
Kim Eul-dong
キム・ウルドン
Kim Eul-dong
Kim Eul-dong
Kim Eul-dong
Kim Eul-dong
Kim Eul-dong
金乙東
金乙东
Kim Eul-dong
nm2071149
00004176
Kim Eul Dong
Kim Eul Dong
Q12583135
강창희
강창희
강창희 (1946년)
강창희 (1946년)
姜昌熙
1946-08-03
Kang Chang-hee
male
politician
Kang Chang-hee
Kang Chang-hee
Kang Chang-hee
姜昌熙
Kang Chang-hee
Кан Чханхи
Кан Чханхи
Kang Chan-hee
Q12588497
김재윤
김재윤
김재윤
김재윤
1965-05-24
Q12614768
장하나
장하나
장하나 (1977년)
장하나 (1977년)
1977-06-19
female
Q12586585
금태섭
금태섭
금태섭
금태섭
1967-09-29
gtaeboy
Q16079903
박찬우
박찬우
박찬우
박찬우
1959-04-15
Q12610412
윤재옥
윤재옥
윤재옥
윤재옥
Q12604547
신장용
신장용
신장용
신장용
1963-12-01
Q24000551
권칠승
권칠승
권칠승
권칠승

Statistics

Average successful run time: 1 minute

Total run time: about 1 hour

Total cpu time used: 3 minutes

Total disk space used: 255 KB

History

  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    32 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    nothing changed in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    nothing changed in the database
  • Auto ran revision 859b9466 and completed successfully .
    nothing changed in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
  • Auto ran and failed .
  • Auto ran revision 859b9466 and completed successfully .
    nothing changed in the database
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    489 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Auto ran revision 859b9466 and completed successfully .
    487 records updated in the database
    31 pages scraped
  • Manually ran revision 859b9466 and completed successfully .
    489 records updated in the database
  • Auto ran and failed .
  • Auto ran revision 859b9466 and completed successfully .
    488 records updated in the database
    31 pages scraped
  • Manually ran revision 859b9466 and completed successfully .
    489 records added in the database
    31 pages scraped
  • Created on morph.io