Contributors chrismytton

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.1 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing method_source 0.8.2  Installing coderay 1.1.1  Installing httpclient 2.8.2.4  Installing open-uri-cached 0.0.5  Installing slop 3.6.0  Installing sqlite3 1.3.12 with native extensions  Using bundler 1.11.2  Installing pry 0.10.4  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 3 Gemfile dependencies, 10 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (13.14s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=1 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=2 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=3 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=4 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=5 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=6 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=7 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=8 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=9 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=10 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=11 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=12 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=13 Scraping http://api.popong.com/v0.1/person/search?api_key=test&per_page=1000&page=14

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.13 MB) Use the API

rows 10 / 12913

wiki address_id name twitter gender image name_cn blog birthday facebook address name_en education homepage id education_id
[]
유홍
m
柳 弘
1853-01-01
Yu Hong
미기재
185311
[]
[]
지헌모
m
池憲模
1863-01-01
Ji Heon-mo
중졸
186311
[null,null]
[]
안기환
m
安琦煥
1872-01-01
Ahn Gi-hwan
漢修
187211
[]
[]
양경수
m
梁慶洙
1873-01-01
Yang Gyeong-su
미기재
187311
[]
[]
신숙
m
申肅
1873-01-01
Shin Sug
대동전졸
187312
[null,null]
[]
이승만
m
李承晩
1874-01-01
Lee Seung-man
미국와싱톤대학졸, 하바드대학졸
187411
[null,null,null,null]
[]
강원용
m
姜原容
1874-01-01
Kang Weon-yong
보전졸
187412
[null,null]
[]
최진
m
崔 鎭
1875-01-01
Choi Jin
미기재
187511
[]
[]
이규원
m
李圭元
1876-01-01
Lee Gyu-weon
한수(漢修)
187611
[]
[]
원용한
m
元容漢
1876-01-01
Weon Yong-han
187612
[]

Statistics

Average successful run time: 2 minutes

Total run time: about 1 hour

Total cpu time used: 6 minutes

Total disk space used: 2.16 MB

History

  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    134 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
  • Manually ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran and failed .
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran and failed .
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and failed .
    nothing changed in the database
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    28 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    nothing changed in the database
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Auto ran revision 5e14855a and completed successfully .
    12913 records added, 12913 records removed in the database
    14 pages scraped
  • Manually ran revision 5e14855a and completed successfully .
    12913 records added in the database
    14 pages scraped
  • Created on morph.io

Scraper code

Ruby

korea-popong-api / scraper.rb