Contributors tmtmtmtm ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.13.7  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.13.7) is older than the version that created the lockfile (1.14.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/table_unspanner.git  Installing ast 2.3.0  Installing rake 12.0.0  Installing public_suffix 2.0.4  Installing coderay 1.1.0  Installing safe_yaml 1.0.4  Installing unf_ext 0.0.7.2 with native extensions  Installing git 1.3.0  Installing field_serializer 0.3.0  Installing hashdiff 0.3.1  Installing method_source 0.8.2  Installing httpclient 2.6.0.1  Installing mime-types-data 3.2016.0521  Installing mini_portile2 2.1.0  Installing minitest 5.10.1  Installing vcr 3.0.3  Installing netrc 0.11.0  Installing open-uri-cached 0.0.5  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing require_all 1.3.3  Installing unicode-display_width 1.2.1  Installing ruby-progressbar 1.8.1  Installing sqlite3 1.3.10 with native extensions  Using bundler 1.13.7  Installing parser 2.4.0.0  Installing rainbow 2.2.2 with native extensions  Installing addressable 2.5.0  Installing crack 0.4.3  Installing mime-types 3.1  Installing nokogiri 1.7.0.1 with native extensions  Installing minispec-metadata 2.0.0  Installing minitest-around 0.4.0  Installing pry 0.10.1  Installing unf 0.1.4  Installing webmock 2.0.3  Installing sqlite_magic 0.0.3  Installing minitest-vcr 1.4.0  Installing domain_name 0.5.20161129  Installing vcr-archive 0.3.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing rubocop 0.48.1  Installing http-cookie 1.0.3  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7)  Using scraped 0.2.0 from https://github.com/everypolitician/scraped.git (at master@c3fc06e)  Using table_unspanner 0.1.0 from https://github.com/everypolitician/table_unspanner.git (at master@a70a98a)  Installing rest-client 2.0.0  Bundle complete! 15 Gemfile dependencies, 46 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (28.55s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.13.7) is older than the version that created the lockfile (1.14.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting http://www.parliament.gh/parliamentarians /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:359:in `open_http': 404 Not Found (OpenURI::HTTPError) from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:737:in `buffer_open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:212:in `block in open_loop' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:210:in `catch' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:210:in `open_loop' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `block in open_uri' from /app/vendor/bundle/ruby/2.3.0/gems/vcr-3.0.3/lib/vcr/util/variable_args_block_caller.rb:9:in `call_block' from /app/vendor/bundle/ruby/2.3.0/gems/vcr-3.0.3/lib/vcr.rb:189:in `use_cassette' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive.rb:36:in `record' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `open_uri' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:35:in `open' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request/strategy/live_request.rb:10:in `response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:28:in `block in first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `first' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:29:in `first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c3fc06e1c44b/lib/scraped/request.rb:12:in `response' from scraper.rb:97:in `scrape_list' from scraper.rb:112:in `<main>'

Data

Downloaded 903 times by everypolitician ondenman attigs paullenz Created4

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (74 KB) Use the API

rows 0 / 0

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (74 KB) Use the API

rows 1 / 1

id name source start_date
6
Sixth Parliament of the Fourth Republic
2013-01-07

Statistics

Average successful run time: about 3 hours

Total run time: 6 days

Total cpu time used: 3 days

Total disk space used: 32.6 MB

History

  • Auto ran revision 0a6a926a and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    170 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    289 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    74 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b890e5a2 and failed .
    273 records removed in the database
    3 pages scraped
  • Auto ran and failed .
  • Auto ran revision b890e5a2 and completed successfully .
    233 records added, 1 record removed in the database
    1462 pages scraped
  • Auto ran revision b890e5a2 and failed .
    1 record added, 233 records removed in the database
    202 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and failed .
    nothing changed in the database
  • Auto ran revision b890e5a2 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision b890e5a2 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision b890e5a2 and completed successfully .
    252 records added, 5 records removed in the database
    1462 pages scraped
  • Auto ran revision b890e5a2 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision b890e5a2 and failed .
    26 records added, 275 records removed in the database
    119 pages scraped
  • Auto ran revision 95c8c928 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 95c8c928 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 95c8c928 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 95c8c928 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Manually ran revision 95c8c928 and completed successfully .
    273 records added, 273 records removed in the database
  • Auto ran revision 9de158ec and failed .
    nothing changed in the database
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1463 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
  • Auto ran revision 729921b1 and failed .
    nothing changed in the database
  • Auto ran revision 729921b1 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Auto ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
    1462 pages scraped
  • Manually ran revision 729921b1 and completed successfully .
    273 records added, 273 records removed in the database
  • Manually ran and failed .
  • Manually ran and failed .
  • Auto ran and failed .
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and failed .
    nothing changed in the database
    8 pages scraped
  • Auto ran revision ccf2dc80 and failed .
    141 records added, 141 records removed in the database
    738 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1463 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    226 records added, 226 records removed in the database
    1211 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
  • Manually ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
  • Auto ran revision ccf2dc80 and failed .
    nothing changed in the database
  • Auto ran revision ccf2dc80 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    nothing changed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    102 records added, 102 records removed in the database
  • Auto ran revision ccf2dc80 and failed .
    nothing changed in the database
  • Manually ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1461 pages scraped
  • Auto ran revision ccf2dc80 and failed .
    197 records added, 197 records removed in the database
    1048 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1462 pages scraped
  • Auto ran revision ccf2dc80 and failed .
    175 records added, 175 records removed in the database
    931 pages scraped
  • Auto ran revision ccf2dc80 and completed successfully .
    274 records added, 274 records removed in the database
    1460 pages scraped
  • Manually ran revision ccf2dc80 and completed successfully .
    274 records added, 271 records removed in the database
    1462 pages scraped
  • Manually ran revision 843e2017 and completed successfully .
    273 records added in the database
    364 pages scraped
  • Created on morph.io

Scraper code

Ruby

ghana-parliament / scraper.rb