This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from  Fetching version metadata from  Fetching  Fetching  Fetching  Fetching  Fetching  Fetching rake 12.0.0  Fetching public_suffix 2.0.4  Fetching ast 2.3.0  Installing ast 2.3.0  Installing rake 12.0.0  Installing public_suffix 2.0.4  Using bundler 1.15.2  Fetching coderay 1.1.0  Installing coderay 1.1.0  Fetching safe_yaml 1.0.4  Installing safe_yaml 1.0.4  Fetching unf_ext  Fetching field_serializer 0.3.0  Fetching git 1.3.0  Installing field_serializer 0.3.0  Installing unf_ext with native extensions  Installing git 1.3.0  Fetching hashdiff 0.3.1  Installing hashdiff 0.3.1  Fetching httpclient  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing httpclient  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Fetching minitest 5.10.1  Installing mini_portile2 2.1.0  Installing minitest 5.10.1  Fetching vcr 3.0.3  Fetching netrc 0.11.0  Installing vcr 3.0.3  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching rainbow 2.1.0  Fetching require_all 1.4.0  Installing require_all 1.4.0  Installing rainbow 2.1.0  Fetching ruby-progressbar 1.8.1  Fetching unicode-display_width 1.1.2  Installing unicode-display_width 1.1.2  Installing ruby-progressbar 1.8.1  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Fetching parser  Installing parser  Fetching addressable 2.5.0  Installing addressable 2.5.0  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri  Installing nokogiri with native extensions  Fetching minispec-metadata 2.0.0  Installing minispec-metadata 2.0.0  Fetching minitest-around 0.4.0  Installing minitest-around 0.4.0  Fetching pry 0.10.1  Installing pry 0.10.1  Fetching rubocop 0.46.0  Installing rubocop 0.46.0  Fetching webmock 2.0.3  Installing webmock 2.0.3  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching minitest-vcr 1.4.0  Installing minitest-vcr 1.4.0  Fetching vcr-archive 0.3.0  Installing vcr-archive 0.3.0  Using scraper_test 0.1.0 from (at master@9b4326c)  Fetching domain_name 0.5.20161129  Installing domain_name 0.5.20161129  Using scraped_page_archive 0.5.0 from (at master@28f93d7)  Fetching sqlite_magic 0.0.3  Fetching http-cookie 1.0.3  Using scraped 0.3.0 from (at master@c2e9db2)  Using table_unspanner 0.1.0 from (at master@a70a98a)  Installing sqlite_magic 0.0.3  Installing http-cookie 1.0.3  Using scraperwiki 3.0.1 from (at morph_defaults@fc50176)  Fetching rest-client 2.0.0  Installing rest-client 2.0.0  Bundle complete! 16 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG:  Bundle completed (27.37s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect': Failed to open TCP connection to (getaddrinfo: Name or service not known) (SocketError) from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/timeout.rb:101:in `timeout' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:878:in `connect' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:863:in `do_start' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/net/http.rb:852:in `start' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:319:in `open_http' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:737:in `buffer_open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:212:in `block in open_loop' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:210:in `catch' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:210:in `open_loop' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri' from /app/vendor/bundle/ruby/2.3.0/gems/open-uri-cached-0.0.5/lib/open-uri/cached.rb:10:in `open_uri' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:35:in `open' from scraper.rb:20:in `noko_for' from scraper.rb:92:in `scrape_list' from scraper.rb:123:in `<main>'


Average successful run time: 4 minutes

Total run time: 2 days

Total cpu time used: 23 minutes

Total disk space used: 190 KB


  • Auto ran revision e4c78670 and failed .
    nothing changed in the database
  • Auto ran revision e4c78670 and failed .
    62 records removed in the database
  • Auto ran revision e4c78670 and failed .
    nothing changed in the database
  • Auto ran revision e4c78670 and failed .
    nothing changed in the database
  • Auto ran revision e4c78670 and completed successfully .
    nothing changed in the database
    63 pages scraped
  • ...
  • Created on

Show complete history

Scraper code


guyana-parliament / scraper.rb