equivalentideas / darebin

Scrapes eservices.darebin.vic.gov.au

Contributors henare equivalentideas

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.1.6 [1G-----> Installing dependencies using 1.7.12 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Installing httpclient 2.6.0.1 [1G Installing mime-types 2.6.1 [1G Installing net-http-digest_auth 1.4 [1G Installing net-http-persistent 2.9.4 [1G Installing mini_portile 0.6.2 [1G Installing ntlm-http 0.1.1 [1G Installing unf_ext 0.0.7.1 [1G Using bundler 1.7.12 [1G Installing webrobots 0.1.1 [1G Installing unf 0.1.4 [1G Installing domain_name 0.5.24 [1G Installing http-cookie 1.0.2 [1G Installing sqlite3 1.3.10 [1G Installing sqlite_magic 0.0.5 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults) [1G Installing nokogiri 1.6.6.2 [1G Installing mechanize 2.7.3 [1G Your bundle is complete! [1G Gems in the groups development and test were not installed. [1G It was installed into ./vendor/bundle [1G Bundle completed (28.00s) [1G Cleaning up the bundler cache. [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper [1G Default process types for Ruby -> rake, console Injecting scraper and running... "Enquiry List" /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:158:in `rescue in rbuf_fill': too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 2 requests on 69960700719600, last used 121.079173711 seconds ago (Net::HTTP::Persistent::Error) from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:152:in `rbuf_fill' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:134:in `readuntil' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:144:in `readline' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http/response.rb:39:in `read_status_line' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http/response.rb:28:in `read_new' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1414:in `block in transport_request' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1411:in `catch' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1411:in `transport_request' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1384:in `request' from /app/vendor/bundle/ruby/2.1.0/gems/net-http-persistent-2.9.4/lib/net/http/persistent.rb:999:in `request' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:259:in `fetch' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:976:in `response_redirect' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:300:in `fetch' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize.rb:1281:in `post_form' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize.rb:548:in `submit' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/form.rb:223:in `submit' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/form.rb:229:in `click_button' from scraper.rb:16:in `<main>'

Statistics

Total run time: 13 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 27 KB

History

  • Manually ran revision da8346c2 and failed .
    nothing changed in the database
    4 pages scraped
  • Manually ran revision b01a959f and failed .
    nothing changed in the database
    4 pages scraped
  • Manually ran revision b01a959f and failed .
    nothing changed in the database
    4 pages scraped
  • Manually ran revision cf446f9c and failed .
    nothing changed in the database
    4 pages scraped
  • Created on morph.io

Scraper code

darebin