Gets development applications for City of Darebin.

Contributors henare mlandauer equivalentideas

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.1.6 -----> Installing dependencies using 1.7.12  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing httpclient 2.6.0.1  Installing mime-types 2.6.1  Installing net-http-digest_auth 1.4  Installing net-http-persistent 2.9.4  Installing mini_portile 0.6.2  Installing ntlm-http 0.1.1  Installing unf_ext 0.0.7.1  Using bundler 1.7.12  Installing webrobots 0.1.1  Installing unf 0.1.4  Installing domain_name 0.5.24  Installing http-cookie 1.0.2  Installing sqlite3 1.3.10  Installing sqlite_magic 0.0.5  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults)  Installing nokogiri 1.6.6.2  Installing mechanize 2.7.3  Your bundle is complete!  Gems in the groups development and test were not installed.  It was installed into ./vendor/bundle  Bundle completed (28.00s)  Cleaning up the bundler cache.  -----> Discovering process types  Procfile declares types -> scraper  Default process types for Ruby -> rake, console Injecting scraper and running... "Enquiry List" /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:158:in `rescue in rbuf_fill': too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 2 requests on 69960700719600, last used 121.079173711 seconds ago (Net::HTTP::Persistent::Error) from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:152:in `rbuf_fill' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:134:in `readuntil' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/protocol.rb:144:in `readline' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http/response.rb:39:in `read_status_line' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http/response.rb:28:in `read_new' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1414:in `block in transport_request' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1411:in `catch' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1411:in `transport_request' from /app/vendor/ruby-2.1.6/lib/ruby/2.1.0/net/http.rb:1384:in `request' from /app/vendor/bundle/ruby/2.1.0/gems/net-http-persistent-2.9.4/lib/net/http/persistent.rb:999:in `request' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:259:in `fetch' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:976:in `response_redirect' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:300:in `fetch' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize.rb:1281:in `post_form' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize.rb:548:in `submit' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/form.rb:223:in `submit' from /app/vendor/bundle/ruby/2.1.0/gems/mechanize-2.7.3/lib/mechanize/form.rb:229:in `click_button' from scraper.rb:16:in `<main>'

Statistics

Total run time: 13 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 28.4 KB

History

  • Manually ran revision da8346c2 and failed .
    nothing changed in the database
    4 pages scraped
  • Manually ran revision b01a959f and failed .
    nothing changed in the database
    4 pages scraped
  • Manually ran revision b01a959f and failed .
    nothing changed in the database
    4 pages scraped
  • Manually ran revision cf446f9c and failed .
    nothing changed in the database
    4 pages scraped
  • Created on morph.io

Scraper code

Ruby

darebin / scraper.rb