ianheggie-oaf / wollondilly

Wollondilly Shire Council Development Applications


Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill': too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 49639288614880, last used 1748733504.3736784 seconds ago (Net::HTTP::Persistent::Error) from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:125:in `read' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:293:in `block in read_body_0' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:253:in `inflater' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:283:in `read_body_0' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:204:in `read_body' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:924:in `response_read' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:283:in `block in fetch' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1503:in `block in transport_request' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:165:in `reading_body' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1502:in `transport_request' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:951:in `block in request' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:648:in `connection_for' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:945:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:280:in `fetch' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:26:in `<main>'

Statistics

Total run time: about 12 hours

Total cpu time used: less than a minute

Total disk space used: 329 KB

History

  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb