ianheggie-oaf / wollondilly

Wollondilly Shire Council Development Applications


Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy... /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:963:in `response_read': Content-Length (9782145) does not match response body length (7864320) (Mechanize::ResponseReadError) (Mechanize::ResponseReadError) from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:283:in `block in fetch' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1503:in `block in transport_request' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:165:in `reading_body' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1502:in `transport_request' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:951:in `block in request' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:648:in `connection_for' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:945:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:280:in `fetch' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:26:in `<main>'

Statistics

Total run time: about 3 hours

Total cpu time used: less than 10 seconds

Total disk space used: 329 KB

History

  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • Auto ran revision 95d5b551 and failed .
  • Manually ran revision 95d5b551 and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb