planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize': execution expired (Net::OpenTimeout) from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:710:in `start' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:640:in `connection_for' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:945:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:280:in `fetch' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:26:in `<main>'

Data

Downloaded 3265 times by dcalde mlandauer openaustralia jesse-a-reilly repose-lecture muzzie86 BrendanFrameless Mosborne1290

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.07 MB) Use the API

rows 10 / 6069

council_reference address description info_url date_scraped date_received on_notice_from on_notice_to lat lng
DA/2015/605/2
21 Station Master Avenue THIRLMERE, NSW
Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area
https://tracking.wollondilly.nsw.gov.au/detail/010.2015.00000605.002
2020-07-29
2020-07-09
-34.2015815866067
150.57718975772
DA/2017/7/2
40 Burragorang Street THE OAKS, NSW
Modification - design changes
https://tracking.wollondilly.nsw.gov.au/detail/010.2017.00000007.002
2020-07-29
2020-07-09
2020-07-15
2020-07-29
-34.0785271073153
150.566013656916
DA/2018/755/3
18 Torumba Circuit SILVERDALE, NSW
Modification - Modify condition 13 (1)
https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000755.003
2020-07-29
2020-07-10
-33.9125745023159
150.604898799426
DA/2019/597/3
85 Eagles Road RAZORBACK, NSW
Modification - design changes
https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000597.003
2020-07-29
2020-07-06
2020-07-10
2020-07-24
-34.1315649588424
150.672930057128
DA/2019/658/2
2 Kalangara Road SILVERDALE, NSW
Modification - design changes
https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000658.002
2020-07-29
2020-07-03
-33.911332578772
150.604277567584
DA/2020/170/2
120 Burrells Road MENANGLE, NSW
Modification - include temporary occupation
https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000170.002
2020-07-29
2020-07-07
-34.1561082189654
150.691282209498
DA/2020/231/2
8 Hassall Road BUXTON, NSW
Modification - Design changes
https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000231.002
2020-07-29
2020-07-10
-34.2487649560524
150.540986009254
DA/2020/315/1
529 Old Razorback Road CAWDOR, NSW
Dwelling additions and s68 connect to existing
https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000315.001
2020-07-29
2020-06-29
-34.1159615115923
150.668708408434
DA/2020/316/1
5 Camellia Court PICTON, NSW
Secondary dwelling & retaining walls
https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000316.001
2020-07-29
2020-06-29
-34.1813143878095
150.614690808844
DA/2020/317/1
5 Dillies Lane TAHMOOR, NSW
Dwelling house
https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000317.001
2020-07-29
2020-06-29
-34.2187083600634
150.604580262409

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 34 minutes

Total disk space used: 2.4 MB

History

  • Auto ran revision 95d5b551 and failed .
    nothing changed in the database
  • Auto ran revision 95d5b551 and failed .
    nothing changed in the database
  • Auto ran revision 95d5b551 and failed .
    nothing changed in the database
  • Auto ran revision 95d5b551 and failed .
    nothing changed in the database
  • Auto ran revision 95d5b551 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb