StashProperty / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer AndreM101

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.1 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.6  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Installing httpclient 2.8.3  Fetching mime-types-data 3.2019.0331  Installing unf_ext 0.0.7.6 with native extensions  Installing mime-types-data 3.2019.0331  Fetching net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Installing mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Installing net-http-digest_auth 1.4.1  Fetching webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing webrobots 0.1.2  Installing sqlite3 1.3.13 with native extensions  Fetching net-http-persistent 3.0.1  Installing net-http-persistent 3.0.1  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.3  Installing nokogiri 1.10.3 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (23.09s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Storing DA/1997/173/4 - 129 Silica Road YANDERRA, NSW Storing DA/2014/331/2 - 30 Bronzewing Street West TAHMOOR, NSW Storing DA/2016/168/2 - 6 Adelaide Place SILVERDALE, NSW Storing DA/2016/412/6 - 1 Cooper Drive OAKDALE, NSW Storing DA/2017/123/2 - 115 Stratford Road TAHMOOR, NSW Storing DA/2018/202/2 - 235 Braddocks Road WEROMBI, NSW Storing DA/2018/615/2 - 80 Quarry Road THE OAKS, NSW Storing DA/2019/537/2 - 90 Garlicks Range Road ORANGEVILLE, NSW Storing DA/2019/596/2 - 120 Glendiver Road THE OAKS, NSW Storing DA/2019/650/2 - 19 Wellers Road BARGO, NSW Storing DA/2020/132/2 - 38 The Acres Way TAHMOOR, NSW Storing DA/2020/475/3 - Marsh Road SILVERDALE, NSW Storing DA/2020/619/2 - 93 Avon Dam Road BARGO, NSW Storing DA/2020/804/2 - 180 Biffins Lane CAWDOR, NSW Storing DA/2021/87/2 - 111-117 Remembrance Driveway TAHMOOR, NSW Storing DA/2021/112/2 - 14 Cracknell Street WILTON, NSW Storing DA/2021/180/1 - 46 Roy Crescent THIRLMERE, NSW Storing DA/2021/181/1 - 20 Walmsley Crescent SILVERDALE, NSW Storing DA/2021/182/1 - 28 Douglas Park Drive WILTON, NSW Storing DA/2021/183/1 - 72 Rita Street THIRLMERE, NSW Storing DA/2021/184/1 - 141 Lyrebird Road PHEASANTS NEST, NSW Storing DA/2021/185/1 - 1440 Werombi Road WEROMBI, NSW Storing DA/2021/186/1 - 14 Galidan Avenue OAKDALE, NSW Storing DA/2021/187/1 - 50 Wanawong Street BELIMBLA PARK, NSW Storing DA/2021/188/1 - 13 Cooper Drive OAKDALE, NSW Storing DA/2021/189/1 - 235 Braddocks Road WEROMBI, NSW Storing DA/2021/190/1 - 4 Green Hills Drive SILVERDALE, NSW Storing DA/2021/191/1 - 25 Highland Crescent THIRLMERE, NSW Storing DA/2021/192/1 - 5 Wherritt Close PICTON, NSW Storing DA/2021/193/1 - 22 Tiger Street SILVERDALE, NSW Storing DA/2021/194/1 - 285 Finns Road MENANGLE, NSW Storing DA/2021/195/1 - 2590 Silverdale Road WALLACIA, NSW Storing DA/2021/196/1 - 3 Doneley Street WILTON, NSW Storing DA/2021/197/1 - 15 Eather Street WILTON, NSW Storing DA/2021/198/1 - 16 Tyrrell Place THE OAKS, NSW Storing DA/2021/199/1 - 80 Rockbarton Road OAKDALE, NSW Storing DA/2021/200/1 - 219 Donalds Range Road RAZORBACK, NSW Storing DA/2021/201/1 - 12 Elphin Street TAHMOOR, NSW Storing DA/2021/202/1 - 71 Ridgehaven Road SILVERDALE, NSW Storing DA/2021/203/1 - 390 Mount Hercules Road RAZORBACK, NSW Storing DA/2021/204/1 - 130 Terry Road THERESA PARK, NSW Storing DA/2021/205/1 - 5 Neal Place APPIN, NSW Storing DA/2021/206/1 - 26 The Acres Way TAHMOOR, NSW Storing DA/2021/207/1 - 28 Green Hills Drive SILVERDALE, NSW Storing DA/2021/208/1 - 49 Dutton Road BUXTON, NSW Storing DA/2021/209/1 - 2-20 Exeter Road BUXTON, NSW Storing DA/2021/210/1 - 4 Corry Street THIRLMERE, NSW Storing DA/2021/211/1 - 31 Tickle Drive THIRLMERE, NSW Storing DA/2021/212/1 - 21 Bullen Drive SILVERDALE, NSW Storing DA/2021/213/1 - 5 The Ironbarks PICTON, NSW Storing DA/2021/214/1 - 625 Pheasants Nest Road PHEASANTS NEST, NSW Storing DA/2021/215/1 - 24 Cooper Drive OAKDALE, NSW Storing DA/2021/216/1 - 46-48 Lumsdaine Street PICTON, NSW Storing DA/2021/217/1 - 29 Bell Street THIRLMERE, NSW Storing DA/2021/218/1 - 5 Perkins Street OAKDALE, NSW Storing DA/2021/219/1 - 10 Willis Street OAKDALE, NSW Storing DA/2021/220/1 - 89 Ingleton Circuit WILTON, NSW Storing DA/2021/221/1 - 1556 Burragorang Road OAKDALE, NSW Storing DA/2021/222/1 - 3 Grey Box Circuit TAHMOOR, NSW Storing DA/2021/223/1 - 5 Totterdell Place TAHMOOR, NSW Storing DA/2021/224/1 - 9 Gumtree Terrace TAHMOOR, NSW Storing DA/2021/225/1 - 13 Hackney Street WILTON, NSW Storing DA/2021/226/1 - 1572 Burragorang Road OAKDALE, NSW Storing DA/2021/227/1 - 10 Abbotsford Road PICTON, NSW Storing DA/2021/228/1 - 275 Argyle Street PICTON, NSW Storing DA/2021/229/1 - 15 Kurrajong Crescent TAHMOOR, NSW Storing DA/2021/230/1 - 11 Water Gum Place TAHMOOR, NSW Storing DA/2021/231/1 - 8 Cabrera Street THIRLMERE, NSW Storing DA/2021/232/1 - 24 Kennedy Street APPIN, NSW Storing DA/2021/233/1 - 22 Marion Street THIRLMERE, NSW Storing DA/2021/234/1 - 33 Dennis Street THIRLMERE, NSW Storing DA/2021/235/1 - 1 Poplar Place PICTON, NSW Storing DA/2021/236/1 - 62 River Road TAHMOOR, NSW Storing DA/2021/237/1 - 15 Meadowvale Road APPIN, NSW Storing DA/2021/238/1 - 91 Eastview Drive ORANGEVILLE, NSW Storing DA/2021/239/1 - 39 The Acres Way TAHMOOR, NSW Storing DA/2021/240/1 - 39 The Acres Way TAHMOOR, NSW Storing DA/2021/241/1 - 745 Barkers Lodge Road MOWBRAY PARK, NSW Storing DA/2021/242/1 - 3 Bradbury Street TAHMOOR, NSW Storing DA/2021/243/1 - 34 Eliza Place PICTON, NSW Storing DA/2021/244/1 - 70 Ironbark Road BARGO, NSW Storing DA/2021/245/1 - 12 Blue Gum Place TAHMOOR, NSW Storing DA/2021/246/1 - 73 Highland Crescent THIRLMERE, NSW Storing DA/2021/247/1 - 25 Constance Street THIRLMERE, NSW Storing DA/2021/248/1 - 57 Reservoir Road BARGO, NSW Storing DA/2021/249/1 - 55 Macquariedale Road APPIN, NSW Storing DA/2021/250/1 - 28 Green Hills Drive SILVERDALE, NSW Storing DA/2021/251/1 - 6 Vanderville Street THE OAKS, NSW Storing DA/2021/252/1 - 7 Summer House Rise TAHMOOR, NSW Storing DA/2021/253/1 - 241 Binalong Road BELIMBLA PARK, NSW Storing DA/2021/254/1 - 110 Mockingbird Road PHEASANTS NEST, NSW Storing DA/2021/255/1 - 2 Roy Crescent THIRLMERE, NSW Storing DA/2021/256/1 - 38 Ashby Close BARGO, NSW Storing DA/2021/257/1 - 8B Cambalan Street BARGO, NSW Storing DA/2021/258/1 - 2 Littlewood Road THE OAKS, NSW Storing DA/2021/259/1 - 250 Wilton Road WILTON, NSW Storing DA/2021/260/1 - 8 Hillier Close CAMDEN PARK, NSW Storing DA/2021/261/1 - 88 Elvy Street BARGO, NSW Storing DA/2021/262/1 - 88 Elvy Street BARGO, NSW Storing DA/2021/263/1 - 88 Elvy Street BARGO, NSW Storing DA/2021/264/1 - 4 Adelaide Place SILVERDALE, NSW Storing DA/2021/265/1 - 265 Silverdale Road ORANGEVILLE, NSW Storing DA/2021/266/1 - 248 Menangle Street PICTON, NSW Storing CDC/2021/118/1 - 29 Brundah Road THIRLMERE, NSW Storing CDC/2021/119/1 - 19 Leopard Street SILVERDALE, NSW Storing CDC/2021/120/1 - 5 Evans Street THIRLMERE, NSW Storing CDC/2021/121/1 - 63 Marsh Road SILVERDALE, NSW Storing CDC/2021/122/1 - 4 Safari Drive SILVERDALE, NSW Storing CDC/2021/123/1 - 5 Cracknell Street WILTON, NSW Storing CDC/2021/124/1 - 61 St Heliers Road SILVERDALE, NSW Storing CDC/2021/126/1 - 15 Tiger Street SILVERDALE, NSW Storing CDC/2021/127/1 - 28 Safari Drive SILVERDALE, NSW Storing CDC/2021/128/1 - 13 The Irons Drive WILTON, NSW Storing CDC/2021/129/1 - 30 Hackney Street WILTON, NSW Storing CDC/2021/131/1 - 1 Greenbridge Drive WILTON, NSW Storing CDC/2021/132/1 - 10 Tiger Street SILVERDALE, NSW Storing CDC/2021/133/1 - 6 Walmsley Crescent SILVERDALE, NSW Storing CDC/2021/134/1 - 17 Stafford Street SILVERDALE, NSW Storing CDC/2021/135/1 - 12 Green Hills Drive SILVERDALE, NSW Storing CDC/2021/136/1 - 59 Tiger Street SILVERDALE, NSW Storing CDC/2021/137/1 - 9 The Irons Drive WILTON, NSW Storing CDC/2021/138/1 - 24 Bullen Drive SILVERDALE, NSW Storing CDC/2021/139/1 - 10 Tiger Street SILVERDALE, NSW Storing CDC/2021/140/1 - 3 Corry Street THIRLMERE, NSW Storing CDC/2021/142/1 - 20 Grey Box Circuit TAHMOOR, NSW Storing CDC/2021/143/1 - 19 Clubhouse Road WILTON, NSW Storing CDC/2021/144/1 - 13 Baldi Drive SILVERDALE, NSW Storing CDC/2021/145/1 - 10 Corry Street THIRLMERE, NSW Storing CDC/2021/146/1 - 71 Marsh Road SILVERDALE, NSW Storing CDC/2021/147/1 - 17 Leopard Street SILVERDALE, NSW Storing CDC/2021/148/1 - 10 Armstrong Road APPIN, NSW Storing CDC/2021/149/1 - 48 Leopard Street SILVERDALE, NSW Storing CDC/2021/150/1 - 21 Gumara Street SILVERDALE, NSW Storing CDC/2021/151/1 - 4 Clubhouse Road WILTON, NSW Storing CDC/2021/152/1 - 51 Tiger Street SILVERDALE, NSW Storing CDC/2021/153/1 - 25A Park Avenue TAHMOOR, NSW Storing CDC/2021/154/1 - 3 Joyner Street THIRLMERE, NSW Storing CDC/2021/155/1 - 58 Dredge Avenue DOUGLAS PARK, NSW Storing CDC/2021/156/1 - 3 Belford Circuit TAHMOOR, NSW Storing CDC/2021/157/1 - 345 Arina Road BARGO, NSW Storing CDC/2021/158/1 - 8 Kilimanjaro Street SILVERDALE, NSW Storing CDC/2021/159/1 - 47 Bell Street THIRLMERE, NSW Storing CDC/2021/161/1 - 7 Morice Street APPIN, NSW Storing CDC/2021/163/1 - 56 Walmsley Crescent SILVERDALE, NSW Storing CDC/2021/164/1 - 2 The Acres Way TAHMOOR, NSW Storing CDC/2021/165/1 - 13 Tea Tree Place TAHMOOR, NSW

Data

Downloaded 4 times by dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (88 KB) Use the API

rows 10 / 272

council_reference address description info_url date_scraped date_received on_notice_from on_notice_to lat lng
DA/2021/90/1
119 Braddocks Road WEROMBI, NSW
Dwelling house and shed
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000090.001
2021-03-13
2021-02-11
2021-02-16
2021-02-23
-34.0124237973208
150.544820064762
DA/2021/91/1
119 Braddocks Road WEROMBI, NSW
S68 AWTS with surface spray irrigation
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000091.001
2021-03-13
2021-02-11
-34.0124237973208
150.544820064762
DA/2021/92/1
3 Mount Bethel Circuit ORANGEVILLE, NSW
Equestrian arena, associated earthworks and retaining works (including legitimise use of existing unauthorised works)
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000092.001
2021-03-13
2021-02-11
-34.0117128155565
150.62815668369
DA/2021/93/1
21 Moore Road OAKDALE, NSW
Secondary dwelling
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000093.001
2021-03-13
2021-02-11
2021-02-23
2021-03-09
-34.0772745524875
150.509846105654
DA/2021/94/1
8 Cecilia Place THIRLMERE, NSW
Dwelling house
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000094.001
2021-03-13
2021-02-11
-34.204377192893
150.58015298769
DA/2021/95/1
155 Lyrebird Road PHEASANTS NEST, NSW
Shed
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000095.001
2021-03-13
2021-02-11
2021-02-16
2021-02-23
-34.2336402001306
150.623829357986
CDC/2021/55/1
51B Kader Street BARGO, NSW
Dwelling House
https://tracking.wollondilly.nsw.gov.au/detail/018.2021.00000055.001
2021-03-13
2021-02-11
-34.2897148023669
150.574805997948
DA/2018/610/4
55 Bronzewing Street West TAHMOOR, NSW
Modification to DA/2018/610/1 proposing a minor lot boundary adjustment and conditions that nominates lots burdened by inter-allotment drainage and rectify the anomalies in relation to lot numbering
https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000610.004
2021-03-14
2021-02-12
-34.2246989419475
150.580484405743
DA/2021/96/1
140 Eltons Road SILVERDALE, NSW
Construction of an earth dam for use as a sediment basin
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000096.001
2021-03-14
2021-02-12
-33.9275401256705
150.608201223985
DA/2021/97/1
21 Chapman Street TAHMOOR, NSW
Proposed detached dual occupancy & two lot torrens title subdivision
https://tracking.wollondilly.nsw.gov.au/detail/010.2021.00000097.001
2021-03-14
2021-02-12
2021-02-16
2021-03-02
-34.2198040546689
150.58699880774

Statistics

Average successful run time: less than a minute

Total run time: 33 minutes

Total cpu time used: less than a minute

Total disk space used: 429 KB

History

  • Auto ran revision 784543d9 and completed successfully .
    146 records added, 142 records removed in the database
  • Auto ran revision 784543d9 and completed successfully .
    145 records added, 137 records removed in the database
  • Auto ran revision 784543d9 and completed successfully .
    137 records added, 130 records removed in the database
  • Auto ran revision 784543d9 and completed successfully .
    130 records added, 124 records removed in the database
  • Auto ran revision 784543d9 and completed successfully .
    138 records added, 135 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb