planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors

Last run completed successfully 2024-07-26.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Using bundler 1.15.2 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Installing ntlm-http 0.1.1 [1G Fetching sqlite3 1.3.13 [1G Installing webrobots 0.1.2 [1G Fetching net-http-persistent 3.0.1 [1G Installing sqlite3 1.3.13 with native extensions [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (12.90s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing S68/2024/80/1 - 51 Woodlands Way ORANGEVILLE, NSW Storing S68/2024/81/1 - 66 Brundah Road THIRLMERE, NSW Storing S68/2024/82/1 - 20 Silky Oak Place THIRLMERE, NSW Storing S68/2024/83/1 - 70 Kangaroo Road TAHMOOR, NSW Storing S68/2024/84/1 - 15 Banksia Place OAKDALE, NSW Storing S68/2024/85/1 - 269 Donalds Range Road RAZORBACK, NSW Storing S68/2024/86/1 - 5 Finns Road MENANGLE, NSW Storing S68/2024/87/1 - 105 Glendiver Road THE OAKS, NSW Storing S68/2024/88/1 - 5 Mulberry Street WILTON, NSW Storing S68/2024/90/1 - 9 Tickle Drive THIRLMERE, NSW Storing S68/2024/91/1 - 11 Kundabung Street BELIMBLA PARK, NSW Storing S68/2024/92/1 - 8 Attunga Close PICTON, NSW Storing S68/2024/93/1 - 210 Egans Road OAKDALE, NSW Storing S68/2024/94/1 - 80 Elvy Street BARGO, NSW Storing S68/2024/95/1 - 15 Eagle Creek Road THERESA PARK, NSW Storing S68/2024/96/1 - 17 Yanderra Road YANDERRA, NSW Storing S68/2024/97/1 - 220 Station Street THIRLMERE, NSW Storing S68/2024/98/1 - 103 Rockford Road TAHMOOR, NSW Storing DA/1993/282/2 - 536 West Parade BUXTON, NSW Storing DA/2019/234/2 - 373 Thirlmere Way THIRLMERE, NSW Storing DA/2019/334/2 - 102 Camden Road DOUGLAS PARK, NSW Storing DA/2020/226/2 - 35 Kent Road PICTON, NSW Storing DA/2020/668/3 - 290 Bargo Road BARGO, NSW Storing DA/2021/979/3 - 436 Argyle Street PICTON, NSW Storing DA/2022/1079/2 - 217 Menangle Street PICTON, NSW Storing DA/2023/13/3 - 20 Burgess Street WILTON, NSW Storing DA/2023/737/2 - 12 Walter Street THIRLMERE, NSW Storing DA/2023/1143/2 - 15 Banksia Place OAKDALE, NSW Storing DA/2023/1211/2 - 729 Montpelier Drive THE OAKS, NSW Storing DA/2024/54/2 - 115 Smalls Road BROWNLOW HILL, NSW Storing DA/2024/331/2 - 32 Macanene Street WILTON, NSW Storing DA/2024/374/2 - 32 Dulcimere Street TAHMOOR, NSW Storing DA/2024/469/1 - 55 Burrells Road MENANGLE, NSW Storing DA/2024/474/1 - 33 Alma Den Way TAHMOOR, NSW Storing DA/2024/481/1 - 29 Waterhouse Drive SILVERDALE, NSW Storing DA/2024/485/1 - 29 Waterhouse Drive SILVERDALE, NSW Storing DA/2024/491/1 - 10 Dharawal Avenue MENANGLE, NSW Storing DA/2024/492/1 - 16-18 Weir Road WARRAGAMBA, NSW Storing DA/2024/494/1 - 34 Marsh Road SILVERDALE, NSW Storing DA/2024/495/1 - 240 Montpelier Drive THE OAKS, NSW Storing DA/2024/497/1 - 174 Camden Road DOUGLAS PARK, NSW Storing DA/2024/498/1 - 50 Whipbird Road PHEASANTS NEST, NSW Storing DA/2024/500/1 - 64 Brundah Road THIRLMERE, NSW Storing DA/2024/501/1 - 226 Donalds Range Road RAZORBACK, NSW Storing DA/2024/502/1 - 10 Douglas Park Drive WILTON, NSW Storing DA/2024/503/1 - 6 Hoskin Street TAHMOOR, NSW Storing DA/2024/504/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/505/1 - 150 Rapleys Loop Road WEROMBI, NSW Storing DA/2024/506/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/508/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/509/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/510/1 - 47 Mallee Crescent TAHMOOR, NSW Storing DA/2024/512/1 - 680 Silverdale Road ORANGEVILLE, NSW Storing DA/2024/513/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/515/1 - 200 Stanhope Road THERESA PARK, NSW Storing DA/2024/516/1 - 105 Buxton Avenue BUXTON, NSW Storing DA/2024/517/1 - 39 Eastview Drive ORANGEVILLE, NSW Storing DA/2024/518/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/519/1 - 17 Sunset View Drive ORANGEVILLE, NSW Storing DA/2024/520/1 - 75 Johnston Road BARGO, NSW Storing DA/2024/521/1 - 66 Brundah Road THIRLMERE, NSW Storing DA/2024/522/1 - 51 Woodlands Way ORANGEVILLE, NSW Storing DA/2024/523/1 - 22B King Street APPIN, NSW Storing DA/2024/525/1 - 8 Karkanah Street WILTON, NSW Storing DA/2024/527/1 - 20 Silky Oak Place THIRLMERE, NSW Storing DA/2024/528/1 - 75 Bobs Range Road ORANGEVILLE, NSW Storing DA/2024/529/1 - 6 Sleepy Hollow Drive MENANGLE, NSW Storing DA/2024/530/1 - 36 Coyle Circuit OAKDALE, NSW Storing DA/2024/531/1 - 170 Russell Lane OAKDALE, NSW Storing DA/2024/534/1 - 8 Beeston Street MENANGLE, NSW Storing DA/2024/535/1 - 40 Henry Street PICTON, NSW Storing DA/2024/536/1 - 63 Burton Drive TAHMOOR, NSW Storing DA/2024/537/1 - 33 Galidan Avenue OAKDALE, NSW Storing DA/2024/538/1 - 5 Ridgehaven Road SILVERDALE, NSW Storing DA/2024/539/1 - 36 Kirkwood Chase WILTON, NSW Storing DA/2024/540/1 - 105 Glendiver Road THE OAKS, NSW Storing DA/2024/542/1 - 440 Cawdor Road CAWDOR, NSW Storing DA/2024/543/1 - 29 Cuttriss Crescent WILTON, NSW Storing DA/2024/544/1 - 26 Tickle Drive THIRLMERE, NSW Storing DA/2024/546/1 - 139 Brundah Road THIRLMERE, NSW Storing DA/2024/547/1 - 163-173 Remembrance Driveway TAHMOOR, NSW Storing DA/2024/548/1 - 10 Kennedy Street APPIN, NSW Storing DA/2024/549/1 - 309 Bobs Range Road ORANGEVILLE, NSW Storing DA/2024/552/1 - 110 Stonebrook Meadows Road RAZORBACK, NSW Storing DA/2024/553/1 - 25 Harvest Way WILTON, NSW Storing DA/2024/557/1 - 254 Taylors Road SILVERDALE, NSW Storing DA/2024/561/1 - 8 Hawthorne Road BARGO, NSW Storing DA/2024/566/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/567/1 - 13 Spearing Street WILTON, NSW Storing DA/2024/568/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/570/1 - 15 Eagle Creek Road THERESA PARK, NSW Storing DA/2024/571/1 - 31 Macanene Street WILTON, NSW Storing DA/2024/572/1 - 9 Barrington Road SILVERDALE, NSW Storing DA/2024/573/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/574/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/576/1 - 2 Na Daang Crescent MENANGLE, NSW Storing DA/2024/577/1 - 89 Nectarbrook Drive ORANGEVILLE, NSW Storing DA/2024/581/1 - 45 Halliday Road OAKDALE, NSW Storing DA/2024/582/1 - 7 Bly Street TAHMOOR, NSW Storing DA/2024/585/1 - 3 Beeston Street MENANGLE, NSW Storing CDC/2023/422/2 - 10 Walter Street THIRLMERE, NSW Storing CDC/2024/207/1 - 7 McGregor Street WILTON, NSW Storing CDC/2024/208/1 - 28 Tahmoor Road TAHMOOR, NSW Storing CDC/2024/216/1 - 10 Walter Street THIRLMERE, NSW Storing CDC/2024/220/1 - 46A Merlin Street THE OAKS, NSW Storing CDC/2024/222/1 - 58 Bullen Drive SILVERDALE, NSW Storing CDC/2024/227/1 - 25 Stringybark Drive WILTON, NSW Storing CDC/2024/231/1 - 18 Kelso Street WILTON, NSW Storing CDC/2024/238/1 - 17 Mulberry Street WILTON, NSW Storing CDC/2024/240/1 - 38 Reginald Circuit WILTON, NSW Storing CDC/2024/241/1 - 17 Gibney Street WILTON, NSW Storing CDC/2024/242/1 - 22 St Lukes Street WILTON, NSW

Data

Downloaded 2816 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.82 MB) Use the API

rows 10 / 5358

council_reference	address	description	info_url	date_scraped	date_received	on_notice_from	on_notice_to	lat	lng
DA/2015/605/2	21 Station Master Avenue THIRLMERE, NSW	Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area	https://tracking.wollondilly.nsw.gov.au/detail/010.2015.00000605.002	2020-07-29	2020-07-09			-34.2015815866067	150.57718975772
DA/2017/7/2	40 Burragorang Street THE OAKS, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2017.00000007.002	2020-07-29	2020-07-09	2020-07-15	2020-07-29	-34.0785271073153	150.566013656916
DA/2018/755/3	18 Torumba Circuit SILVERDALE, NSW	Modification - Modify condition 13 (1)	https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000755.003	2020-07-29	2020-07-10			-33.9125745023159	150.604898799426
DA/2019/597/3	85 Eagles Road RAZORBACK, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000597.003	2020-07-29	2020-07-06	2020-07-10	2020-07-24	-34.1315649588424	150.672930057128
DA/2019/658/2	2 Kalangara Road SILVERDALE, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000658.002	2020-07-29	2020-07-03			-33.911332578772	150.604277567584
DA/2020/170/2	120 Burrells Road MENANGLE, NSW	Modification - include temporary occupation	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000170.002	2020-07-29	2020-07-07			-34.1561082189654	150.691282209498
DA/2020/231/2	8 Hassall Road BUXTON, NSW	Modification - Design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000231.002	2020-07-29	2020-07-10			-34.2487649560524	150.540986009254
DA/2020/315/1	529 Old Razorback Road CAWDOR, NSW	Dwelling additions and s68 connect to existing	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000315.001	2020-07-29	2020-06-29			-34.1159615115923	150.668708408434
DA/2020/316/1	5 Camellia Court PICTON, NSW	Secondary dwelling & retaining walls	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000316.001	2020-07-29	2020-06-29			-34.1813143878095	150.614690808844
DA/2020/317/1	5 Dillies Lane TAHMOOR, NSW	Dwelling house	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000317.001	2020-07-29	2020-06-29			-34.2187083600634	150.604580262409

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 30 minutes

Total disk space used: 2.15 MB

History

Auto ran revision 95d5b551 and completed successfully 2024-07-26.

run time 40 s

112 records added, 107 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-07-25.

run time 52 s

114 records added, 110 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-07-24.

run time 16 s

114 records added, 109 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-07-23.

run time 44 s

109 records added, 94 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-07-22.

run time 44 s

94 records added, 90 records removed in the database
...
Created on morph.io 2020-07-29

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb

git clone URL