planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors

Last run completed successfully 2023-06-10.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching ntlm-http 0.1.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching webrobots 0.1.2 [1G Installing ntlm-http 0.1.1 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Fetching net-http-persistent 3.0.1 [1G Installing sqlite3 1.3.13 with native extensions [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (22.04s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing S68/2023/35/1 - 8 Timair Road THIRLMERE, NSW Storing S68/2023/38/1 - 20 Wombat Hollow Terrace TAHMOOR, NSW Storing S68/2023/39/1 - 124 Ridgehaven Road SILVERDALE, NSW Storing S68/2023/40/1 - 12 Sanctuary Drive TAHMOOR, NSW Storing S68/2023/42/1 - 20 Rockford Road TAHMOOR, NSW Storing S68/2023/43/1 - 794 Barkers Lodge Road MOWBRAY PARK, NSW Storing S68/2023/44/1 - 157 Donalds Range Road RAZORBACK, NSW Storing S68/2023/45/1 - 37 Wombat Hollow Terrace TAHMOOR, NSW Storing S68/2023/46/1 - 16 The Acres Way TAHMOOR, NSW Storing S68/2023/47/1 - 55 Estonian Road THIRLMERE, NSW Storing S68/2023/48/1 - 116 Brundah Road THIRLMERE, NSW Storing S68/2023/49/1 - 50 Brundah Road THIRLMERE, NSW Storing S68/2023/50/1 - 130 Buxton Avenue BUXTON, NSW Storing S68/2023/51/1 - 9 Meryla Street COURIDJAH, NSW Storing S68/2023/52/1 - 22 Sanctuary Drive TAHMOOR, NSW Storing S68/2023/53/1 - 153 Bobs Range Road ORANGEVILLE, NSW Storing S68/2023/54/1 - 69 Rita Street THIRLMERE, NSW Storing DA/2015/417/2 - Lysaght Road APPIN, NSW Storing DA/2018/108/2 - 8 Green Court WILTON, NSW Storing DA/2019/599/2 - 1160 Barkers Lodge Road OAKDALE, NSW Storing DA/2021/346/3 - Hume Highway PHEASANTS NEST, NSW Storing DA/2021/817/2 - 45 The Acres Way TAHMOOR, NSW Storing DA/2022/568/2 - 79 Kundabung Street BELIMBLA PARK, NSW Storing DA/2022/595/5 - 34 Laurel Street MENANGLE, NSW Storing DA/2022/747/2 - 1515 Barkers Lodge Road OAKDALE, NSW Storing DA/2022/884/2 - 3/1679 Remembrance Driveway PICTON, NSW Storing DA/2022/912/2 - 3 Struan Street TAHMOOR, NSW Storing DA/2022/922/2 - 17 Burgess Street WILTON, NSW Storing DA/2022/1126/2 - 140 Bobs Range Road ORANGEVILLE, NSW Storing DA/2022/1275/2 - 16 Florence Close BARGO, NSW Storing DA/2023/43/2 - 31 Eather Street WILTON, NSW Storing DA/2023/327/2 - 93 Cross Street TAHMOOR, NSW Storing DA/2023/400/1 - 21A Kerr Street APPIN, NSW Storing DA/2023/404/1 - 170 Bargo River Road TAHMOOR, NSW Storing DA/2023/408/1 - 22 Macanene Street WILTON, NSW Storing DA/2023/420/1 - 11 Tahmoor Road TAHMOOR, NSW Storing DA/2023/422/1 - 4 Coyle Circuit OAKDALE, NSW Storing DA/2023/423/1 - 44 Carlton Road THIRLMERE, NSW Storing DA/2023/424/1 - 6 Woodside Place TAHMOOR, NSW Storing DA/2023/426/1 - 3712 Remembrance Driveway BARGO, NSW Storing DA/2023/427/1 - 6 Allport Street WILTON, NSW Storing DA/2023/428/1 - 26 Cooper Drive OAKDALE, NSW Storing DA/2023/430/1 - 18 Greene Place THIRLMERE, NSW Storing DA/2023/432/1 - 35 Norma Close BARGO, NSW Storing DA/2023/433/1 - 18 Erith Road BUXTON, NSW Storing DA/2023/434/1 - 51 Highland Crescent THIRLMERE, NSW Storing DA/2023/435/1 - 7 Pear Tree Street WILTON, NSW Storing DA/2023/438/1 - 35 Ingleton Circuit WILTON, NSW Storing DA/2023/439/1 - 50 The Irons Drive WILTON, NSW Storing DA/2023/440/1 - 25 Stargard Crescent PICTON, NSW Storing DA/2023/441/1 - 5 Coveny Street SILVERDALE, NSW Storing DA/2023/442/1 - 90 Cross Street TAHMOOR, NSW Storing DA/2023/443/1 - 802 Thirlmere Way PICTON, NSW Storing DA/2023/445/1 - 21 The Grange PICTON, NSW Storing DA/2023/446/1 - 26 Collett Circuit APPIN, NSW Storing DA/2023/448/1 - 15 Pembroke Parade WILTON, NSW Storing DA/2023/449/1 - 8 Tarini Place TAHMOOR, NSW Storing DA/2023/450/1 - 36 Coyle Circuit OAKDALE, NSW Storing DA/2023/451/1 - 55 Estonian Road THIRLMERE, NSW Storing DA/2023/452/1 - 7 Jarrah Street TAHMOOR, NSW Storing DA/2023/453/1 - 5 Jarrah Street TAHMOOR, NSW Storing DA/2023/454/1 - 9 Jarrah Street TAHMOOR, NSW Storing DA/2023/455/1 - 30 Tickle Drive THIRLMERE, NSW Storing DA/2023/457/1 - 11 Jarrah Street TAHMOOR, NSW Storing DA/2023/458/1 - 59-61 Taylors Road SILVERDALE, NSW Storing DA/2023/459/1 - 23 Eucalyptus Grove BUXTON, NSW Storing DA/2023/460/1 - 40A West Parade BUXTON, NSW Storing DA/2023/461/1 - 40 Nolan Road OAKDALE, NSW Storing DA/2023/462/1 - 845 Silverdale Road WEROMBI, NSW Storing DA/2023/464/1 - 46 Burton Drive TAHMOOR, NSW Storing DA/2023/465/1 - 1 Teale Circuit TAHMOOR, NSW Storing DA/2023/466/1 - 10 Central Creamery Avenue MENANGLE, NSW Storing DA/2023/467/1 - 9 White Oak Street TAHMOOR, NSW Storing DA/2023/468/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/469/1 - 33 Scar Tree Crescent WILTON, NSW Storing DA/2023/470/1 - 35 Scar Tree Crescent WILTON, NSW Storing DA/2023/471/1 - 116 Brundah Road THIRLMERE, NSW Storing DA/2023/472/1 - 1 Lone Lea Street TAHMOOR, NSW Storing DA/2023/473/1 - 6 Ramsay Street PICTON, NSW Storing DA/2023/474/1 - 15 St James Place APPIN, NSW Storing DA/2023/475/1 - 12 Grey Box Circuit TAHMOOR, NSW Storing DA/2023/476/1 - 2 Adelaide Place SILVERDALE, NSW Storing DA/2023/477/1 - 1 Silverdale Road SILVERDALE, NSW Storing DA/2023/478/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/480/1 - 14 Seymour Road THE OAKS, NSW Storing DA/2023/481/1 - 69 Stringybark Drive WILTON, NSW Storing DA/2023/482/1 - 75 Michell Road THIRLMERE, NSW Storing DA/2023/483/1 - 12 Greene Place THIRLMERE, NSW Storing DA/2023/484/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/485/1 - 2 Rex Street WILTON, NSW Storing DA/2023/486/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/487/1 - 27 Oaks Street THIRLMERE, NSW Storing DA/2023/489/1 - 3 Nectarbrook Drive ORANGEVILLE, NSW Storing DA/2023/491/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/492/1 - 1 Koolahs Street APPIN, NSW Storing DA/2023/494/1 - 119 Westbrook Road CAWDOR, NSW Storing DA/2023/495/1 - 21 Thirlmere Way TAHMOOR, NSW Storing DA/2023/497/1 - 29 Butler Drive WILTON, NSW Storing DA/2023/498/1 - 12 Ritchie Road SILVERDALE, NSW Storing DA/2023/500/1 - 57 Burton Drive TAHMOOR, NSW Storing DA/2023/501/1 - 8 Attunga Close PICTON, NSW Storing DA/2023/502/1 - 19 Coachwood Crescent PICTON, NSW Storing DA/2023/503/1 - 35 Davisland Avenue WILTON, NSW Storing DA/2023/504/1 - 6 Pear Tree Street WILTON, NSW Storing DA/2023/506/1 - 75 Burton Drive TAHMOOR, NSW Storing DA/2023/507/1 - 32 Burton Drive TAHMOOR, NSW Storing DA/2023/508/1 - 94 Jenkins Street DOUGLAS PARK, NSW Storing DA/2023/509/1 - 22 Tickle Drive THIRLMERE, NSW Storing DA/2023/510/1 - 6 Jarrah Street TAHMOOR, NSW Storing DA/2023/511/1 - 325 Finns Road MENANGLE, NSW Storing DA/2023/512/1 - 995 Silverdale Road WEROMBI, NSW Storing DA/2023/517/1 - 14 Pear Tree Street WILTON, NSW Storing DA/2023/518/1 - 15 Hogans Drive BARGO, NSW Storing DA/2023/521/1 - 27 Oswald Street WILTON, NSW Storing DA/2023/522/1 - 190 Calf Farm Road MOUNT HUNTER, NSW Storing DA/2023/523/1 - 5 Mulberry Street WILTON, NSW Storing DA/2023/524/1 - 17 Scar Tree Crescent WILTON, NSW Storing CDC/2023/17/2 - 5 Grundy Close WILTON, NSW Storing CDC/2023/85/2 - 2 Carney Street WILTON, NSW Storing CDC/2023/181/1 - 17A Westbourne Avenue THIRLMERE, NSW Storing CDC/2023/183/1 - 7 Butler Drive WILTON, NSW Storing CDC/2023/199/1 - 24 Torulosa Road THE OAKS, NSW Storing CDC/2023/204/1 - 52 Macanene Street WILTON, NSW Storing CDC/2023/205/1 - 11 Frank Street THE OAKS, NSW Storing CDC/2023/206/1 - Hume Highway PHEASANTS NEST, NSW Storing CDC/2023/207/1 - 40 Moorland Road TAHMOOR, NSW Storing CDC/2023/210/1 - 10 Gumtree Terrace TAHMOOR, NSW Storing CDC/2023/211/1 - Hume Highway PHEASANTS NEST, NSW Storing CDC/2023/215/1 - 24 Bickleigh Avenue WILTON, NSW Storing CDC/2023/217/1 - 71 Silverdale Road SILVERDALE, NSW Storing CDC/2023/218/1 - 14 Bradninch Crescent WILTON, NSW Storing CDC/2023/219/1 - 15 Pear Tree Street WILTON, NSW Storing CDC/2023/221/1 - 19 Kurrajong Crescent TAHMOOR, NSW Storing CDC/2023/227/1 - 31 St Lukes Street WILTON, NSW Storing CDC/2023/228/1 - 2 Wild Flower Place TAHMOOR, NSW Storing CDC/2023/230/1 - 3 Bradninch Crescent WILTON, NSW Storing CDC/2023/233/1 - 5 Bradninch Crescent WILTON, NSW

Data

Downloaded 1418 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.21 MB) Use the API

rows 10 / 3578

council_reference	address	description	info_url	date_scraped	date_received	on_notice_from	on_notice_to	lat	lng
DA/2015/605/2	21 Station Master Avenue THIRLMERE, NSW	Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area	https://tracking.wollondilly.nsw.gov.au/detail/010.2015.00000605.002	2020-07-29	2020-07-09			-34.2015815866067	150.57718975772
DA/2017/7/2	40 Burragorang Street THE OAKS, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2017.00000007.002	2020-07-29	2020-07-09	2020-07-15	2020-07-29	-34.0785271073153	150.566013656916
DA/2018/755/3	18 Torumba Circuit SILVERDALE, NSW	Modification - Modify condition 13 (1)	https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000755.003	2020-07-29	2020-07-10			-33.9125745023159	150.604898799426
DA/2019/597/3	85 Eagles Road RAZORBACK, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000597.003	2020-07-29	2020-07-06	2020-07-10	2020-07-24	-34.1315649588424	150.672930057128
DA/2019/658/2	2 Kalangara Road SILVERDALE, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000658.002	2020-07-29	2020-07-03			-33.911332578772	150.604277567584
DA/2020/170/2	120 Burrells Road MENANGLE, NSW	Modification - include temporary occupation	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000170.002	2020-07-29	2020-07-07			-34.1561082189654	150.691282209498
DA/2020/231/2	8 Hassall Road BUXTON, NSW	Modification - Design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000231.002	2020-07-29	2020-07-10			-34.2487649560524	150.540986009254
DA/2020/315/1	529 Old Razorback Road CAWDOR, NSW	Dwelling additions and s68 connect to existing	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000315.001	2020-07-29	2020-06-29			-34.1159615115923	150.668708408434
DA/2020/316/1	5 Camellia Court PICTON, NSW	Secondary dwelling & retaining walls	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000316.001	2020-07-29	2020-06-29			-34.1813143878095	150.614690808844
DA/2020/317/1	5 Dillies Lane TAHMOOR, NSW	Dwelling house	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000317.001	2020-07-29	2020-06-29			-34.2187083600634	150.604580262409

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 23 minutes

Total disk space used: 1.54 MB

History

Auto ran revision 95d5b551 and completed successfully 2023-06-10.

run time 1 minute

137 records added, 137 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2023-06-09.

run time 9 s

144 records added, 143 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2023-06-08.

run time 1 minute

149 records added, 138 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2023-06-07.

run time 1 minute

147 records added, 141 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2023-06-06.

run time 1 minute

141 records added, 136 records removed in the database
...
Created on morph.io 2020-07-29

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb

git clone URL