planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors

Last run completed successfully 2022-06-28.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Fetching mime-types-data 3.2019.0331 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Installing httpclient 2.8.3 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing mime-types-data 3.2019.0331 [1G Fetching mini_portile2 2.4.0 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching ntlm-http 0.1.1 [1G Installing mini_portile2 2.4.0 [1G Fetching webrobots 0.1.2 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Installing sqlite3 1.3.13 with native extensions [1G Installing ntlm-http 0.1.1 [1G Fetching net-http-persistent 3.0.1 [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (24.76s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing DA/1996/102/3 - 16 Myrtle Creek Avenue TAHMOOR, NSW Storing DA/2006/59068/2 - 131-133 Bobs Range Road ORANGEVILLE, NSW Storing DA/2014/331/3 - 30 Bronzewing Street TAHMOOR, NSW Storing DA/2019/40/2 - 34 Hassall Road BUXTON, NSW Storing DA/2019/365/3 - 80 Dietz Lane OAKDALE, NSW Storing DA/2020/192/2 - 69 Rita Street THIRLMERE, NSW Storing DA/2020/449/2 - 4 Eliza Place PICTON, NSW Storing DA/2020/480/2 - 12 Bulli Appin Road APPIN, NSW Storing DA/2021/711/2 - 1565 Werombi Road WEROMBI, NSW Storing DA/2021/1003/3 - 85 Eltons Road SILVERDALE, NSW Storing DA/2021/1073/2 - 2 Nestlebrae Street SILVERDALE, NSW Storing DA/2021/1173/2 - 7 Station Street MENANGLE, NSW Storing DA/2022/219/2 - 1565 Werombi Road WEROMBI, NSW Storing DA/2022/299/2 - 57 Ridgehaven Road SILVERDALE, NSW Storing DA/2022/422/1 - 390 Wilton Park Road WILTON, NSW Storing DA/2022/452/1 - 37 Fisher Street THE OAKS, NSW Storing DA/2022/461/1 - 9 Central Creamery Avenue MENANGLE, NSW Storing DA/2022/474/1 - 125 Yarran Road BARGO, NSW Storing DA/2022/476/1 - 46 Highland Crescent THIRLMERE, NSW Storing DA/2022/478/1 - 100 Eagles Road RAZORBACK, NSW Storing DA/2022/479/1 - 150 Braddocks Road WEROMBI, NSW Storing DA/2022/480/1 - 1 Central Creamery Avenue MENANGLE, NSW Storing DA/2022/482/1 - 50 Brundah Road THIRLMERE, NSW Storing DA/2022/483/1 - 13 Janice Drive TAHMOOR, NSW Storing DA/2022/484/1 - 140 News Road WEROMBI, NSW Storing DA/2022/485/1 - 31 Laurel Street MENANGLE, NSW Storing DA/2022/486/1 - 13 Stevens Road MENANGLE, NSW Storing DA/2022/487/1 - 20 Turunen Avenue SILVERDALE, NSW Storing DA/2022/488/1 - 125 Yarran Road BARGO, NSW Storing DA/2022/489/1 - 255 Werombi Road BROWNLOW HILL, NSW Storing DA/2022/490/1 - 120 Sunnyside Road THE OAKS, NSW Storing DA/2022/491/1 - 120 Sunnyside Road THE OAKS, NSW Storing DA/2022/492/1 - 20 Albert Kench Place BUXTON, NSW Storing DA/2022/493/1 - 75 Lakes Street THIRLMERE, NSW Storing DA/2022/494/1 - 46 Coevon Road BUXTON, NSW Storing DA/2022/495/1 - 50 Rotolactor Parade MENANGLE, NSW Storing DA/2022/496/1 - 2 Central Creamery Avenue MENANGLE, NSW Storing DA/2022/497/1 - 30 Ingleton Circuit WILTON, NSW Storing DA/2022/498/1 - 22 Thirlmere Way TAHMOOR, NSW Storing DA/2022/499/1 - 4 Coyle Circuit OAKDALE, NSW Storing DA/2022/500/1 - 43 Fraser Street TAHMOOR, NSW Storing DA/2022/501/1 - 20 Merlin Street THE OAKS, NSW Storing DA/2022/502/1 - 145 Condell Park Road WILTON, NSW Storing DA/2022/503/1 - 866 Montpelier Drive THE OAKS, NSW Storing DA/2022/504/1 - 11 Hawkins Road TAHMOOR, NSW Storing DA/2022/505/1 - 11 Hawkins Road TAHMOOR, NSW Storing DA/2022/506/1 - 1 The Acres Way TAHMOOR, NSW Storing DA/2022/507/1 - 166 Taylors Road SILVERDALE, NSW Storing DA/2022/508/1 - 195B Fairway Drive WILTON, NSW Storing DA/2022/509/1 - 12 Cumbria Street THIRLMERE, NSW Storing DA/2022/510/1 - 18 Laurel Street MENANGLE, NSW Storing DA/2022/511/1 - 675 Montpelier Drive THE OAKS, NSW Storing DA/2022/512/1 - 50 Lawson Road PHEASANTS NEST, NSW Storing DA/2022/513/1 - 50 Michell Road THIRLMERE, NSW Storing DA/2022/514/1 - 13 Yanderra Road YANDERRA, NSW Storing DA/2022/515/1 - 2 Laurel Street MENANGLE, NSW Storing DA/2022/516/1 - 21 Station Street MENANGLE, NSW Storing DA/2022/517/1 - 4 Noonamena Road TAHMOOR, NSW Storing DA/2022/519/1 - 1 Dunroman Lane BUXTON, NSW Storing DA/2022/520/1 - 25 Station Master Avenue THIRLMERE, NSW Storing DA/2022/521/1 - 403 Argyle Street PICTON, NSW Storing DA/2022/522/1 - 22 Albert Avenue THIRLMERE, NSW Storing DA/2022/523/1 - 71 Second Street WARRAGAMBA, NSW Storing DA/2022/524/1 - 145 Arina Road BARGO, NSW Storing DA/2022/525/1 - 145 Arina Road BARGO, NSW Storing DA/2022/526/1 - 1 Marsh Place THE OAKS, NSW Storing DA/2022/527/1 - 1 Marsh Place THE OAKS, NSW Storing DA/2022/528/1 - 3 Potters Drive TAHMOOR, NSW Storing DA/2022/529/1 - 74 Appin Road APPIN, NSW Storing DA/2022/530/1 - 44-50 Church Street APPIN, NSW Storing DA/2022/531/1 - 13 Yanderra Road YANDERRA, NSW Storing DA/2022/532/1 - 130 Dwyers Road PHEASANTS NEST, NSW Storing DA/2022/534/1 - 10 Gumtree Terrace TAHMOOR, NSW Storing DA/2022/535/1 - 59 Coyle Circuit OAKDALE, NSW Storing DA/2022/536/1 - 5 Timair Road THIRLMERE, NSW Storing DA/2022/537/1 - 15A Close Street THIRLMERE, NSW Storing DA/2022/538/1 - 19 King Street APPIN, NSW Storing DA/2022/539/1 - 7 Tamara Close OAKDALE, NSW Storing DA/2022/540/1 - 6 Manna Way SILVERDALE, NSW Storing DA/2022/541/1 - 1 The Acres Way TAHMOOR, NSW Storing DA/2022/542/1 - 18 Tiger Street SILVERDALE, NSW Storing DA/2022/543/1 - 190 Fergusson Road LAKESLAND, NSW Storing DA/2022/544/1 - 64 Kader Street BARGO, NSW Storing DA/2022/545/1 - 20 Fosters Lane MOUNT HUNTER, NSW Storing DA/2022/546/1 - 25 Manna Way SILVERDALE, NSW Storing DA/2022/547/1 - Marsh Road SILVERDALE, NSW Storing DA/2022/548/1 - Marsh Road SILVERDALE, NSW Storing DA/2022/549/1 - 35 Denmead Street THIRLMERE, NSW Storing DA/2022/550/1 - 50 Pineridge Crescent SILVERDALE, NSW Storing DA/2022/551/1 - 8 Agnes Place THIRLMERE, NSW Storing DA/2022/552/1 - 6 Laurel Street MENANGLE, NSW Storing DA/2022/553/1 - 65 Mulhollands Road PICTON, NSW Storing DA/2022/554/1 - 65 Mulhollands Road PICTON, NSW Storing DA/2022/555/1 - 71 Fairway Drive WILTON, NSW Storing DA/2022/556/1 - 3 Nectarbrook Drive ORANGEVILLE, NSW Storing DA/2022/557/1 - 42 St Heliers Road SILVERDALE, NSW Storing DA/2022/558/1 - Marsh Road SILVERDALE, NSW Storing DA/2022/559/1 - 30 Heritage Drive APPIN, NSW Storing DA/2022/560/1 - 120 Sunnyside Road THE OAKS, NSW Storing DA/2022/561/1 - 2 Stirling Drive WILTON, NSW Storing DA/2022/562/1 - 16 Obrien Street OAKDALE, NSW Storing DA/2022/563/1 - 90 Daley Close THE OAKS, NSW Storing DA/2022/564/1 - 5 Obrien Street OAKDALE, NSW Storing DA/2022/565/1 - 27 Dymond Street BARGO, NSW Storing DA/2022/566/1 - 80 Rita Street THIRLMERE, NSW Storing DA/2022/567/1 - 5 Betty Place THIRLMERE, NSW Storing DA/2022/568/1 - 79 Kundabung Street BELIMBLA PARK, NSW Storing DA/2022/569/1 - 6 Sanderson Street TAHMOOR, NSW Storing DA/2022/570/1 - 5 Sonja Place PICTON, NSW Storing DA/2022/571/1 - 3 Coveny Street SILVERDALE, NSW Storing DA/2022/572/1 - 120 Railside Avenue BARGO, NSW Storing DA/2022/573/1 - 35 Stirling Drive WILTON, NSW Storing DA/2022/574/1 - 24 Elvy Street BARGO, NSW Storing DA/2022/575/1 - 24 Elvy Street BARGO, NSW Storing DA/2022/576/1 - 30 Ingleton Circuit WILTON, NSW Storing DA/2022/578/1 - 48 St Heliers Road SILVERDALE, NSW Storing DA/2022/579/1 - 15 Ambervale Drive ORANGEVILLE, NSW Storing DA/2022/580/1 - 59 Coyle Circuit OAKDALE, NSW Storing DA/2022/581/1 - 14 Williamswood Road MOUNT HUNTER, NSW Storing DA/2022/582/1 - 2 Doyle Lane TAHMOOR, NSW Storing DA/2022/583/1 - 90 Caloola Road BARGO, NSW Storing DA/2022/584/1 - 40 Halliday Road OAKDALE, NSW Storing DA/2022/585/1 - 35 Jumbunna Place BUXTON, NSW Storing DA/2022/586/1 - 3 Sanderson Street TAHMOOR, NSW Storing DA/2022/587/1 - 82 Hornby Street WILTON, NSW Storing DA/2022/588/1 - 12 Angus Lane PICTON, NSW Storing DA/2022/589/1 - 50 Laurel Street MENANGLE, NSW Storing DA/2022/590/1 - 239 Bridge Street THIRLMERE, NSW Storing DA/2022/591/1 - 30 Lawson Road PHEASANTS NEST, NSW Storing DA/2022/592/1 - 190 Fergusson Road LAKESLAND, NSW Storing DA/2022/593/1 - 10 Attunga Close PICTON, NSW Storing DA/2022/594/1 - Lysaght Road APPIN, NSW Storing DA/2022/595/1 - 34 Laurel Street MENANGLE, NSW Storing DA/2022/596/1 - 350 Rapleys Loop Road WEROMBI, NSW Storing DA/2022/597/1 - 1161 Burragorang Road BELIMBLA PARK, NSW Storing DA/2022/598/1 - 270 Farnsworth Avenue WARRAGAMBA, NSW Storing DA/2022/599/1 - 436 Menangle Road MENANGLE, NSW Storing DA/2022/600/1 - 17 Dulcimere Street TAHMOOR, NSW Storing DA/2022/601/1 - 16 Nestlebrae Street SILVERDALE, NSW Storing DA/2022/602/1 - 12 Nestlebrae Street SILVERDALE, NSW Storing DA/2022/603/1 - 270 Farnsworth Avenue WARRAGAMBA, NSW Storing DA/2022/604/1 - 5 Dulcimere Street TAHMOOR, NSW Storing DA/2022/605/1 - 9 Woodside Place TAHMOOR, NSW Storing DA/2022/606/1 - 3 Rosedale Street TAHMOOR, NSW Storing DA/2022/607/1 - 7 Dean Close OAKDALE, NSW Storing DA/2022/608/1 - 10 Hudson Place BARGO, NSW Storing DA/2022/611/1 - 4 Rosedale Street TAHMOOR, NSW Storing DA/2022/612/1 - 1151 Burragorang Road BELIMBLA PARK, NSW Storing DA/2022/613/1 - 9 Station Street MENANGLE, NSW Storing DA/2022/614/1 - 9 Station Street MENANGLE, NSW Storing DA/2022/616/1 - 5 Woodside Place TAHMOOR, NSW Storing DA/2022/618/1 - 13 Obrien Street OAKDALE, NSW Storing DA/2022/619/1 - 134 Silverdale Road SILVERDALE, NSW Storing DA/2022/621/1 - 390 Mount Hercules Road RAZORBACK, NSW Storing DA/2022/626/1 - 22 Rotolactor Parade MENANGLE, NSW Storing CDC/2022/136/1 - 114 Brundah Road THIRLMERE, NSW Storing CDC/2022/138/1 - 116 Ridgehaven Road SILVERDALE, NSW Storing CDC/2022/141/1 - 7 Elmwood Way WILTON, NSW Storing CDC/2022/144/1 - 41 The Grange PICTON, NSW Storing CDC/2022/148/1 - 9 Ruwald Place CAMDEN PARK, NSW Storing CDC/2022/154/1 - 151 Mount Hercules Road RAZORBACK, NSW

Data

Downloaded 831 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (665 KB) Use the API

rows 10 / 1947

council_reference	address	description	info_url	date_scraped	date_received	on_notice_from	on_notice_to	lat	lng
DA/2015/605/2	21 Station Master Avenue THIRLMERE, NSW	Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area	https://tracking.wollondilly.nsw.gov.au/detail/010.2015.00000605.002	2020-07-29	2020-07-09			-34.2015815866067	150.57718975772
DA/2017/7/2	40 Burragorang Street THE OAKS, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2017.00000007.002	2020-07-29	2020-07-09	2020-07-15	2020-07-29	-34.0785271073153	150.566013656916
DA/2018/755/3	18 Torumba Circuit SILVERDALE, NSW	Modification - Modify condition 13 (1)	https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000755.003	2020-07-29	2020-07-10			-33.9125745023159	150.604898799426
DA/2019/597/3	85 Eagles Road RAZORBACK, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000597.003	2020-07-29	2020-07-06	2020-07-10	2020-07-24	-34.1315649588424	150.672930057128
DA/2019/658/2	2 Kalangara Road SILVERDALE, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000658.002	2020-07-29	2020-07-03			-33.911332578772	150.604277567584
DA/2020/170/2	120 Burrells Road MENANGLE, NSW	Modification - include temporary occupation	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000170.002	2020-07-29	2020-07-07			-34.1561082189654	150.691282209498
DA/2020/231/2	8 Hassall Road BUXTON, NSW	Modification - Design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000231.002	2020-07-29	2020-07-10			-34.2487649560524	150.540986009254
DA/2020/315/1	529 Old Razorback Road CAWDOR, NSW	Dwelling additions and s68 connect to existing	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000315.001	2020-07-29	2020-06-29			-34.1159615115923	150.668708408434
DA/2020/316/1	5 Camellia Court PICTON, NSW	Secondary dwelling & retaining walls	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000316.001	2020-07-29	2020-06-29			-34.1813143878095	150.614690808844
DA/2020/317/1	5 Dillies Lane TAHMOOR, NSW	Dwelling house	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000317.001	2020-07-29	2020-06-29			-34.2187083600634	150.604580262409

Statistics

Average successful run time: 2 minutes

Total run time: about 21 hours

Total cpu time used: 14 minutes

Total disk space used: 1010 KB

History

Auto ran revision 95d5b551 and completed successfully 2022-06-28.

run time 1 minute

161 records added, 159 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2022-06-27.

run time 7 s

159 records added, 155 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2022-06-26.

run time 1 minute

158 records added, 158 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2022-06-25.

run time 4 minutes

159 records added, 159 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2022-06-24.

run time 1 minute

163 records added, 151 records removed in the database
...
Created on morph.io 2020-07-29

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb

git clone URL