planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors

Last run completed successfully 2020-08-13.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Fetching mime-types-data 3.2019.0331 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Installing mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Installing ntlm-http 0.1.1 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Fetching net-http-persistent 3.0.1 [1G Installing sqlite3 1.3.13 with native extensions [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (24.38s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Storing DA/2014/328/3 - 38 Williamswood Road MOUNT HUNTER, NSW Storing DA/2015/137/5 - 2710 Remembrance Driveway TAHMOOR, NSW Storing DA/2015/845/2 - 20 Macquarie Place TAHMOOR, NSW Storing DA/2016/484/2 - 15 Meryla Street COURIDJAH, NSW Storing DA/2016/750/2 - Greenbridge Drive WILTON, NSW Storing DA/2016/948/2 - 7 Adelaide Place SILVERDALE, NSW Storing DA/2017/32/2 - 11/180 Glendiver Road THE OAKS, NSW Storing DA/2017/138/3 - 125 News Road WEROMBI, NSW Storing DA/2017/259/2 - 80 River Road TAHMOOR, NSW Storing DA/2017/440/2 - 3 Nineteenth Street WARRAGAMBA, NSW Storing DA/2017/708/3 - 363 Thirlmere Way THIRLMERE, NSW Storing DA/2018/131/4 - 71 Eagle Creek Road WEROMBI, NSW Storing DA/2018/196/2 - 160 Cummins Road MENANGLE, NSW Storing DA/2018/339/3 - 990 Picton Road WILTON, NSW Storing DA/2018/576/2 - 21 Kurrajong Crescent TAHMOOR, NSW Storing DA/2019/414/2 - 195 Thirlmere Way THIRLMERE, NSW Storing DA/2019/434/2 - 40 Hayters Lane WEROMBI, NSW Storing DA/2019/507/2 - 95 Rita Street THIRLMERE, NSW Storing DA/2019/518/2 - 12 Gordon Street THIRLMERE, NSW Storing DA/2020/68/2 - 7 Lake Victoria Way SILVERDALE, NSW Storing DA/2020/69/2 - 9 Lake Victoria Way SILVERDALE, NSW Storing DA/2020/90/2 - 95 Oaks Road THIRLMERE, NSW Storing DA/2020/97/2 - 88 Castlereagh Street TAHMOOR, NSW Storing DA/2020/197/2 - 120 Wanawong Street BELIMBLA PARK, NSW Storing DA/2020/199/2 - 3110 Remembrance Driveway BARGO, NSW Storing DA/2020/200/2 - 12 The Acres Way TAHMOOR, NSW Storing DA/2020/303/2 - 495 Steveys Forest Road OAKDALE, NSW Storing DA/2020/310/2 - 1 Cracknell Street WILTON, NSW Storing DA/2020/357/1 - 46 The Acres Way TAHMOOR, NSW Storing DA/2020/358/1 - 39 Dutton Road BUXTON, NSW Storing DA/2020/359/1 - 44 Alexander Way MOUNT HUNTER, NSW Storing DA/2020/360/1 - 16 Railway Parade DOUGLAS PARK, NSW Storing DA/2020/361/1 - 20A Church Street APPIN, NSW Storing DA/2020/362/1 - 11 Cumbria Street THIRLMERE, NSW Storing DA/2020/363/1 - 20 Browns Road THE OAKS, NSW Storing DA/2020/364/1 - 10 Kent Road PICTON, NSW Storing DA/2020/365/1 - 17 Old Southern Road YANDERRA, NSW Storing DA/2020/366/1 - 124B Silverdale Road SILVERDALE, NSW Storing DA/2020/367/1 - 24 Green Hills Drive SILVERDALE, NSW Storing DA/2020/368/1 - 1 Evans Street THIRLMERE, NSW Storing DA/2020/369/1 - 85 The Irons Drive WILTON, NSW Storing DA/2020/370/1 - 1A Stuart Place TAHMOOR, NSW Storing DA/2020/371/1 - 547 Bents Basin Road WALLACIA, NSW Storing DA/2020/372/1 - 745 Montpelier Drive THE OAKS, NSW Storing DA/2020/373/1 - 180 Rockford Road TAHMOOR, NSW Storing DA/2020/374/1 - 13 Wild Street PICTON, NSW Storing DA/2020/375/1 - 111 Camden Road DOUGLAS PARK, NSW Storing DA/2020/376/1 - 115 Mount View Close RAZORBACK, NSW Storing DA/2020/377/1 - 16 Torulosa Road THE OAKS, NSW Storing DA/2020/378/1 - 8 Langmead Road SILVERDALE, NSW Storing DA/2020/379/1 - 1565 Werombi Road WEROMBI, NSW Storing DA/2020/380/1 - 1163 Burragorang Road BELIMBLA PARK, NSW Storing DA/2020/381/1 - 8 Cuneo Place THIRLMERE, NSW Storing DA/2020/382/1 - 465 Silverdale Road ORANGEVILLE, NSW Storing DA/2020/383/1 - 25 Picton Avenue PICTON, NSW Storing DA/2020/384/1 - 8 Cooper Drive OAKDALE, NSW Storing DA/2020/385/1 - 150 Rapleys Loop Road WEROMBI, NSW Storing DA/2020/386/1 - 2 Karen Place SILVERDALE, NSW Storing DA/2020/387/1 - 18 Cooper Drive OAKDALE, NSW Storing DA/2020/388/1 - 15 Plateau Drive RAZORBACK, NSW Storing DA/2020/389/1 - 490 Menangle Road MENANGLE, NSW Storing DA/2020/390/1 - 6 Young Avenue CAMDEN PARK, NSW Storing DA/2020/391/1 - 49 Kyeema Street PICTON, NSW Storing DA/2020/392/1 - 71 Silverdale Road SILVERDALE, NSW Storing DA/2020/393/1 - 195 Spring Creek Road MOUNT HUNTER, NSW Storing DA/2020/394/1 - 1980 Silverdale Road SILVERDALE, NSW Storing DA/2020/395/1 - 225 Binalong Road BELIMBLA PARK, NSW Storing DA/2020/396/1 - 221 News Road WEROMBI, NSW Storing DA/2020/397/1 - 250 Picton Road RAZORBACK, NSW Storing DA/2020/398/1 - 4 Gaudry Street THE OAKS, NSW Storing DA/2020/399/1 - 50 The Acres Way TAHMOOR, NSW Storing DA/2020/400/1 - 120 Wilton Road WILTON, NSW Storing DA/2020/401/1 - 1370 Moreton Park Road MENANGLE, NSW Storing DA/2020/402/1 - 8 Goodwin Street WILTON, NSW Storing DA/2020/403/1 - 107 Silverdale Road SILVERDALE, NSW Storing DA/2020/404/1 - 83 Fairway Drive WILTON, NSW Storing DA/2020/405/1 - 26 Cooper Drive OAKDALE, NSW Storing DA/2020/406/1 - 12 St James Place APPIN, NSW Storing DA/2020/407/1 - 1060 Barkers Lodge Road OAKDALE, NSW Storing DA/2020/408/1 - 62 The Acres Way TAHMOOR, NSW Storing DA/2020/409/1 - 26 Ashby Close BARGO, NSW Storing DA/2020/410/1 - 3 Spearing Street WILTON, NSW Storing DA/2020/411/1 - 50 Yarran Road BARGO, NSW Storing DA/2020/412/1 - 150 Ruddocks Road LAKESLAND, NSW Storing DA/2020/413/1 - 23 Tiger Street SILVERDALE, NSW Storing DA/2020/414/1 - 34 Kyeema Street PICTON, NSW Storing DA/2020/415/1 - 1161 Burragorang Road BELIMBLA PARK, NSW Storing DA/2020/416/1 - 9 Camellia Court PICTON, NSW Storing DA/2020/417/1 - 16 Perkins Street OAKDALE, NSW Storing DA/2020/418/1 - 14 Woodward Road WILTON, NSW Storing DA/2020/419/1 - 3 Friesian Way PICTON, NSW Storing DA/2020/420/1 - 17 Galidan Avenue OAKDALE, NSW Storing DA/2020/421/1 - 39 Third Street WARRAGAMBA, NSW Storing DA/2020/422/1 - 8 Cooper Drive OAKDALE, NSW Storing DA/2020/423/1 - 220 Hawthorne Road BARGO, NSW Storing DA/2020/424/1 - 2 Ingleton Circuit WILTON, NSW Storing DA/2020/425/1 - 106 Cummins Road MENANGLE, NSW Storing DA/2020/426/1 - 458 Argyle Street PICTON, NSW Storing DA/2020/427/1 - 77 Marsh Road SILVERDALE, NSW Storing DA/2020/428/1 - 45 Beverley Road BUXTON, NSW Storing DA/2020/429/1 - 50 Campsie Street WILTON, NSW Storing DA/2020/430/1 - 19 Kader Street BARGO, NSW Storing DA/2020/431/1 - 92 Heritage Drive APPIN, NSW Storing DA/2020/432/1 - 2 Panorama Street BARGO, NSW Storing DA/2020/433/1 - 42 Menangle Street PICTON, NSW Storing DA/2020/434/1 - 6 Ramsay Street PICTON, NSW Storing DA/2020/435/1 - 40 Pineridge Crescent SILVERDALE, NSW Storing DA/2020/436/1 - 15 Antill Street PICTON, NSW Storing DA/2020/437/1 - 218 Binalong Road BELIMBLA PARK, NSW Storing DA/2020/438/1 - 37 Claremont Drive BARGO, NSW Storing DA/2020/439/1 - 15 Cumbria Street THIRLMERE, NSW Storing DA/2020/440/1 - 19 Third Street WARRAGAMBA, NSW Storing DA/2020/441/1 - 2 King Street APPIN, NSW Storing DA/2020/442/1 - 35 Kyeema Street PICTON, NSW Storing DA/2020/443/1 - 12 Perkins Street OAKDALE, NSW Storing DA/2020/444/1 - 115 Rapleys Loop Road WEROMBI, NSW Storing DA/2020/445/1 - 26 Perkins Street OAKDALE, NSW Storing DA/2020/446/1 - 218 Binalong Road BELIMBLA PARK, NSW Storing DA/2020/447/1 - 941 Bulli Appin Road APPIN, NSW Storing DA/2020/448/1 - 57 Rita Street THIRLMERE, NSW Storing DA/2020/449/1 - 4 Eliza Place PICTON, NSW Storing DA/2020/450/1 - 13 Perkins Street OAKDALE, NSW Storing DA/2020/451/1 - 11 Cooper Drive OAKDALE, NSW Storing DA/2020/452/1 - 343 Bridge Street THIRLMERE, NSW Storing DA/2020/454/1 - 90 Mulhollands Road PICTON, NSW Storing CDC/2020/67/2 - 21 Constance Street THIRLMERE, NSW Storing CDC/2020/68/2 - 19 Constance Street THIRLMERE, NSW Storing CDC/2020/200/1 - 19 Cecilia Place THIRLMERE, NSW Storing CDC/2020/201/2 - 16 Roy Crescent THIRLMERE, NSW Storing CDC/2020/202/1 - 14 River Road TAHMOOR, NSW Storing CDC/2020/203/1 - 13 Roy Crescent THIRLMERE, NSW Storing CDC/2020/206/1 - 52 St Heliers Road SILVERDALE, NSW Storing CDC/2020/207/1 - 1 Torumba Circuit SILVERDALE, NSW Storing CDC/2020/208/1 - 26 Ingleton Circuit WILTON, NSW Storing CDC/2020/210/1 - 1 Water Gum Place TAHMOOR, NSW Storing CDC/2020/211/1 - 9 Tyrrell Place THE OAKS, NSW Storing CDC/2020/212/1 - 1 Alfred Place THIRLMERE, NSW Storing CDC/2020/213/1 - 33 Torulosa Road THE OAKS, NSW Storing CDC/2020/214/1 - 168 Taylors Road SILVERDALE, NSW Storing CDC/2020/215/1 - 114 Rita Street THIRLMERE, NSW Storing CDC/2020/217/1 - 2360 Remembrance Driveway PICTON, NSW Storing CDC/2020/218/1 - 13 Gumara Street SILVERDALE, NSW Storing CDC/2020/219/1 - 12 Roy Crescent THIRLMERE, NSW Storing CDC/2020/220/1 - 33 Fisher Street THE OAKS, NSW Storing CDC/2020/221/1 - 1 Roy Crescent THIRLMERE, NSW Storing CDC/2020/222/1 - 14 Roy Crescent THIRLMERE, NSW Storing CDC/2020/223/1 - 11-13 Harley Street YANDERRA, NSW Storing CDC/2020/224/1 - 6 Burragorang Street THE OAKS, NSW Storing CDC/2020/224/2 - 6 Burragorang Street THE OAKS, NSW Storing CDC/2020/225/1 - 19 Station Master Avenue THIRLMERE, NSW Storing CDC/2020/226/1 - 17 Stringybark Drive WILTON, NSW Storing CDC/2020/227/1 - 7 Taylor Street WILTON, NSW Storing CDC/2020/227/2 - 7 Taylor Street WILTON, NSW Storing CDC/2020/228/1 - 24 Ingleton Circuit WILTON, NSW Storing CDC/2020/229/1 - 42 Silverdale Road SILVERDALE, NSW Storing CDC/2020/230/1 - 58 Fairway Drive WILTON, NSW Storing CDC/2020/231/1 - 51 Roy Crescent THIRLMERE, NSW Storing CDC/2020/232/1 - 53 Roy Crescent THIRLMERE, NSW Storing CDC/2020/233/1 - 29 Tyson Road WILTON, NSW Storing CDC/2020/234/1 - 29 Heritage Drive APPIN, NSW Storing CDC/2020/235/1 - 11 Roy Crescent THIRLMERE, NSW Storing CDC/2020/236/1 - 290 Werombi Road BROWNLOW HILL, NSW Storing CDC/2020/237/1 - 24 Illawarra Street APPIN, NSW

Data

Downloaded 17 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (72 KB) Use the API

rows 10 / 232

council_reference	address	description	info_url	date_scraped	date_received	on_notice_from	on_notice_to	lat	lng
DA/2015/605/2	21 Station Master Avenue THIRLMERE, NSW	Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area	https://tracking.wollondilly.nsw.gov.au/detail/010.2015.00000605.002	2020-07-29	2020-07-09			-34.2015815866067	150.57718975772
DA/2017/7/2	40 Burragorang Street THE OAKS, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2017.00000007.002	2020-07-29	2020-07-09	2020-07-15	2020-07-29	-34.0785271073153	150.566013656916
DA/2018/755/3	18 Torumba Circuit SILVERDALE, NSW	Modification - Modify condition 13 (1)	https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000755.003	2020-07-29	2020-07-10			-33.9125745023159	150.604898799426
DA/2019/597/3	85 Eagles Road RAZORBACK, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000597.003	2020-07-29	2020-07-06	2020-07-10	2020-07-24	-34.1315649588424	150.672930057128
DA/2019/658/2	2 Kalangara Road SILVERDALE, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000658.002	2020-07-29	2020-07-03			-33.911332578772	150.604277567584
DA/2020/170/2	120 Burrells Road MENANGLE, NSW	Modification - include temporary occupation	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000170.002	2020-07-29	2020-07-07			-34.1561082189654	150.691282209498
DA/2020/231/2	8 Hassall Road BUXTON, NSW	Modification - Design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000231.002	2020-07-29	2020-07-10			-34.2487649560524	150.540986009254
DA/2020/315/1	529 Old Razorback Road CAWDOR, NSW	Dwelling additions and s68 connect to existing	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000315.001	2020-07-29	2020-06-29			-34.1159615115923	150.668708408434
DA/2020/316/1	5 Camellia Court PICTON, NSW	Secondary dwelling & retaining walls	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000316.001	2020-07-29	2020-06-29			-34.1813143878095	150.614690808844
DA/2020/317/1	5 Dillies Lane TAHMOOR, NSW	Dwelling house	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000317.001	2020-07-29	2020-06-29			-34.2187083600634	150.604580262409

Statistics

Average successful run time: less than a minute

Total run time: 2 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 412 KB

History

Manually ran revision 06a19fe9 and completed successfully 2020-08-13.

run time 56 s

163 records added, 74 records removed in the database
Manually ran revision 06a19fe9 and completed successfully 2020-07-29.

run time 57 s

143 records added in the database
Created on morph.io 2020-07-29

Scraper code

Ruby

wollondilly / scraper.rb

git clone URL