planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications


Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching ntlm-http 0.1.1 [1G Installing mime-types-data 3.2019.0331 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Installing webrobots 0.1.2 [1G Installing sqlite3 1.3.13 with native extensions [1G Fetching net-http-persistent 3.0.1 [1G Installing net-http-persistent 3.0.1 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (13.00s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing S68/2024/75/1 - 25 Glenanne Place THIRLMERE, NSW Storing S68/2024/76/1 - 19 Trentham Avenue DOUGLAS PARK, NSW Storing S68/2024/78/1 - 64 Brundah Road THIRLMERE, NSW Storing S68/2024/79/1 - 5 Bradninch Crescent WILTON, NSW Storing S68/2024/80/1 - 51 Woodlands Way ORANGEVILLE, NSW Storing S68/2024/81/1 - 66 Brundah Road THIRLMERE, NSW Storing S68/2024/82/1 - 20 Silky Oak Place THIRLMERE, NSW Storing S68/2024/83/1 - 70 Kangaroo Road TAHMOOR, NSW Storing S68/2024/84/1 - 15 Banksia Place OAKDALE, NSW Storing S68/2024/85/1 - 269 Donalds Range Road RAZORBACK, NSW Storing S68/2024/86/1 - 5 Finns Road MENANGLE, NSW Storing S68/2024/87/1 - 105 Glendiver Road THE OAKS, NSW Storing S68/2024/88/1 - 5 Mulberry Street WILTON, NSW Storing S68/2024/90/1 - 9 Tickle Drive THIRLMERE, NSW Storing S68/2024/91/1 - 11 Kundabung Street BELIMBLA PARK, NSW Storing S68/2024/92/1 - 8 Attunga Close PICTON, NSW Storing S68/2024/94/1 - 80 Elvy Street BARGO, NSW Storing DA/1993/282/2 - 536 West Parade BUXTON, NSW Storing DA/2019/334/2 - 102 Camden Road DOUGLAS PARK, NSW Storing DA/2020/226/2 - 35 Kent Road PICTON, NSW Storing DA/2020/668/3 - 290 Bargo Road BARGO, NSW Storing DA/2022/1079/2 - 217 Menangle Street PICTON, NSW Storing DA/2023/13/3 - 20 Burgess Street WILTON, NSW Storing DA/2023/737/2 - 12 Walter Street THIRLMERE, NSW Storing DA/2023/1143/2 - 15 Banksia Place OAKDALE, NSW Storing DA/2023/1211/2 - 729 Montpelier Drive THE OAKS, NSW Storing DA/2024/54/2 - 115 Smalls Road BROWNLOW HILL, NSW Storing DA/2024/374/2 - 32 Dulcimere Street TAHMOOR, NSW Storing DA/2024/469/1 - 55 Burrells Road MENANGLE, NSW Storing DA/2024/474/1 - 33 Alma Den Way TAHMOOR, NSW Storing DA/2024/485/1 - 29 Waterhouse Drive SILVERDALE, NSW Storing DA/2024/489/1 - 7 Wombat Hollow Terrace TAHMOOR, NSW Storing DA/2024/491/1 - 10 Dharawal Avenue MENANGLE, NSW Storing DA/2024/492/1 - 16-18 Weir Road WARRAGAMBA, NSW Storing DA/2024/494/1 - 34 Marsh Road SILVERDALE, NSW Storing DA/2024/495/1 - 240 Montpelier Drive THE OAKS, NSW Storing DA/2024/496/1 - 70 Jarvis Street THIRLMERE, NSW Storing DA/2024/497/1 - 174 Camden Road DOUGLAS PARK, NSW Storing DA/2024/498/1 - 50 Whipbird Road PHEASANTS NEST, NSW Storing DA/2024/500/1 - 64 Brundah Road THIRLMERE, NSW Storing DA/2024/501/1 - 226 Donalds Range Road RAZORBACK, NSW Storing DA/2024/502/1 - 10 Douglas Park Drive WILTON, NSW Storing DA/2024/503/1 - 6 Hoskin Street TAHMOOR, NSW Storing DA/2024/504/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/505/1 - 150 Rapleys Loop Road WEROMBI, NSW Storing DA/2024/506/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/507/1 - 5 Silven Park Way SILVERDALE, NSW Storing DA/2024/508/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/509/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/510/1 - 47 Mallee Crescent TAHMOOR, NSW Storing DA/2024/512/1 - 680 Silverdale Road ORANGEVILLE, NSW Storing DA/2024/513/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/515/1 - 200 Stanhope Road THERESA PARK, NSW Storing DA/2024/516/1 - 105 Buxton Avenue BUXTON, NSW Storing DA/2024/517/1 - 39 Eastview Drive ORANGEVILLE, NSW Storing DA/2024/518/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/519/1 - 17 Sunset View Drive ORANGEVILLE, NSW Storing DA/2024/520/1 - 75 Johnston Road BARGO, NSW Storing DA/2024/521/1 - 66 Brundah Road THIRLMERE, NSW Storing DA/2024/522/1 - 51 Woodlands Way ORANGEVILLE, NSW Storing DA/2024/523/1 - 22B King Street APPIN, NSW Storing DA/2024/525/1 - 8 Karkanah Street WILTON, NSW Storing DA/2024/527/1 - 20 Silky Oak Place THIRLMERE, NSW Storing DA/2024/528/1 - 75 Bobs Range Road ORANGEVILLE, NSW Storing DA/2024/529/1 - 6 Sleepy Hollow Drive MENANGLE, NSW Storing DA/2024/530/1 - 36 Coyle Circuit OAKDALE, NSW Storing DA/2024/531/1 - 170 Russell Lane OAKDALE, NSW Storing DA/2024/534/1 - 8 Beeston Street MENANGLE, NSW Storing DA/2024/535/1 - 40 Henry Street PICTON, NSW Storing DA/2024/536/1 - 63 Burton Drive TAHMOOR, NSW Storing DA/2024/537/1 - 33 Galidan Avenue OAKDALE, NSW Storing DA/2024/538/1 - 5 Ridgehaven Road SILVERDALE, NSW Storing DA/2024/539/1 - 36 Kirkwood Chase WILTON, NSW Storing DA/2024/540/1 - 105 Glendiver Road THE OAKS, NSW Storing DA/2024/543/1 - 29 Cuttriss Crescent WILTON, NSW Storing DA/2024/544/1 - 26 Tickle Drive THIRLMERE, NSW Storing DA/2024/548/1 - 10 Kennedy Street APPIN, NSW Storing DA/2024/552/1 - 110 Stonebrook Meadows Road RAZORBACK, NSW Storing DA/2024/553/1 - 25 Harvest Way WILTON, NSW Storing DA/2024/557/1 - 254 Taylors Road SILVERDALE, NSW Storing DA/2024/568/1 - Bullen Drive SILVERDALE, NSW Storing DA/2024/572/1 - 9 Barrington Road SILVERDALE, NSW Storing DA/2024/576/1 - 2 Na Daang Crescent MENANGLE, NSW Storing CDC/2023/422/2 - 10 Walter Street THIRLMERE, NSW Storing CDC/2024/195/1 - 845 Mount Hercules Road RAZORBACK, NSW Storing CDC/2024/196/1 - 1060 Barkers Lodge Road OAKDALE, NSW Storing CDC/2024/207/1 - 7 McGregor Street WILTON, NSW Storing CDC/2024/208/1 - 28 Tahmoor Road TAHMOOR, NSW Storing CDC/2024/216/1 - 10 Walter Street THIRLMERE, NSW Storing CDC/2024/220/1 - 46A Merlin Street THE OAKS, NSW Storing CDC/2024/222/1 - 58 Bullen Drive SILVERDALE, NSW Storing CDC/2024/227/1 - 25 Stringybark Drive WILTON, NSW Storing CDC/2024/229/1 - 10 Byrne Street APPIN, NSW Storing CDC/2024/231/1 - 18 Kelso Street WILTON, NSW

Data

Downloaded 2808 times by dcalde openaustralia mlandauer jesse-a-reilly muzzie86 BrendanFrameless

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.81 MB) Use the API

rows 10 / 5329

council_reference address description info_url date_scraped date_received on_notice_from on_notice_to lat lng
DA/2015/605/2
21 Station Master Avenue THIRLMERE, NSW
Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area
2020-07-29
2020-07-09
-34.2015815866067
150.57718975772
DA/2017/7/2
40 Burragorang Street THE OAKS, NSW
Modification - design changes
2020-07-29
2020-07-09
2020-07-15
2020-07-29
-34.0785271073153
150.566013656916
DA/2018/755/3
18 Torumba Circuit SILVERDALE, NSW
Modification - Modify condition 13 (1)
2020-07-29
2020-07-10
-33.9125745023159
150.604898799426
DA/2019/597/3
85 Eagles Road RAZORBACK, NSW
Modification - design changes
2020-07-29
2020-07-06
2020-07-10
2020-07-24
-34.1315649588424
150.672930057128
DA/2019/658/2
2 Kalangara Road SILVERDALE, NSW
Modification - design changes
2020-07-29
2020-07-03
-33.911332578772
150.604277567584
DA/2020/170/2
120 Burrells Road MENANGLE, NSW
Modification - include temporary occupation
2020-07-29
2020-07-07
-34.1561082189654
150.691282209498
DA/2020/231/2
8 Hassall Road BUXTON, NSW
Modification - Design changes
2020-07-29
2020-07-10
-34.2487649560524
150.540986009254
DA/2020/315/1
529 Old Razorback Road CAWDOR, NSW
Dwelling additions and s68 connect to existing
2020-07-29
2020-06-29
-34.1159615115923
150.668708408434
DA/2020/316/1
5 Camellia Court PICTON, NSW
Secondary dwelling & retaining walls
2020-07-29
2020-06-29
-34.1813143878095
150.614690808844
DA/2020/317/1
5 Dillies Lane TAHMOOR, NSW
Dwelling house
2020-07-29
2020-06-29
-34.2187083600634
150.604580262409

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 30 minutes

Total disk space used: 2.14 MB

History

  • Auto ran revision 95d5b551 and completed successfully .
    94 records added, 90 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    107 records added, 107 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    116 records added, 116 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    119 records added, 115 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    121 records added, 115 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb