planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications


Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Installing ntlm-http 0.1.1 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Fetching net-http-persistent 3.0.1 [1G Installing sqlite3 1.3.13 with native extensions [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (12.36s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing S68/2024/5/1 - 76 Safari Drive SILVERDALE, NSW Storing S68/2024/6/1 - 80 Elvy Street BARGO, NSW Storing S68/2024/7/1 - 45 Richardson Street THIRLMERE, NSW Storing S68/2024/8/1 - 729 Montpelier Drive THE OAKS, NSW Storing S68/2024/10/1 - 11 Wombat Hollow Terrace TAHMOOR, NSW Storing S68/2024/11/1 - 11 Wombat Hollow Terrace TAHMOOR, NSW Storing S68/2024/12/1 - 295 Garlicks Range Road ORANGEVILLE, NSW Storing S68/2024/13/1 - 40 Mount Bethel Circuit ORANGEVILLE, NSW Storing S68/2024/14/1 - Regreme Road PICTON, NSW Storing S68/2024/16/1 - 50 Durham Street DOUGLAS PARK, NSW Storing DA/2015/834/2 - 205 Picton Road PICTON, NSW Storing DA/2019/440/3 - 23 Baldi Drive SILVERDALE, NSW Storing DA/2020/215/3 - 1365 Menangle Road RAZORBACK, NSW Storing DA/2021/339/2 - 26 Arden Road BUXTON, NSW Storing DA/2022/304/2 - 25 The Ironbarks PICTON, NSW Storing DA/2022/343/2 - 17 Taylors Road SILVERDALE, NSW Storing DA/2022/1216/2 - 10 O'Brien Street OAKDALE, NSW Storing DA/2023/663/2 - 17 Scar Tree Crescent WILTON, NSW Storing DA/2023/706/2 - 295 Garlicks Range Road ORANGEVILLE, NSW Storing DA/2023/1000/2 - 5 Burton Drive TAHMOOR, NSW Storing DA/2023/1024/2 - 26 Burton Drive TAHMOOR, NSW Storing DA/2023/1056/2 - 7 Burton Drive TAHMOOR, NSW Storing DA/2023/1124/2 - 14 Burton Drive TAHMOOR, NSW Storing DA/2023/1173/2 - 38 Burton Drive TAHMOOR, NSW Storing DA/2023/1174/2 - 36 Burton Drive TAHMOOR, NSW Storing DA/2024/2/1 - 3 Bly Street TAHMOOR, NSW Storing DA/2024/17/1 - 24 Vicary Lane ORANGEVILLE, NSW Storing DA/2024/19/1 - 335 Macquariedale Road APPIN, NSW Storing DA/2024/22/1 - 20-22 Remembrance Driveway TAHMOOR, NSW Storing DA/2024/24/1 - 130 Rotherwood Road RAZORBACK, NSW Storing DA/2024/32/1 - 43 Third Street WARRAGAMBA, NSW Storing DA/2024/33/1 - 400 McKee Road THERESA PARK, NSW Storing DA/2024/34/1 - 28 Moore Road OAKDALE, NSW Storing DA/2024/38/1 - 20 Oxenbridge Avenue WILTON, NSW Storing DA/2024/39/1 - 18 Butler Drive WILTON, NSW Storing DA/2024/40/1 - 76 Greenacre Drive TAHMOOR, NSW Storing DA/2024/41/1 - 21 Silky Oak Place THIRLMERE, NSW Storing DA/2024/42/1 - 74 Ingleton Circuit WILTON, NSW Storing DA/2024/43/1 - 70 Greenacre Drive TAHMOOR, NSW Storing DA/2024/44/1 - 25 Serengeti Circuit SILVERDALE, NSW Storing DA/2024/46/1 - 7 Dunk Place CAMDEN PARK, NSW Storing DA/2024/48/1 - 26 Hordern Street WILTON, NSW Storing DA/2024/49/1 - 42 Resthaven Way SILVERDALE, NSW Storing DA/2024/50/1 - 80 Elvy Street BARGO, NSW Storing DA/2024/51/1 - 8 Summer House Rise TAHMOOR, NSW Storing DA/2024/52/1 - 9 Mallee Crescent TAHMOOR, NSW Storing DA/2024/53/1 - 65 Finns Road MENANGLE, NSW Storing DA/2024/54/1 - 115 Smalls Road BROWNLOW HILL, NSW Storing DA/2024/55/1 - 77 Hawkey Road MENANGLE, NSW Storing DA/2024/56/1 - 459 Argyle Street PICTON, NSW Storing DA/2024/60/1 - 310 Argyle Street PICTON, NSW Storing DA/2024/62/1 - 25-27 Burton Drive TAHMOOR, NSW Storing DA/2024/63/1 - 53-55 East Parade BUXTON, NSW Storing DA/2024/64/1 - 13 Reginald Circuit WILTON, NSW Storing DA/2024/65/1 - 15 Reginald Circuit WILTON, NSW Storing DA/2024/66/1 - 17 Reginald Circuit WILTON, NSW Storing DA/2024/67/1 - 8 Gibney Street WILTON, NSW Storing DA/2024/68/1 - 23 Archies Crossing Way MENANGLE, NSW Storing DA/2024/69/1 - 79 Cuttriss Crescent WILTON, NSW Storing DA/2024/70/1 - 27 Station Street MENANGLE, NSW Storing DA/2024/71/1 - 11 Laurel Street MENANGLE, NSW Storing DA/2024/72/1 - 11 Wombat Hollow Terrace TAHMOOR, NSW Storing DA/2024/73/1 - 3 Monamieth Street TAHMOOR, NSW Storing DA/2024/74/1 - 2 Hoskin Street TAHMOOR, NSW Storing DA/2024/75/1 - 25 Reginald Circuit WILTON, NSW Storing DA/2024/77/1 - 29 Reginald Circuit WILTON, NSW Storing DA/2024/79/1 - 9 Camden Street WILTON, NSW Storing DA/2024/80/1 - 10 Na Daang Crescent MENANGLE, NSW Storing DA/2024/82/1 - 30 Laurel Street MENANGLE, NSW Storing DA/2024/85/1 - 6 Vanderville Street THE OAKS, NSW Storing DA/2024/86/1 - 26 Station Street MENANGLE, NSW Storing DA/2024/87/1 - 34 Gibson Street SILVERDALE, NSW Storing DA/2024/89/1 - 9 Myrtle Creek Avenue TAHMOOR, NSW Storing DA/2024/90/1 - 87 Hawthorne Road BARGO, NSW Storing DA/2024/91/1 - 140 Fallons Road WEROMBI, NSW Storing DA/2024/92/1 - 27 Fitzroy Street WILTON, NSW Storing DA/2024/93/1 - 32 Butler Drive WILTON, NSW Storing DA/2024/94/1 - 26 Butler Drive WILTON, NSW Storing DA/2024/95/1 - 14 Butler Drive WILTON, NSW Storing DA/2024/96/1 - 12 Gibney Street WILTON, NSW Storing DA/2024/97/1 - 6 Gibney Street WILTON, NSW Storing DA/2024/98/1 - 4 Gibney Street WILTON, NSW Storing DA/2024/99/1 - 10 Gibney Street WILTON, NSW Storing DA/2024/100/1 - 54 Greenacre Drive TAHMOOR, NSW Storing DA/2024/101/1 - 52 Greenacre Drive TAHMOOR, NSW Storing DA/2024/102/1 - 24 Dulcimere Street TAHMOOR, NSW Storing DA/2024/103/1 - 10 Crawford Creek Place RAZORBACK, NSW Storing DA/2024/105/1 - 13 McLeay Road WEROMBI, NSW Storing DA/2024/106/1 - 10 Cecilia Place THIRLMERE, NSW Storing DA/2024/107/1 - 44 Alexander Way MOUNT HUNTER, NSW Storing DA/2024/109/1 - 151 Bobs Range Road ORANGEVILLE, NSW Storing DA/2024/111/1 - 15 McLellan Street WILTON, NSW Storing DA/2024/112/1 - 100 Hornby Street WILTON, NSW Storing DA/2024/113/1 - 24 St Lukes Street WILTON, NSW Storing DA/2024/115/1 - 13 Kalangara Road SILVERDALE, NSW Storing DA/2024/116/1 - 11 Winton Street APPIN, NSW Storing DA/2024/118/1 - 21 Durham Street DOUGLAS PARK, NSW Storing DA/2024/120/1 - 50 Durham Street DOUGLAS PARK, NSW Storing DA/2024/121/1 - 6 Tsavo Street SILVERDALE, NSW Storing DA/2024/122/1 - 15 Dharawal Avenue MENANGLE, NSW Storing DA/2024/124/1 - 16 Burton Drive TAHMOOR, NSW Storing DA/2024/125/1 - 1775 Barkers Lodge Road OAKDALE, NSW Storing DA/2024/126/1 - 62 Greenacre Drive TAHMOOR, NSW Storing DA/2024/127/1 - 120 Great Southern Road BARGO, NSW Storing DA/2024/128/1 - 33 St Lukes Street WILTON, NSW Storing DA/2024/136/1 - 15 Hogans Drive BARGO, NSW Storing DA/2024/139/1 - 150 Donalds Range Road RAZORBACK, NSW Storing CDC/2023/299/2 - 12E Remembrance Driveway TAHMOOR, NSW Storing CDC/2023/579/2 - 25 Frew Street WILTON, NSW Storing CDC/2024/32/1 - 20 Westbourne Avenue THIRLMERE, NSW Storing CDC/2024/39/1 - 6 Bickleigh Avenue WILTON, NSW Storing CDC/2024/41/1 - 58 Argyle Street PICTON, NSW Storing CDC/2024/43/1 - 56 Argyle Street PICTON, NSW Storing CDC/2024/44/1 - 23 Cuttriss Crescent WILTON, NSW Storing CDC/2024/46/1 - 2/68 Railside Avenue BARGO, NSW Storing CDC/2024/47/1 - 30 Macanene Street WILTON, NSW Storing CDC/2024/50/1 - 2 Myrtle Creek Avenue TAHMOOR, NSW

Data

Downloaded 2483 times by dcalde openaustralia mlandauer jesse-a-reilly muzzie86 BrendanFrameless

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.6 MB) Use the API

rows 10 / 4727

council_reference address description info_url date_scraped date_received on_notice_from on_notice_to lat lng
DA/2015/605/2
21 Station Master Avenue THIRLMERE, NSW
Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area
2020-07-29
2020-07-09
-34.2015815866067
150.57718975772
DA/2017/7/2
40 Burragorang Street THE OAKS, NSW
Modification - design changes
2020-07-29
2020-07-09
2020-07-15
2020-07-29
-34.0785271073153
150.566013656916
DA/2018/755/3
18 Torumba Circuit SILVERDALE, NSW
Modification - Modify condition 13 (1)
2020-07-29
2020-07-10
-33.9125745023159
150.604898799426
DA/2019/597/3
85 Eagles Road RAZORBACK, NSW
Modification - design changes
2020-07-29
2020-07-06
2020-07-10
2020-07-24
-34.1315649588424
150.672930057128
DA/2019/658/2
2 Kalangara Road SILVERDALE, NSW
Modification - design changes
2020-07-29
2020-07-03
-33.911332578772
150.604277567584
DA/2020/170/2
120 Burrells Road MENANGLE, NSW
Modification - include temporary occupation
2020-07-29
2020-07-07
-34.1561082189654
150.691282209498
DA/2020/231/2
8 Hassall Road BUXTON, NSW
Modification - Design changes
2020-07-29
2020-07-10
-34.2487649560524
150.540986009254
DA/2020/315/1
529 Old Razorback Road CAWDOR, NSW
Dwelling additions and s68 connect to existing
2020-07-29
2020-06-29
-34.1159615115923
150.668708408434
DA/2020/316/1
5 Camellia Court PICTON, NSW
Secondary dwelling & retaining walls
2020-07-29
2020-06-29
-34.1813143878095
150.614690808844
DA/2020/317/1
5 Dillies Lane TAHMOOR, NSW
Dwelling house
2020-07-29
2020-06-29
-34.2187083600634
150.604580262409

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 27 minutes

Total disk space used: 1.93 MB

History

  • Auto ran revision 95d5b551 and completed successfully .
    117 records added, 117 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    124 records added, 115 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    115 records added, 102 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    104 records added, 97 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    101 records added, 90 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb