planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications


Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching ntlm-http 0.1.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching webrobots 0.1.2 [1G Installing ntlm-http 0.1.1 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Fetching net-http-persistent 3.0.1 [1G Installing sqlite3 1.3.13 with native extensions [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (22.04s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing S68/2023/35/1 - 8 Timair Road THIRLMERE, NSW Storing S68/2023/38/1 - 20 Wombat Hollow Terrace TAHMOOR, NSW Storing S68/2023/39/1 - 124 Ridgehaven Road SILVERDALE, NSW Storing S68/2023/40/1 - 12 Sanctuary Drive TAHMOOR, NSW Storing S68/2023/42/1 - 20 Rockford Road TAHMOOR, NSW Storing S68/2023/43/1 - 794 Barkers Lodge Road MOWBRAY PARK, NSW Storing S68/2023/44/1 - 157 Donalds Range Road RAZORBACK, NSW Storing S68/2023/45/1 - 37 Wombat Hollow Terrace TAHMOOR, NSW Storing S68/2023/46/1 - 16 The Acres Way TAHMOOR, NSW Storing S68/2023/47/1 - 55 Estonian Road THIRLMERE, NSW Storing S68/2023/48/1 - 116 Brundah Road THIRLMERE, NSW Storing S68/2023/49/1 - 50 Brundah Road THIRLMERE, NSW Storing S68/2023/50/1 - 130 Buxton Avenue BUXTON, NSW Storing S68/2023/51/1 - 9 Meryla Street COURIDJAH, NSW Storing S68/2023/52/1 - 22 Sanctuary Drive TAHMOOR, NSW Storing S68/2023/53/1 - 153 Bobs Range Road ORANGEVILLE, NSW Storing S68/2023/54/1 - 69 Rita Street THIRLMERE, NSW Storing DA/2015/417/2 - Lysaght Road APPIN, NSW Storing DA/2018/108/2 - 8 Green Court WILTON, NSW Storing DA/2019/599/2 - 1160 Barkers Lodge Road OAKDALE, NSW Storing DA/2021/346/3 - Hume Highway PHEASANTS NEST, NSW Storing DA/2021/817/2 - 45 The Acres Way TAHMOOR, NSW Storing DA/2022/568/2 - 79 Kundabung Street BELIMBLA PARK, NSW Storing DA/2022/595/5 - 34 Laurel Street MENANGLE, NSW Storing DA/2022/747/2 - 1515 Barkers Lodge Road OAKDALE, NSW Storing DA/2022/884/2 - 3/1679 Remembrance Driveway PICTON, NSW Storing DA/2022/912/2 - 3 Struan Street TAHMOOR, NSW Storing DA/2022/922/2 - 17 Burgess Street WILTON, NSW Storing DA/2022/1126/2 - 140 Bobs Range Road ORANGEVILLE, NSW Storing DA/2022/1275/2 - 16 Florence Close BARGO, NSW Storing DA/2023/43/2 - 31 Eather Street WILTON, NSW Storing DA/2023/327/2 - 93 Cross Street TAHMOOR, NSW Storing DA/2023/400/1 - 21A Kerr Street APPIN, NSW Storing DA/2023/404/1 - 170 Bargo River Road TAHMOOR, NSW Storing DA/2023/408/1 - 22 Macanene Street WILTON, NSW Storing DA/2023/420/1 - 11 Tahmoor Road TAHMOOR, NSW Storing DA/2023/422/1 - 4 Coyle Circuit OAKDALE, NSW Storing DA/2023/423/1 - 44 Carlton Road THIRLMERE, NSW Storing DA/2023/424/1 - 6 Woodside Place TAHMOOR, NSW Storing DA/2023/426/1 - 3712 Remembrance Driveway BARGO, NSW Storing DA/2023/427/1 - 6 Allport Street WILTON, NSW Storing DA/2023/428/1 - 26 Cooper Drive OAKDALE, NSW Storing DA/2023/430/1 - 18 Greene Place THIRLMERE, NSW Storing DA/2023/432/1 - 35 Norma Close BARGO, NSW Storing DA/2023/433/1 - 18 Erith Road BUXTON, NSW Storing DA/2023/434/1 - 51 Highland Crescent THIRLMERE, NSW Storing DA/2023/435/1 - 7 Pear Tree Street WILTON, NSW Storing DA/2023/438/1 - 35 Ingleton Circuit WILTON, NSW Storing DA/2023/439/1 - 50 The Irons Drive WILTON, NSW Storing DA/2023/440/1 - 25 Stargard Crescent PICTON, NSW Storing DA/2023/441/1 - 5 Coveny Street SILVERDALE, NSW Storing DA/2023/442/1 - 90 Cross Street TAHMOOR, NSW Storing DA/2023/443/1 - 802 Thirlmere Way PICTON, NSW Storing DA/2023/445/1 - 21 The Grange PICTON, NSW Storing DA/2023/446/1 - 26 Collett Circuit APPIN, NSW Storing DA/2023/448/1 - 15 Pembroke Parade WILTON, NSW Storing DA/2023/449/1 - 8 Tarini Place TAHMOOR, NSW Storing DA/2023/450/1 - 36 Coyle Circuit OAKDALE, NSW Storing DA/2023/451/1 - 55 Estonian Road THIRLMERE, NSW Storing DA/2023/452/1 - 7 Jarrah Street TAHMOOR, NSW Storing DA/2023/453/1 - 5 Jarrah Street TAHMOOR, NSW Storing DA/2023/454/1 - 9 Jarrah Street TAHMOOR, NSW Storing DA/2023/455/1 - 30 Tickle Drive THIRLMERE, NSW Storing DA/2023/457/1 - 11 Jarrah Street TAHMOOR, NSW Storing DA/2023/458/1 - 59-61 Taylors Road SILVERDALE, NSW Storing DA/2023/459/1 - 23 Eucalyptus Grove BUXTON, NSW Storing DA/2023/460/1 - 40A West Parade BUXTON, NSW Storing DA/2023/461/1 - 40 Nolan Road OAKDALE, NSW Storing DA/2023/462/1 - 845 Silverdale Road WEROMBI, NSW Storing DA/2023/464/1 - 46 Burton Drive TAHMOOR, NSW Storing DA/2023/465/1 - 1 Teale Circuit TAHMOOR, NSW Storing DA/2023/466/1 - 10 Central Creamery Avenue MENANGLE, NSW Storing DA/2023/467/1 - 9 White Oak Street TAHMOOR, NSW Storing DA/2023/468/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/469/1 - 33 Scar Tree Crescent WILTON, NSW Storing DA/2023/470/1 - 35 Scar Tree Crescent WILTON, NSW Storing DA/2023/471/1 - 116 Brundah Road THIRLMERE, NSW Storing DA/2023/472/1 - 1 Lone Lea Street TAHMOOR, NSW Storing DA/2023/473/1 - 6 Ramsay Street PICTON, NSW Storing DA/2023/474/1 - 15 St James Place APPIN, NSW Storing DA/2023/475/1 - 12 Grey Box Circuit TAHMOOR, NSW Storing DA/2023/476/1 - 2 Adelaide Place SILVERDALE, NSW Storing DA/2023/477/1 - 1 Silverdale Road SILVERDALE, NSW Storing DA/2023/478/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/480/1 - 14 Seymour Road THE OAKS, NSW Storing DA/2023/481/1 - 69 Stringybark Drive WILTON, NSW Storing DA/2023/482/1 - 75 Michell Road THIRLMERE, NSW Storing DA/2023/483/1 - 12 Greene Place THIRLMERE, NSW Storing DA/2023/484/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/485/1 - 2 Rex Street WILTON, NSW Storing DA/2023/486/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/487/1 - 27 Oaks Street THIRLMERE, NSW Storing DA/2023/489/1 - 3 Nectarbrook Drive ORANGEVILLE, NSW Storing DA/2023/491/1 - Safari Drive SILVERDALE, NSW Storing DA/2023/492/1 - 1 Koolahs Street APPIN, NSW Storing DA/2023/494/1 - 119 Westbrook Road CAWDOR, NSW Storing DA/2023/495/1 - 21 Thirlmere Way TAHMOOR, NSW Storing DA/2023/497/1 - 29 Butler Drive WILTON, NSW Storing DA/2023/498/1 - 12 Ritchie Road SILVERDALE, NSW Storing DA/2023/500/1 - 57 Burton Drive TAHMOOR, NSW Storing DA/2023/501/1 - 8 Attunga Close PICTON, NSW Storing DA/2023/502/1 - 19 Coachwood Crescent PICTON, NSW Storing DA/2023/503/1 - 35 Davisland Avenue WILTON, NSW Storing DA/2023/504/1 - 6 Pear Tree Street WILTON, NSW Storing DA/2023/506/1 - 75 Burton Drive TAHMOOR, NSW Storing DA/2023/507/1 - 32 Burton Drive TAHMOOR, NSW Storing DA/2023/508/1 - 94 Jenkins Street DOUGLAS PARK, NSW Storing DA/2023/509/1 - 22 Tickle Drive THIRLMERE, NSW Storing DA/2023/510/1 - 6 Jarrah Street TAHMOOR, NSW Storing DA/2023/511/1 - 325 Finns Road MENANGLE, NSW Storing DA/2023/512/1 - 995 Silverdale Road WEROMBI, NSW Storing DA/2023/517/1 - 14 Pear Tree Street WILTON, NSW Storing DA/2023/518/1 - 15 Hogans Drive BARGO, NSW Storing DA/2023/521/1 - 27 Oswald Street WILTON, NSW Storing DA/2023/522/1 - 190 Calf Farm Road MOUNT HUNTER, NSW Storing DA/2023/523/1 - 5 Mulberry Street WILTON, NSW Storing DA/2023/524/1 - 17 Scar Tree Crescent WILTON, NSW Storing CDC/2023/17/2 - 5 Grundy Close WILTON, NSW Storing CDC/2023/85/2 - 2 Carney Street WILTON, NSW Storing CDC/2023/181/1 - 17A Westbourne Avenue THIRLMERE, NSW Storing CDC/2023/183/1 - 7 Butler Drive WILTON, NSW Storing CDC/2023/199/1 - 24 Torulosa Road THE OAKS, NSW Storing CDC/2023/204/1 - 52 Macanene Street WILTON, NSW Storing CDC/2023/205/1 - 11 Frank Street THE OAKS, NSW Storing CDC/2023/206/1 - Hume Highway PHEASANTS NEST, NSW Storing CDC/2023/207/1 - 40 Moorland Road TAHMOOR, NSW Storing CDC/2023/210/1 - 10 Gumtree Terrace TAHMOOR, NSW Storing CDC/2023/211/1 - Hume Highway PHEASANTS NEST, NSW Storing CDC/2023/215/1 - 24 Bickleigh Avenue WILTON, NSW Storing CDC/2023/217/1 - 71 Silverdale Road SILVERDALE, NSW Storing CDC/2023/218/1 - 14 Bradninch Crescent WILTON, NSW Storing CDC/2023/219/1 - 15 Pear Tree Street WILTON, NSW Storing CDC/2023/221/1 - 19 Kurrajong Crescent TAHMOOR, NSW Storing CDC/2023/227/1 - 31 St Lukes Street WILTON, NSW Storing CDC/2023/228/1 - 2 Wild Flower Place TAHMOOR, NSW Storing CDC/2023/230/1 - 3 Bradninch Crescent WILTON, NSW Storing CDC/2023/233/1 - 5 Bradninch Crescent WILTON, NSW

Data

Downloaded 1418 times by openaustralia dcalde mlandauer jesse-a-reilly muzzie86 BrendanFrameless

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.21 MB) Use the API

rows 10 / 3578

council_reference address description info_url date_scraped date_received on_notice_from on_notice_to lat lng
DA/2015/605/2
21 Station Master Avenue THIRLMERE, NSW
Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area
2020-07-29
2020-07-09
-34.2015815866067
150.57718975772
DA/2017/7/2
40 Burragorang Street THE OAKS, NSW
Modification - design changes
2020-07-29
2020-07-09
2020-07-15
2020-07-29
-34.0785271073153
150.566013656916
DA/2018/755/3
18 Torumba Circuit SILVERDALE, NSW
Modification - Modify condition 13 (1)
2020-07-29
2020-07-10
-33.9125745023159
150.604898799426
DA/2019/597/3
85 Eagles Road RAZORBACK, NSW
Modification - design changes
2020-07-29
2020-07-06
2020-07-10
2020-07-24
-34.1315649588424
150.672930057128
DA/2019/658/2
2 Kalangara Road SILVERDALE, NSW
Modification - design changes
2020-07-29
2020-07-03
-33.911332578772
150.604277567584
DA/2020/170/2
120 Burrells Road MENANGLE, NSW
Modification - include temporary occupation
2020-07-29
2020-07-07
-34.1561082189654
150.691282209498
DA/2020/231/2
8 Hassall Road BUXTON, NSW
Modification - Design changes
2020-07-29
2020-07-10
-34.2487649560524
150.540986009254
DA/2020/315/1
529 Old Razorback Road CAWDOR, NSW
Dwelling additions and s68 connect to existing
2020-07-29
2020-06-29
-34.1159615115923
150.668708408434
DA/2020/316/1
5 Camellia Court PICTON, NSW
Secondary dwelling & retaining walls
2020-07-29
2020-06-29
-34.1813143878095
150.614690808844
DA/2020/317/1
5 Dillies Lane TAHMOOR, NSW
Dwelling house
2020-07-29
2020-06-29
-34.2187083600634
150.604580262409

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 23 minutes

Total disk space used: 1.54 MB

History

  • Auto ran revision 95d5b551 and completed successfully .
    137 records added, 137 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    144 records added, 143 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    149 records added, 138 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    147 records added, 141 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    141 records added, 136 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb