planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications


Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.1 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.6  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Fetching mime-types-data 3.2019.0331  Installing unf_ext 0.0.7.6 with native extensions  Installing httpclient 2.8.3  Fetching net-http-digest_auth 1.4.1  Installing mime-types-data 3.2019.0331  Fetching mini_portile2 2.4.0  Installing net-http-digest_auth 1.4.1  Fetching ntlm-http 0.1.1  Installing mini_portile2 2.4.0  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Installing ntlm-http 0.1.1  Fetching net-http-persistent 3.0.1  Installing net-http-persistent 3.0.1  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.3  Installing nokogiri 1.10.3 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (24.76s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing DA/1996/102/3 - 16 Myrtle Creek Avenue TAHMOOR, NSW Storing DA/2006/59068/2 - 131-133 Bobs Range Road ORANGEVILLE, NSW Storing DA/2014/331/3 - 30 Bronzewing Street TAHMOOR, NSW Storing DA/2019/40/2 - 34 Hassall Road BUXTON, NSW Storing DA/2019/365/3 - 80 Dietz Lane OAKDALE, NSW Storing DA/2020/192/2 - 69 Rita Street THIRLMERE, NSW Storing DA/2020/449/2 - 4 Eliza Place PICTON, NSW Storing DA/2020/480/2 - 12 Bulli Appin Road APPIN, NSW Storing DA/2021/711/2 - 1565 Werombi Road WEROMBI, NSW Storing DA/2021/1003/3 - 85 Eltons Road SILVERDALE, NSW Storing DA/2021/1073/2 - 2 Nestlebrae Street SILVERDALE, NSW Storing DA/2021/1173/2 - 7 Station Street MENANGLE, NSW Storing DA/2022/219/2 - 1565 Werombi Road WEROMBI, NSW Storing DA/2022/299/2 - 57 Ridgehaven Road SILVERDALE, NSW Storing DA/2022/422/1 - 390 Wilton Park Road WILTON, NSW Storing DA/2022/452/1 - 37 Fisher Street THE OAKS, NSW Storing DA/2022/461/1 - 9 Central Creamery Avenue MENANGLE, NSW Storing DA/2022/474/1 - 125 Yarran Road BARGO, NSW Storing DA/2022/476/1 - 46 Highland Crescent THIRLMERE, NSW Storing DA/2022/478/1 - 100 Eagles Road RAZORBACK, NSW Storing DA/2022/479/1 - 150 Braddocks Road WEROMBI, NSW Storing DA/2022/480/1 - 1 Central Creamery Avenue MENANGLE, NSW Storing DA/2022/482/1 - 50 Brundah Road THIRLMERE, NSW Storing DA/2022/483/1 - 13 Janice Drive TAHMOOR, NSW Storing DA/2022/484/1 - 140 News Road WEROMBI, NSW Storing DA/2022/485/1 - 31 Laurel Street MENANGLE, NSW Storing DA/2022/486/1 - 13 Stevens Road MENANGLE, NSW Storing DA/2022/487/1 - 20 Turunen Avenue SILVERDALE, NSW Storing DA/2022/488/1 - 125 Yarran Road BARGO, NSW Storing DA/2022/489/1 - 255 Werombi Road BROWNLOW HILL, NSW Storing DA/2022/490/1 - 120 Sunnyside Road THE OAKS, NSW Storing DA/2022/491/1 - 120 Sunnyside Road THE OAKS, NSW Storing DA/2022/492/1 - 20 Albert Kench Place BUXTON, NSW Storing DA/2022/493/1 - 75 Lakes Street THIRLMERE, NSW Storing DA/2022/494/1 - 46 Coevon Road BUXTON, NSW Storing DA/2022/495/1 - 50 Rotolactor Parade MENANGLE, NSW Storing DA/2022/496/1 - 2 Central Creamery Avenue MENANGLE, NSW Storing DA/2022/497/1 - 30 Ingleton Circuit WILTON, NSW Storing DA/2022/498/1 - 22 Thirlmere Way TAHMOOR, NSW Storing DA/2022/499/1 - 4 Coyle Circuit OAKDALE, NSW Storing DA/2022/500/1 - 43 Fraser Street TAHMOOR, NSW Storing DA/2022/501/1 - 20 Merlin Street THE OAKS, NSW Storing DA/2022/502/1 - 145 Condell Park Road WILTON, NSW Storing DA/2022/503/1 - 866 Montpelier Drive THE OAKS, NSW Storing DA/2022/504/1 - 11 Hawkins Road TAHMOOR, NSW Storing DA/2022/505/1 - 11 Hawkins Road TAHMOOR, NSW Storing DA/2022/506/1 - 1 The Acres Way TAHMOOR, NSW Storing DA/2022/507/1 - 166 Taylors Road SILVERDALE, NSW Storing DA/2022/508/1 - 195B Fairway Drive WILTON, NSW Storing DA/2022/509/1 - 12 Cumbria Street THIRLMERE, NSW Storing DA/2022/510/1 - 18 Laurel Street MENANGLE, NSW Storing DA/2022/511/1 - 675 Montpelier Drive THE OAKS, NSW Storing DA/2022/512/1 - 50 Lawson Road PHEASANTS NEST, NSW Storing DA/2022/513/1 - 50 Michell Road THIRLMERE, NSW Storing DA/2022/514/1 - 13 Yanderra Road YANDERRA, NSW Storing DA/2022/515/1 - 2 Laurel Street MENANGLE, NSW Storing DA/2022/516/1 - 21 Station Street MENANGLE, NSW Storing DA/2022/517/1 - 4 Noonamena Road TAHMOOR, NSW Storing DA/2022/519/1 - 1 Dunroman Lane BUXTON, NSW Storing DA/2022/520/1 - 25 Station Master Avenue THIRLMERE, NSW Storing DA/2022/521/1 - 403 Argyle Street PICTON, NSW Storing DA/2022/522/1 - 22 Albert Avenue THIRLMERE, NSW Storing DA/2022/523/1 - 71 Second Street WARRAGAMBA, NSW Storing DA/2022/524/1 - 145 Arina Road BARGO, NSW Storing DA/2022/525/1 - 145 Arina Road BARGO, NSW Storing DA/2022/526/1 - 1 Marsh Place THE OAKS, NSW Storing DA/2022/527/1 - 1 Marsh Place THE OAKS, NSW Storing DA/2022/528/1 - 3 Potters Drive TAHMOOR, NSW Storing DA/2022/529/1 - 74 Appin Road APPIN, NSW Storing DA/2022/530/1 - 44-50 Church Street APPIN, NSW Storing DA/2022/531/1 - 13 Yanderra Road YANDERRA, NSW Storing DA/2022/532/1 - 130 Dwyers Road PHEASANTS NEST, NSW Storing DA/2022/534/1 - 10 Gumtree Terrace TAHMOOR, NSW Storing DA/2022/535/1 - 59 Coyle Circuit OAKDALE, NSW Storing DA/2022/536/1 - 5 Timair Road THIRLMERE, NSW Storing DA/2022/537/1 - 15A Close Street THIRLMERE, NSW Storing DA/2022/538/1 - 19 King Street APPIN, NSW Storing DA/2022/539/1 - 7 Tamara Close OAKDALE, NSW Storing DA/2022/540/1 - 6 Manna Way SILVERDALE, NSW Storing DA/2022/541/1 - 1 The Acres Way TAHMOOR, NSW Storing DA/2022/542/1 - 18 Tiger Street SILVERDALE, NSW Storing DA/2022/543/1 - 190 Fergusson Road LAKESLAND, NSW Storing DA/2022/544/1 - 64 Kader Street BARGO, NSW Storing DA/2022/545/1 - 20 Fosters Lane MOUNT HUNTER, NSW Storing DA/2022/546/1 - 25 Manna Way SILVERDALE, NSW Storing DA/2022/547/1 - Marsh Road SILVERDALE, NSW Storing DA/2022/548/1 - Marsh Road SILVERDALE, NSW Storing DA/2022/549/1 - 35 Denmead Street THIRLMERE, NSW Storing DA/2022/550/1 - 50 Pineridge Crescent SILVERDALE, NSW Storing DA/2022/551/1 - 8 Agnes Place THIRLMERE, NSW Storing DA/2022/552/1 - 6 Laurel Street MENANGLE, NSW Storing DA/2022/553/1 - 65 Mulhollands Road PICTON, NSW Storing DA/2022/554/1 - 65 Mulhollands Road PICTON, NSW Storing DA/2022/555/1 - 71 Fairway Drive WILTON, NSW Storing DA/2022/556/1 - 3 Nectarbrook Drive ORANGEVILLE, NSW Storing DA/2022/557/1 - 42 St Heliers Road SILVERDALE, NSW Storing DA/2022/558/1 - Marsh Road SILVERDALE, NSW Storing DA/2022/559/1 - 30 Heritage Drive APPIN, NSW Storing DA/2022/560/1 - 120 Sunnyside Road THE OAKS, NSW Storing DA/2022/561/1 - 2 Stirling Drive WILTON, NSW Storing DA/2022/562/1 - 16 Obrien Street OAKDALE, NSW Storing DA/2022/563/1 - 90 Daley Close THE OAKS, NSW Storing DA/2022/564/1 - 5 Obrien Street OAKDALE, NSW Storing DA/2022/565/1 - 27 Dymond Street BARGO, NSW Storing DA/2022/566/1 - 80 Rita Street THIRLMERE, NSW Storing DA/2022/567/1 - 5 Betty Place THIRLMERE, NSW Storing DA/2022/568/1 - 79 Kundabung Street BELIMBLA PARK, NSW Storing DA/2022/569/1 - 6 Sanderson Street TAHMOOR, NSW Storing DA/2022/570/1 - 5 Sonja Place PICTON, NSW Storing DA/2022/571/1 - 3 Coveny Street SILVERDALE, NSW Storing DA/2022/572/1 - 120 Railside Avenue BARGO, NSW Storing DA/2022/573/1 - 35 Stirling Drive WILTON, NSW Storing DA/2022/574/1 - 24 Elvy Street BARGO, NSW Storing DA/2022/575/1 - 24 Elvy Street BARGO, NSW Storing DA/2022/576/1 - 30 Ingleton Circuit WILTON, NSW Storing DA/2022/578/1 - 48 St Heliers Road SILVERDALE, NSW Storing DA/2022/579/1 - 15 Ambervale Drive ORANGEVILLE, NSW Storing DA/2022/580/1 - 59 Coyle Circuit OAKDALE, NSW Storing DA/2022/581/1 - 14 Williamswood Road MOUNT HUNTER, NSW Storing DA/2022/582/1 - 2 Doyle Lane TAHMOOR, NSW Storing DA/2022/583/1 - 90 Caloola Road BARGO, NSW Storing DA/2022/584/1 - 40 Halliday Road OAKDALE, NSW Storing DA/2022/585/1 - 35 Jumbunna Place BUXTON, NSW Storing DA/2022/586/1 - 3 Sanderson Street TAHMOOR, NSW Storing DA/2022/587/1 - 82 Hornby Street WILTON, NSW Storing DA/2022/588/1 - 12 Angus Lane PICTON, NSW Storing DA/2022/589/1 - 50 Laurel Street MENANGLE, NSW Storing DA/2022/590/1 - 239 Bridge Street THIRLMERE, NSW Storing DA/2022/591/1 - 30 Lawson Road PHEASANTS NEST, NSW Storing DA/2022/592/1 - 190 Fergusson Road LAKESLAND, NSW Storing DA/2022/593/1 - 10 Attunga Close PICTON, NSW Storing DA/2022/594/1 - Lysaght Road APPIN, NSW Storing DA/2022/595/1 - 34 Laurel Street MENANGLE, NSW Storing DA/2022/596/1 - 350 Rapleys Loop Road WEROMBI, NSW Storing DA/2022/597/1 - 1161 Burragorang Road BELIMBLA PARK, NSW Storing DA/2022/598/1 - 270 Farnsworth Avenue WARRAGAMBA, NSW Storing DA/2022/599/1 - 436 Menangle Road MENANGLE, NSW Storing DA/2022/600/1 - 17 Dulcimere Street TAHMOOR, NSW Storing DA/2022/601/1 - 16 Nestlebrae Street SILVERDALE, NSW Storing DA/2022/602/1 - 12 Nestlebrae Street SILVERDALE, NSW Storing DA/2022/603/1 - 270 Farnsworth Avenue WARRAGAMBA, NSW Storing DA/2022/604/1 - 5 Dulcimere Street TAHMOOR, NSW Storing DA/2022/605/1 - 9 Woodside Place TAHMOOR, NSW Storing DA/2022/606/1 - 3 Rosedale Street TAHMOOR, NSW Storing DA/2022/607/1 - 7 Dean Close OAKDALE, NSW Storing DA/2022/608/1 - 10 Hudson Place BARGO, NSW Storing DA/2022/611/1 - 4 Rosedale Street TAHMOOR, NSW Storing DA/2022/612/1 - 1151 Burragorang Road BELIMBLA PARK, NSW Storing DA/2022/613/1 - 9 Station Street MENANGLE, NSW Storing DA/2022/614/1 - 9 Station Street MENANGLE, NSW Storing DA/2022/616/1 - 5 Woodside Place TAHMOOR, NSW Storing DA/2022/618/1 - 13 Obrien Street OAKDALE, NSW Storing DA/2022/619/1 - 134 Silverdale Road SILVERDALE, NSW Storing DA/2022/621/1 - 390 Mount Hercules Road RAZORBACK, NSW Storing DA/2022/626/1 - 22 Rotolactor Parade MENANGLE, NSW Storing CDC/2022/136/1 - 114 Brundah Road THIRLMERE, NSW Storing CDC/2022/138/1 - 116 Ridgehaven Road SILVERDALE, NSW Storing CDC/2022/141/1 - 7 Elmwood Way WILTON, NSW Storing CDC/2022/144/1 - 41 The Grange PICTON, NSW Storing CDC/2022/148/1 - 9 Ruwald Place CAMDEN PARK, NSW Storing CDC/2022/154/1 - 151 Mount Hercules Road RAZORBACK, NSW

Data

Downloaded 831 times by openaustralia dcalde muzzie86

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (665 KB) Use the API

rows 10 / 1947

council_reference address description info_url date_scraped date_received on_notice_from on_notice_to lat lng
DA/2015/605/2
21 Station Master Avenue THIRLMERE, NSW
Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area
2020-07-29
2020-07-09
-34.2015815866067
150.57718975772
DA/2017/7/2
40 Burragorang Street THE OAKS, NSW
Modification - design changes
2020-07-29
2020-07-09
2020-07-15
2020-07-29
-34.0785271073153
150.566013656916
DA/2018/755/3
18 Torumba Circuit SILVERDALE, NSW
Modification - Modify condition 13 (1)
2020-07-29
2020-07-10
-33.9125745023159
150.604898799426
DA/2019/597/3
85 Eagles Road RAZORBACK, NSW
Modification - design changes
2020-07-29
2020-07-06
2020-07-10
2020-07-24
-34.1315649588424
150.672930057128
DA/2019/658/2
2 Kalangara Road SILVERDALE, NSW
Modification - design changes
2020-07-29
2020-07-03
-33.911332578772
150.604277567584
DA/2020/170/2
120 Burrells Road MENANGLE, NSW
Modification - include temporary occupation
2020-07-29
2020-07-07
-34.1561082189654
150.691282209498
DA/2020/231/2
8 Hassall Road BUXTON, NSW
Modification - Design changes
2020-07-29
2020-07-10
-34.2487649560524
150.540986009254
DA/2020/315/1
529 Old Razorback Road CAWDOR, NSW
Dwelling additions and s68 connect to existing
2020-07-29
2020-06-29
-34.1159615115923
150.668708408434
DA/2020/316/1
5 Camellia Court PICTON, NSW
Secondary dwelling & retaining walls
2020-07-29
2020-06-29
-34.1813143878095
150.614690808844
DA/2020/317/1
5 Dillies Lane TAHMOOR, NSW
Dwelling house
2020-07-29
2020-06-29
-34.2187083600634
150.604580262409

Statistics

Average successful run time: 2 minutes

Total run time: about 21 hours

Total cpu time used: 14 minutes

Total disk space used: 1010 KB

History

  • Auto ran revision 95d5b551 and completed successfully .
    161 records added, 159 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    159 records added, 155 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    158 records added, 158 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    159 records added, 159 records removed in the database
  • Auto ran revision 95d5b551 and completed successfully .
    163 records added, 151 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb