planningalerts-scrapers / multiple_atdis

Scrapes multiple authorities that have ATDIS feed


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git  Fetching concurrent-ruby 1.1.5  Fetching minitest 5.11.3  Fetching thread_safe 0.3.6  Installing minitest 5.11.3  Installing thread_safe 0.3.6  Fetching public_suffix 3.1.0  Installing concurrent-ruby 1.1.5  Fetching multi_json 1.13.1  Fetching unf_ext 0.0.7.6  Installing unf_ext 0.0.7.6 with native extensions  Installing multi_json 1.13.1  Installing public_suffix 3.1.0  Fetching mime-types-data 3.2019.0331  Fetching netrc 0.11.0  Installing mime-types-data 3.2019.0331  Installing netrc 0.11.0  Fetching rgeo 2.0.1  Installing rgeo 2.0.1 with native extensions  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching sqlite3 1.4.1  Installing sqlite3 1.4.1 with native extensions  Using bundler 1.15.2  Fetching safe_yaml 1.0.5  Installing safe_yaml 1.0.5  Fetching hashdiff 0.4.0  Installing hashdiff 0.4.0  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching tzinfo 1.2.5  Installing tzinfo 1.2.5  Fetching i18n 1.6.0  Installing i18n 1.6.0  Fetching addressable 2.6.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Installing addressable 2.6.0  Fetching unf 0.1.4  Fetching crack 0.4.3  Installing unf 0.1.4  Fetching rgeo-geojson 2.1.1  Installing rgeo-geojson 2.1.1  Fetching activesupport 5.2.3  Installing crack 0.4.3  Installing activesupport 5.2.3  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching webmock 3.6.0  Fetching activemodel 5.2.3  Installing webmock 3.6.0  Installing activemodel 5.2.3  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching atdis 0.4.1  Installing atdis 0.4.1  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching scraperwiki 3.0.2  Installing scraperwiki 3.0.2  Fetching scraperwiki-morph 0.1.1  Installing scraperwiki-morph 0.1.1  Using atdisplanningalertsfeed 0.1.0 from git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git (at master@a7a7ce7)  Bundle complete! 4 Gemfile dependencies, 34 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from i18n:  HEADS UP! i18n 1.1 changed fallbacks to exclude default locale.  But that may break your application.  Please check your Rails app for 'config.i18n.fallbacks = true'.  If you're using I18n (>= 1.1.0) and Rails (< 5.2.2), this should be  'config.i18n.fallbacks = [I18n.default_locale]'.  If not, fallbacks will be broken in your app by I18n 1.1.x.  For more info see:  https://github.com/svenfuchs/i18n/releases/tag/v1.1.0  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (18.13s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45. Collecting ATDIS feed data for bega_valley... Collecting ATDIS feed data for ballina... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:101:in `timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:878:in `connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:863:in `do_start' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:852:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' D, [2019-08-17T22:45:03.193904 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:45:16.595659 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=4 D, [2019-08-17T22:45:27.483317 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=5 D, [2019-08-17T22:45:39.425376 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=6 D, [2019-08-17T22:45:53.407636 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=7 D, [2019-08-17T22:46:03.259468 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=8 D, [2019-08-17T22:46:14.632302 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=9 D, [2019-08-17T22:46:26.516981 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=10 D, [2019-08-17T22:46:37.308652 #18] DEBUG -- : Fetching Storing 018.2019.00005055.001 - 274 River ST, BALLINA, NSW 2478 Storing 010.2019.00000526.001 - 13 Calnan CR, CUMBALUM, NSW 2478 Storing 010.2019.00000398.002 - 15 Sandbreak CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000525.001 - 38 Calnan CR, CUMBALUM, NSW 2478 Storing 010.2019.00000524.001 - 91 Victoria Park RD, DALWOOD, NSW 2477 Storing 018.2019.00005057.001 - 44 Bangalow RD, BALLINA, NSW 2478 Storing 010.2019.00000486.001 - 29 Millbrook TCE, WOLLONGBAR, NSW 2477 Storing 010.2018.00000657.002 - 6 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000523.001 - 10 Taunton PL, WOLLONGBAR, NSW 2477 Storing 010.2019.00000512.001 - 50 Rifle Range RD, WOLLONGBAR, NSW 2477 Storing 010.2019.00000509.001 - 30 Sunray CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000510.001 - 5/8 Stewart ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000522.001 - 35 Pacific TCE, EAST BALLINA, NSW 2478 Storing 010.2019.00000521.001 - 741 Fernleigh RD, BROOKLET, NSW 2479 Storing 018.2019.00005040.001 - 15 Matilda ST, LENNOX HEAD, NSW 2478 Storing 010.2016.00000586.002 - 528 Uralba RD, URALBA, NSW 2477 Storing 010.2018.00000694.002 - 267 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000494.001 - 21 Grandview ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000507.001 - 225 Friday Hut RD, TINTENBAR, NSW 2478 Storing 010.2019.00000482.001 - 17 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000520.001 - 25 Sandbreak CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000519.001 - 23 Northcott CR, ALSTONVILLE, NSW 2477 Storing 010.2019.00000493.001 - 30 Bolwarra CCT, WOLLONGBAR, NSW 2477 Storing 010.2010.00000184.002 - 28 Summerhill CR, CUMBALUM, NSW 2478 Storing 010.2017.00000369.002 - 5 Jack PL, LENNOX HEAD, NSW 2478 Storing 010.2018.00000585.002 - 17-49 Owen ST, BALLINA, NSW 2478 Storing 010.2019.00000518.001 - 58 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000508.001 - 120 Kalinga ST, WEST BALLINA, NSW 2478 Storing 010.2019.00000516.001 - 53 Sproule DR, ALSTONVALE, NSW 2477 Storing 010.2019.00000515.001 - 16 Trelawney AVE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000513.001 - 528 Uralba RD, URALBA, NSW 2477 Storing 010.2019.00000514.001 - 45 Snapper DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000506.001 - 19 Quays DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000511.001 - 63 Seaswell CR, LENNOX HEAD, NSW 2478 Storing 010.2018.00000135.002 - 454 River DR, EMPIRE VALE, NSW 2478 Storing 010.2019.00000497.001 - 8 Suvla ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000517.001 - 35 Foresters WY, TINTENBAR, NSW 2478 Storing 010.2018.00000674.002 - 51 Greenfield RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000505.001 - 12 Cowrie St, LENNOX HEAD, NSW 2478 Storing 010.2019.00000499.001 - 35 Pine AVE, EAST BALLINA, NSW 2478 Storing 010.2018.00000545.002 - 58 Amber DR, LENNOX HEAD, NSW 2478 Storing 010.2017.00000203.002 - 21 McLeish RD, KINVARA, NSW 2478 Storing 018.2019.00005049.001 - 2-12 Greenwood PL, LENNOX HEAD, NSW 2478 Storing 018.2019.00005056.001 - 70 Scanlan LA, KINVARA, NSW 2478 Storing 010.2019.00000502.001 - 2-12 Greenwood PL, LENNOX HEAD, NSW 2478 Storing 010.2018.00000544.002 - 56 Amber DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000504.001 - 21 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000503.001 - 22 Morton WY, SKENNARS HEAD, NSW 2478 Storing 018.2019.00005052.001 - 92 Tamar ST, BALLINA, NSW 2478 Storing 010.2019.00000500.001 - 15 Leach CR, WEST BALLINA, NSW 2478 Storing 018.2019.00005046.001 - 5 Evelyn Villa DR, ALSTONVILLE, NSW 2477 Storing 010.2019.00000501.001 - 8 Rutherford ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000467.001 - 15 Eagle AVE, BALLINA, NSW 2478 Storing 010.2019.00000491.001 - 63 Alston AVE, ALSTONVILLE, NSW 2477 Storing 018.2019.00005048.001 - 90 Main ST, ALSTONVILLE, NSW 2477 Storing 010.2019.00000496.001 - 12 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2016.00000434.003 - 148 Old Byron Bay RD, NEWRYBAR, NSW 2479 Storing 010.2015.00000393.004 - 1 Grant ST, BALLINA, NSW 2478 Storing 010.2019.00000492.001 - 24 O'Rourke ST, CUMBALUM, NSW 2478 Storing 010.2019.00000487.001 - 1 Grant ST, BALLINA, NSW 2478 Storing 010.2019.00000481.001 - 801 Wardell RD, MEERSCHAUM VALE, NSW 2477 Storing 010.2019.00000488.001 - 32 Olivia CCT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000483.001 - 173 Rous RD, ROUS, NSW 2477 Storing 010.2019.00000484.001 - 237 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000480.001 - Teven RD, TEVEN, NSW 2478 Storing 010.2019.00000490.001 - 92 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000489.001 - 38 Liffey AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000477.001 - 1/5 Byron ST, LENNOX HEAD, NSW 2478 Storing 018.2019.00005051.001 - 84 Kerr ST, BALLINA, NSW 2478 Storing 010.2019.00000485.001 - 7 Scarlett CT, WOLLONGBAR, NSW 2477 Storing 010.2018.00000519.002 - 100 North Creek RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000475.001 - 1 Stonehenge PL, LENNOX HEAD, NSW 2478 Storing 010.2019.00000498.001 - 2 Jamie PL, BALLINA, NSW 2478 Storing 010.2019.00000472.001 - 20 Stonehenge PL, LENNOX HEAD, NSW 2478 Storing 010.2019.00000495.001 - 113 Nashua RD, FERNLEIGH, NSW 2479 Storing 018.2019.00005047.001 - 7 Osprey PL, EAST BALLINA, NSW 2478 Storing 010.2019.00000471.001 - 621 Pearces Creek RD, ALSTONVALE, NSW 2477 Storing 010.2013.00000432.002 - 2/44 Stewart ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000469.001 - 12 Killarney CR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000478.001 - 9 Casuarina RD, EAST BALLINA, NSW 2478 Storing 010.2019.00000476.001 - 9 Jameson AVE, EAST BALLINA, NSW 2478 Storing 010.2019.00000468.001 - 19 Quays DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000473.001 - 51 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000470.001 - 8 Smith ST, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000479.001 - 8 Cowrie St, LENNOX HEAD, NSW 2478 Storing 010.2019.00000465.001 - Teven RD, WEST BALLINA, NSW 2478 Storing 010.2019.00000474.001 - 12 Willie Wagtail PL, ALSTONVILLE, NSW 2477 Storing 010.2019.00000466.001 - 20 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000463.001 - 2/31 Silkwood RD, LENNOX HEAD, NSW 2478 Storing 010.2012.00000274.004 - 84 Kerr ST, BALLINA, NSW 2478 Storing 010.2019.00000462.001 - 80 Owenia WY, BROKEN HEAD, NSW 2481 Storing 010.2019.00000464.001 - 5 Blue Horizon DR, LENNOX HEAD, NSW 2478 Collecting ATDIS feed data for bathurst... D, [2019-08-17T22:46:44.117026 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:46:46.279326 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=4 D, [2019-08-17T22:46:48.153495 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=5 D, [2019-08-17T22:46:50.070457 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=6 D, [2019-08-17T22:46:52.193408 #18] DEBUG -- : Fetching Storing 018.2019.00000125.001 - 28 Darling ST, EGLINTON, NSW 2795 Storing 010.2019.00000208.001 - 56 Mendel DR, KELSO, NSW 2795 Storing 018.2019.00000124.001 - 32 Darling ST, EGLINTON, NSW 2795 Storing 018.2019.00000119.001 - 42 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000123.001 - 21 Quinn CT, LLANARTH, NSW 2795 Storing 010.2019.00000239.001 - 136 Bentinck ST, BATHURST, NSW 2795 Storing 010.2019.00000218.001 - 7 Parson CL, WEST BATHURST, NSW 2795 Storing 010.2019.00000237.001 - 20 Lord ST, BATHURST, NSW 2795 Storing 010.2019.00000238.001 - 268 Howards DR, MOUNT RANKIN, NSW 2795 Storing 010.2019.00000236.001 - 302 Howick ST, BATHURST, NSW 2795 Storing 010.2019.00000211.001 - 1119 Limekilns RD, CLEAR CREEK, NSW 2795 Storing 018.2019.00000122.001 - 56A Boyd ST, KELSO, NSW 2795 Storing 010.2019.00000233.001 - 20 Corporation AVE, ROBIN HILL, NSW 2795 Storing 010.2019.00000235.001 - 27 Oates PL, EGLINTON, NSW 2795 Storing 010.2019.00000234.001 - 3 Dovey DR, KELSO, NSW 2795 Storing 018.2019.00000117.001 - 1 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000103.001 - 13 Lew AVE, EGLINTON, NSW 2795 Storing 010.2019.00000229.001 - 47 Fitzroy ST, PEEL, NSW 2795 Storing 018.2019.00000116.001 - 32 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000232.001 - 48 Durham ST, BATHURST, NSW 2795 Storing 010.2019.00000231.001 - 13 Pit STGT, MOUNT PANORAMA, NSW 2795 Storing 010.2019.00000230.001 - 42 Lew AVE, EGLINTON, NSW 2795 Storing 010.2019.00000216.001 - 34 William ST, BATHURST, NSW 2795 Storing 018.2019.00000115.001 - 14 Saltram CCT, EGLINTON, NSW 2795 Storing 010.2018.00000480.002 - 224 William ST, BATHURST, NSW 2795 Storing 010.2019.00000228.001 - 273 George ST, BATHURST, NSW 2795 Storing 018.2019.00000101.001 - 56 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000227.001 - 4 Douglas CT, KELSO, NSW 2795 Storing 018.2019.00000111.001 - 64 Saint Johns RD, GEORGES PLAINS, NSW 2795 Storing 010.2019.00000226.001 - 282 Havannah ST, SOUTH BATHURST, NSW 2795 Storing 018.2019.00000102.001 - 17 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000225.001 - 31 Sunbright RD, KELSO, NSW 2795 Storing 010.2019.00000224.001 - 13 PJ Moodie DR, RAGLAN, NSW 2795 Storing 010.2019.00000223.001 - 37 Sunbright RD, KELSO, NSW 2795 Storing 010.2019.00000222.001 - 65 Westbourne DR, LLANARTH, NSW 2795 Storing 010.2019.00000217.001 - 14 Brennan DR, KELSO, NSW 2795 Storing 018.2019.00000113.001 - 11 Keystone RI, KELSO, NSW 2795 Storing 018.2019.00000114.001 - 4 Lyon CL, KELSO, NSW 2795 Storing 018.2019.00000112.001 - 5 Hyacinth WAY, LLANARTH, NSW 2795 Storing 010.2019.00000221.001 - 63 Westbourne DR, LLANARTH, NSW 2795 Storing 010.2019.00000220.001 - 62 Hamilton ST, EGLINTON, NSW 2795 Storing 010.2019.00000219.001 - 62 Hamilton ST, EGLINTON, NSW 2795 Storing 018.2019.00000110.001 - 2 Lyon CL, KELSO, NSW 2795 Storing 010.2019.00000215.001 - 3821 Limekilns RD, WATTLE FLAT, NSW 2795 Storing 010.2019.00000214.001 - 4419 Great Western HWY, WALANG, NSW 2795 Storing 010.2019.00000213.001 - 20 Arnold CT, KELSO, NSW 2795 Storing 010.2019.00000212.001 - 43 Fraser DR, EGLINTON, NSW 2795 Storing 018.2019.00000109.001 - 106 Graham DR, KELSO, NSW 2795 Storing 018.2019.00000107.001 - 462 Brewongle LA, GLANMIRE, NSW 2795 Storing 018.2019.00000108.001 - 1 Keystone RI, KELSO, NSW 2795 Storing 018.2019.00000104.001 - 17 Dovey DR, KELSO, NSW 2795 Storing 010.2019.00000153.002 - 72 Piper ST, BATHURST, NSW 2795 Storing 010.2019.00000210.001 - 414 Howick ST, BATHURST, NSW 2795 Storing 010.2019.00000209.001 - 93 Logan ST, EGLINTON, NSW 2795 Storing 010.2019.00000207.001 - 311 Gestingthorpe RD, COW FLAT, NSW 2795 Collecting ATDIS feed data for berrigan... Storing 19.20.DA.D6 - 21 KAMAROOKA STREET, BAROOGA, NSW 3644 Storing 20.20.DA.D9 - 3365 BAROOGA-TOCUMWAL ROAD, FINLEY, NSW 3644 Storing 17.20.DA.DM - 243 MCCULLOCHS ROAD, TOCUMWAL, NSW 2714 Storing 18.20.DA.DO - 83 NGAWE ROAD, BAROOGA, NSW 3644 Storing 14.20.DA.DM - 11 MURRAY STREET, BERRIGAN, NSW 2714 Storing 16.20.DA.D5 - 48 BUCHANANS ROAD, BAROOGA, NSW 3644 Storing 10.20.DA.D5 - 23 HOWE STREET, FINLEY, NSW 2713 Storing 11.20.DA.D3 - ENDEAVOUR STREET, FINLEY, NSW 2713 Storing 9.20.DA.DO - 60 MORRIS DRIVE, TOCUMWAL, NSW 2714 Storing 8.20.DA.DM - 33 MURRAY STREET, FINLEY, NSW 2713 Storing 7.20.DA.D1 - 119 NGAWE ROAD, BAROOGA, NSW 3644 Collecting ATDIS feed data for dubbo... D, [2019-08-17T22:47:09.236801 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:47:14.885534 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=4 D, [2019-08-17T22:47:19.525234 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=5 D, [2019-08-17T22:47:23.060595 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=6 D, [2019-08-17T22:47:26.390135 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=7 D, [2019-08-17T22:47:29.894872 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=8 D, [2019-08-17T22:47:31.891602 #18] DEBUG -- : Fetching Storing 010.2019.00000374.001 - 13A Nanima CR, WELLINGTON, NSW 2820 Storing 010.2019.00000372.001 - 410 Fitzroy ST, DUBBO, NSW 2830 Storing 010.2019.00000378.001 - 18 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000380.001 - 128 Birch AVE, DUBBO, NSW 2830 Storing 010.2019.00000371.001 - 22 Wollomombi PDE, DUBBO, NSW 2830 Storing 010.2019.00000379.001 - 8 Dulhunty AVE, DUBBO, NSW 2830 Storing 010.2019.00000375.001 - 5 Villiers AVE, DUBBO, NSW 2830 Storing 010.2019.00000377.001 - 22 Nanima CR, WELLINGTON, NSW 2820 Storing 010.2019.00000373.001 - 3 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000369.001 - Talbragar ST, DUBBO, NSW 2830 Storing 010.2017.00000607.002 - Keswick PKWY, DUBBO, NSW 2830 Storing 010.2019.00000367.001 - Boyd AVE, DUBBO, NSW 2830 Storing 010.2019.00000343.001 - 110 Palmer ST, DUBBO, NSW 2830 Storing 016.2019.00000052.001 - 125-127 Erskine ST, DUBBO, NSW 2830 Storing 010.2019.00000339.001 - 30 Avon RD, NORTH YEOVAL, NSW 2868 Storing 010.2019.00000335.001 - 6586 Mitchell HWY, CUNDUMBUL, NSW 2866 Storing 010.2019.00000368.001 - 9 Quinn ST, DUBBO, NSW 2830 Storing 010.2019.00000345.001 - 31 Molong ST, STUART TOWN, NSW 2820 Storing 010.2019.00000334.001 - 89 Caves RD, APSLEY, NSW 2820 Storing 010.2019.00000325.001 - 711 Ponto Falls RD, MARYVALE, NSW 2820 Storing 010.2019.00000322.001 - 77-79 Wellington ST, GEURIE, NSW 2818 Storing 016.2019.00000051.001 - 6 Wave CT, DUBBO, NSW 2830 Storing 010.2010.00000053.004 - 42R Obley RD, DUBBO, NSW 2830 Storing 010.2019.00000366.001 - 15 Rhyana CT, DUBBO, NSW 2830 Storing 010.2019.00000365.001 - 17L Mayfield RD, DUBBO, NSW 2830 Storing 010.2019.00000352.001 - 88 Macquarie ST, DUBBO, NSW 2830 Storing 010.2019.00000346.001 - 16 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000364.001 - 3 Avalon PL, DUBBO, NSW 2830 Storing 010.2019.00000336.001 - 13L North Burrabadine RD, DUBBO, NSW 2830 Storing 010.2019.00000362.001 - 4 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000025.002 - 169 Boundary RD, DUBBO, NSW 2830 Storing 010.2018.00000648.002 - 5 Ivy CT, DUBBO, NSW 2830 Storing 010.2019.00000363.001 - 7 Lesmurdie PDE, DUBBO, NSW 2830 Storing 010.2019.00000337.001 - 17 Alder PL, DUBBO, NSW 2830 Storing 010.2019.00000347.001 - 8L Bulwarra DR, DUBBO, NSW 2830 Storing 016.2019.00000048.001 - 56 Church ST, DUBBO, NSW 2830 Storing 010.2019.00000349.001 - 17 Torryburn WY, DUBBO, NSW 2830 Storing 010.2019.00000361.001 - 7 Castlereagh AVE, DUBBO, NSW 2830 Storing 016.2019.00000050.001 - 6R Kurrajong DR, DUBBO, NSW 2830 Storing 010.2019.00000360.001 - 1 Lee ST, WELLINGTON, NSW 2820 Storing 010.2019.00000358.001 - 104 Gladstone RD, BODANGORA, NSW 2820 Storing 010.2019.00000359.001 - 4 Wave CT, DUBBO, NSW 2830 Storing 010.2018.00000569.002 - 30 Waterfall CRES, DUBBO, NSW 2830 Storing 010.2019.00000357.001 - 80R Lagoon Creek RD, MINORE, NSW 2830 Storing 010.2019.00000356.001 - 6 Cloonawillin CL, DUBBO, NSW 2830 Storing 010.2019.00000353.001 - 23 Cormorant CRES, DUBBO, NSW 2830 Storing 016.2019.00000047.001 - 15 Peel PL, DUBBO, NSW 2830 Storing 010.2019.00000342.001 - 46L Warrie RD, DUBBO, NSW 2830 Storing 010.2019.00000329.001 - 8R Burrabadine RD, DUBBO, NSW 2830 Storing 010.2019.00000350.001 - Gilgandra RD, DUBBO, NSW 2830 Storing 010.2019.00000348.001 - 15 Shetland AVE, DUBBO, NSW 2830 Storing 010.2019.00000351.001 - 12 Osborne PL, DUBBO, NSW 2830 Storing 010.2019.00000344.001 - 57 Talbragar ST, DUBBO, NSW 2830 Storing 010.2019.00000340.001 - 7 Turon CR, DUBBO, NSW 2830 Storing 010.2019.00000338.001 - 18 Blueridge DR, DUBBO, NSW 2830 Storing 010.2019.00000341.001 - 66R Cooreena RD, DUBBO, NSW 2830 Storing 016.2019.00000046.001 - 22-30 Whylandra ST, DUBBO, NSW 2830 Storing 010.2019.00000331.001 - 32 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000333.001 - 13 Macintyre CRCT, DUBBO, NSW 2830 Storing 010.2019.00000324.001 - 11 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000332.001 - 13A Nanima CR, WELLINGTON, NSW 2820 Storing 010.2019.00000328.001 - 70-72 Narragal ST, GEURIE, NSW 2818 Storing 010.2019.00000330.001 - 6L Delroy RD, MINORE, NSW 2830 Storing 010.2018.00000630.002 - 18 Jannali RD, DUBBO, NSW 2830 Storing 010.2019.00000327.001 - 37 Mitchell ST, GEURIE, NSW 2818 Storing 010.2019.00000326.001 - 10 Commercial AVE, DUBBO, NSW 2830 Storing 010.2019.00000323.001 - 3 Macgregor ST, DUBBO, NSW 2830 Collecting ATDIS feed data for kiama... D, [2019-08-17T22:48:01.993356 #18] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:48:06.408372 #18] DEBUG -- : Fetching Storing 010.2019.00000144.001 - 131 Riberry LANE, BROUGHTON VILLAGE, NSW 2534 Storing 010.2019.00000142.001 - 75 Johnson ST, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000141.001 - 19 Railway AV, MINNAMURRA, NSW 2533 Storing 010.2019.00000140.001 - 23 Bridges RD, GERRINGONG, NSW 2534 Storing 010.2019.00000139.001 - 19 Caliope ST, KIAMA, NSW 2533 Storing 010.2019.00000138.001 - 1 Beach ST, MINNAMURRA, NSW 2533 Storing 010.2019.00000136.001 - 2 Weir ST, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000137.001 - 2 Weir ST, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000134.001 - 3/65 Manning ST, KIAMA, NSW 2533 Storing 010.2019.00000131.001 - 8 Bass ST, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000132.001 - 45 Jerrara RD, JERRARA, NSW 2533 Storing 010.2019.00000128.001 - 72 Kalang RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000011.002 - 47 McBrien DR, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000133.001 - 17 Elanora RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000130.001 - 89 Fern ST, GERRINGONG, NSW 2534 Storing 010.2019.00000129.001 - 35 Elanora RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000125.001 - 40 Cullen DR, KIAMA DOWNS, NSW 2533 Storing 010.2017.00000331.002 - 43 Surfleet PL, KIAMA, NSW 2533 Storing 010.2019.00000126.001 - 36 Surfleet PL, KIAMA, NSW 2533 Storing 010.2018.00000106.002 - 16 Wilson AV, GERRINGONG, NSW 2534 Storing 010.2019.00000127.001 - 29 South Kiama DR, KIAMA HEIGHTS, NSW 2533 Collecting ATDIS feed data for upper_hunter... Storing 023.2007.00000924.002 - 48 Main ST, PARKVILLE, NSW 2337 Storing 023.2019.00002732.001 - Bobs Camp RD, GUNDY, NSW 2337 Storing 023.2019.00002731.001 - 2002 Hunter Rd, GUNDY, NSW 2337 Collecting ATDIS feed data for armidale... D, [2019-08-17T22:48:30.094394 #18] DEBUG -- : Fetching Storing 263329 - 45 Vernon Street, GUYRA, NSW 2365 Storing 263320 - 33 Old Inverell Road, ARMIDALE, NSW 2350 Storing 263339 - 152 Allingham Street, ARMIDALE, NSW 2350 Storing 263236 - 9 Oak Tree Drive, ARMIDALE, NSW 2350 Storing 263216 - 115 Beardy Street, ARMIDALE, NSW 2350 Storing 263206 - 166 Brown Street, ARMIDALE, NSW 2350 Storing 263186 - 100 Jessie Street, ARMIDALE, NSW 2350 Storing 263113 - 115 Beardy Street, ARMIDALE, NSW 2350 Storing 263061 - 4A Burgess Street, ARMIDALE, NSW 2350 Storing 262902 - 9 Lynches Road, ARMIDALE, NSW 2350 Storing 262872 - 10558 New England Highway, ARMIDALE, NSW 2350 Collecting ATDIS feed data for ashfield... Storing 010.2019.00000120.001 - 11 Lackey Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000121.001 - 155 Ramsay Street, HABERFIELD, NSW 2045 Storing 010.2019.00000119.001 - 2 Wellesley Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000118.001 - 1 Loftus Street, ASHFIELD, NSW 2131 Storing 010.2019.00000115.001 - 212 Hawthorne Parade, HABERFIELD, NSW 2045 Storing 010.2019.00000114.001 - 22 Hugh Street, ASHFIELD, NSW 2131 Storing 010.2019.00000113.001 - 23 Service Avenue, ASHFIELD, NSW 2131 Storing 010.2019.00000112.001 - 30 Stanton Road, HABERFIELD, NSW 2045 Storing 010.2017.00000234.002 - 17 Shepherd Street, ASHFIELD, NSW 2131 Storing 010.2015.00000136.002 - 72 Georges River Road, CROYDON PARK, NSW 2133 Collecting ATDIS feed data for leeton... leeton: ERROR: Failed to open TCP connection to 203.58.97.252:80 (Connection refused - connect(2) for "203.58.97.252" port 80) /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:101:in `timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:878:in `connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:863:in `do_start' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:852:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' Collecting ATDIS feed data for muswellbrook... D, [2019-08-17T22:48:38.447796 #18] DEBUG -- : Fetching https://datracker.muswellbrook.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 W, [2019-08-17T22:48:39.644503 #18] WARN -- : No/invalid pagination, assuming no records/aborting Storing 005.2019.00000069.001 - 26 Queen ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000068.001 - 9 Manning ST, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000043.001 - 132 Woodland Ridge RD, MUSCLE CREEK, NSW 2333 Storing 005.2019.00000067.001 - 420 Wybong P O RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000066.001 - 7 Calgaroo AVE, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000065.001 - 15 Strathmore RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000064.001 - 21 Paxton ST, DENMAN, NSW 2328 Storing 005.2019.00000063.001 - 1 Foley ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000061.001 - 119 Ironbark RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000062.001 - 96 Ironbark RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000060.001 - 8 Malbec ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000059.001 - 4 Sheppard AVE, MUSWELLBROOK, NSW 2333 Collecting ATDIS feed data for walgett... Collecting ATDIS feed data for newcastle... walgett: ERROR: Failed to open TCP connection to myhorizon.walgett.nsw.gov.au:80 (Connection refused - connect(2) for "myhorizon.walgett.nsw.gov.au" port 80) /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:101:in `timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:878:in `connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:863:in `do_start' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:852:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45. Collecting ATDIS feed data for bega_valley... Collecting ATDIS feed data for ballina... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:101:in `timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:878:in `connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:863:in `do_start' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:852:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' D, [2019-08-17T22:45:03.193904 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:45:16.595659 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=4 D, [2019-08-17T22:45:27.483317 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=5 D, [2019-08-17T22:45:39.425376 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=6 D, [2019-08-17T22:45:53.407636 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=7 D, [2019-08-17T22:46:03.259468 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=8 D, [2019-08-17T22:46:14.632302 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=9 D, [2019-08-17T22:46:26.516981 #18] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=10 D, [2019-08-17T22:46:37.308652 #18] DEBUG -- : Fetching Storing 018.2019.00005055.001 - 274 River ST, BALLINA, NSW 2478 Storing 010.2019.00000526.001 - 13 Calnan CR, CUMBALUM, NSW 2478 Storing 010.2019.00000398.002 - 15 Sandbreak CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000525.001 - 38 Calnan CR, CUMBALUM, NSW 2478 Storing 010.2019.00000524.001 - 91 Victoria Park RD, DALWOOD, NSW 2477 Storing 018.2019.00005057.001 - 44 Bangalow RD, BALLINA, NSW 2478 Storing 010.2019.00000486.001 - 29 Millbrook TCE, WOLLONGBAR, NSW 2477 Storing 010.2018.00000657.002 - 6 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000523.001 - 10 Taunton PL, WOLLONGBAR, NSW 2477 Storing 010.2019.00000512.001 - 50 Rifle Range RD, WOLLONGBAR, NSW 2477 Storing 010.2019.00000509.001 - 30 Sunray CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000510.001 - 5/8 Stewart ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000522.001 - 35 Pacific TCE, EAST BALLINA, NSW 2478 Storing 010.2019.00000521.001 - 741 Fernleigh RD, BROOKLET, NSW 2479 Storing 018.2019.00005040.001 - 15 Matilda ST, LENNOX HEAD, NSW 2478 Storing 010.2016.00000586.002 - 528 Uralba RD, URALBA, NSW 2477 Storing 010.2018.00000694.002 - 267 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000494.001 - 21 Grandview ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000507.001 - 225 Friday Hut RD, TINTENBAR, NSW 2478 Storing 010.2019.00000482.001 - 17 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000520.001 - 25 Sandbreak CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000519.001 - 23 Northcott CR, ALSTONVILLE, NSW 2477 Storing 010.2019.00000493.001 - 30 Bolwarra CCT, WOLLONGBAR, NSW 2477 Storing 010.2010.00000184.002 - 28 Summerhill CR, CUMBALUM, NSW 2478 Storing 010.2017.00000369.002 - 5 Jack PL, LENNOX HEAD, NSW 2478 Storing 010.2018.00000585.002 - 17-49 Owen ST, BALLINA, NSW 2478 Storing 010.2019.00000518.001 - 58 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000508.001 - 120 Kalinga ST, WEST BALLINA, NSW 2478 Storing 010.2019.00000516.001 - 53 Sproule DR, ALSTONVALE, NSW 2477 Storing 010.2019.00000515.001 - 16 Trelawney AVE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000513.001 - 528 Uralba RD, URALBA, NSW 2477 Storing 010.2019.00000514.001 - 45 Snapper DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000506.001 - 19 Quays DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000511.001 - 63 Seaswell CR, LENNOX HEAD, NSW 2478 Storing 010.2018.00000135.002 - 454 River DR, EMPIRE VALE, NSW 2478 Storing 010.2019.00000497.001 - 8 Suvla ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000517.001 - 35 Foresters WY, TINTENBAR, NSW 2478 Storing 010.2018.00000674.002 - 51 Greenfield RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000505.001 - 12 Cowrie St, LENNOX HEAD, NSW 2478 Storing 010.2019.00000499.001 - 35 Pine AVE, EAST BALLINA, NSW 2478 Storing 010.2018.00000545.002 - 58 Amber DR, LENNOX HEAD, NSW 2478 Storing 010.2017.00000203.002 - 21 McLeish RD, KINVARA, NSW 2478 Storing 018.2019.00005049.001 - 2-12 Greenwood PL, LENNOX HEAD, NSW 2478 Storing 018.2019.00005056.001 - 70 Scanlan LA, KINVARA, NSW 2478 Storing 010.2019.00000502.001 - 2-12 Greenwood PL, LENNOX HEAD, NSW 2478 Storing 010.2018.00000544.002 - 56 Amber DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000504.001 - 21 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000503.001 - 22 Morton WY, SKENNARS HEAD, NSW 2478 Storing 018.2019.00005052.001 - 92 Tamar ST, BALLINA, NSW 2478 Storing 010.2019.00000500.001 - 15 Leach CR, WEST BALLINA, NSW 2478 Storing 018.2019.00005046.001 - 5 Evelyn Villa DR, ALSTONVILLE, NSW 2477 Storing 010.2019.00000501.001 - 8 Rutherford ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000467.001 - 15 Eagle AVE, BALLINA, NSW 2478 Storing 010.2019.00000491.001 - 63 Alston AVE, ALSTONVILLE, NSW 2477 Storing 018.2019.00005048.001 - 90 Main ST, ALSTONVILLE, NSW 2477 Storing 010.2019.00000496.001 - 12 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2016.00000434.003 - 148 Old Byron Bay RD, NEWRYBAR, NSW 2479 Storing 010.2015.00000393.004 - 1 Grant ST, BALLINA, NSW 2478 Storing 010.2019.00000492.001 - 24 O'Rourke ST, CUMBALUM, NSW 2478 Storing 010.2019.00000487.001 - 1 Grant ST, BALLINA, NSW 2478 Storing 010.2019.00000481.001 - 801 Wardell RD, MEERSCHAUM VALE, NSW 2477 Storing 010.2019.00000488.001 - 32 Olivia CCT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000483.001 - 173 Rous RD, ROUS, NSW 2477 Storing 010.2019.00000484.001 - 237 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000480.001 - Teven RD, TEVEN, NSW 2478 Storing 010.2019.00000490.001 - 92 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000489.001 - 38 Liffey AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000477.001 - 1/5 Byron ST, LENNOX HEAD, NSW 2478 Storing 018.2019.00005051.001 - 84 Kerr ST, BALLINA, NSW 2478 Storing 010.2019.00000485.001 - 7 Scarlett CT, WOLLONGBAR, NSW 2477 Storing 010.2018.00000519.002 - 100 North Creek RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000475.001 - 1 Stonehenge PL, LENNOX HEAD, NSW 2478 Storing 010.2019.00000498.001 - 2 Jamie PL, BALLINA, NSW 2478 Storing 010.2019.00000472.001 - 20 Stonehenge PL, LENNOX HEAD, NSW 2478 Storing 010.2019.00000495.001 - 113 Nashua RD, FERNLEIGH, NSW 2479 Storing 018.2019.00005047.001 - 7 Osprey PL, EAST BALLINA, NSW 2478 Storing 010.2019.00000471.001 - 621 Pearces Creek RD, ALSTONVALE, NSW 2477 Storing 010.2013.00000432.002 - 2/44 Stewart ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000469.001 - 12 Killarney CR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000478.001 - 9 Casuarina RD, EAST BALLINA, NSW 2478 Storing 010.2019.00000476.001 - 9 Jameson AVE, EAST BALLINA, NSW 2478 Storing 010.2019.00000468.001 - 19 Quays DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000473.001 - 51 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000470.001 - 8 Smith ST, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000479.001 - 8 Cowrie St, LENNOX HEAD, NSW 2478 Storing 010.2019.00000465.001 - Teven RD, WEST BALLINA, NSW 2478 Storing 010.2019.00000474.001 - 12 Willie Wagtail PL, ALSTONVILLE, NSW 2477 Storing 010.2019.00000466.001 - 20 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000463.001 - 2/31 Silkwood RD, LENNOX HEAD, NSW 2478 Storing 010.2012.00000274.004 - 84 Kerr ST, BALLINA, NSW 2478 Storing 010.2019.00000462.001 - 80 Owenia WY, BROKEN HEAD, NSW 2481 Storing 010.2019.00000464.001 - 5 Blue Horizon DR, LENNOX HEAD, NSW 2478 Collecting ATDIS feed data for bathurst... D, [2019-08-17T22:46:44.117026 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:46:46.279326 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=4 D, [2019-08-17T22:46:48.153495 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=5 D, [2019-08-17T22:46:50.070457 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=6 D, [2019-08-17T22:46:52.193408 #18] DEBUG -- : Fetching Storing 018.2019.00000125.001 - 28 Darling ST, EGLINTON, NSW 2795 Storing 010.2019.00000208.001 - 56 Mendel DR, KELSO, NSW 2795 Storing 018.2019.00000124.001 - 32 Darling ST, EGLINTON, NSW 2795 Storing 018.2019.00000119.001 - 42 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000123.001 - 21 Quinn CT, LLANARTH, NSW 2795 Storing 010.2019.00000239.001 - 136 Bentinck ST, BATHURST, NSW 2795 Storing 010.2019.00000218.001 - 7 Parson CL, WEST BATHURST, NSW 2795 Storing 010.2019.00000237.001 - 20 Lord ST, BATHURST, NSW 2795 Storing 010.2019.00000238.001 - 268 Howards DR, MOUNT RANKIN, NSW 2795 Storing 010.2019.00000236.001 - 302 Howick ST, BATHURST, NSW 2795 Storing 010.2019.00000211.001 - 1119 Limekilns RD, CLEAR CREEK, NSW 2795 Storing 018.2019.00000122.001 - 56A Boyd ST, KELSO, NSW 2795 Storing 010.2019.00000233.001 - 20 Corporation AVE, ROBIN HILL, NSW 2795 Storing 010.2019.00000235.001 - 27 Oates PL, EGLINTON, NSW 2795 Storing 010.2019.00000234.001 - 3 Dovey DR, KELSO, NSW 2795 Storing 018.2019.00000117.001 - 1 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000103.001 - 13 Lew AVE, EGLINTON, NSW 2795 Storing 010.2019.00000229.001 - 47 Fitzroy ST, PEEL, NSW 2795 Storing 018.2019.00000116.001 - 32 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000232.001 - 48 Durham ST, BATHURST, NSW 2795 Storing 010.2019.00000231.001 - 13 Pit STGT, MOUNT PANORAMA, NSW 2795 Storing 010.2019.00000230.001 - 42 Lew AVE, EGLINTON, NSW 2795 Storing 010.2019.00000216.001 - 34 William ST, BATHURST, NSW 2795 Storing 018.2019.00000115.001 - 14 Saltram CCT, EGLINTON, NSW 2795 Storing 010.2018.00000480.002 - 224 William ST, BATHURST, NSW 2795 Storing 010.2019.00000228.001 - 273 George ST, BATHURST, NSW 2795 Storing 018.2019.00000101.001 - 56 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000227.001 - 4 Douglas CT, KELSO, NSW 2795 Storing 018.2019.00000111.001 - 64 Saint Johns RD, GEORGES PLAINS, NSW 2795 Storing 010.2019.00000226.001 - 282 Havannah ST, SOUTH BATHURST, NSW 2795 Storing 018.2019.00000102.001 - 17 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000225.001 - 31 Sunbright RD, KELSO, NSW 2795 Storing 010.2019.00000224.001 - 13 PJ Moodie DR, RAGLAN, NSW 2795 Storing 010.2019.00000223.001 - 37 Sunbright RD, KELSO, NSW 2795 Storing 010.2019.00000222.001 - 65 Westbourne DR, LLANARTH, NSW 2795 Storing 010.2019.00000217.001 - 14 Brennan DR, KELSO, NSW 2795 Storing 018.2019.00000113.001 - 11 Keystone RI, KELSO, NSW 2795 Storing 018.2019.00000114.001 - 4 Lyon CL, KELSO, NSW 2795 Storing 018.2019.00000112.001 - 5 Hyacinth WAY, LLANARTH, NSW 2795 Storing 010.2019.00000221.001 - 63 Westbourne DR, LLANARTH, NSW 2795 Storing 010.2019.00000220.001 - 62 Hamilton ST, EGLINTON, NSW 2795 Storing 010.2019.00000219.001 - 62 Hamilton ST, EGLINTON, NSW 2795 Storing 018.2019.00000110.001 - 2 Lyon CL, KELSO, NSW 2795 Storing 010.2019.00000215.001 - 3821 Limekilns RD, WATTLE FLAT, NSW 2795 Storing 010.2019.00000214.001 - 4419 Great Western HWY, WALANG, NSW 2795 Storing 010.2019.00000213.001 - 20 Arnold CT, KELSO, NSW 2795 Storing 010.2019.00000212.001 - 43 Fraser DR, EGLINTON, NSW 2795 Storing 018.2019.00000109.001 - 106 Graham DR, KELSO, NSW 2795 Storing 018.2019.00000107.001 - 462 Brewongle LA, GLANMIRE, NSW 2795 Storing 018.2019.00000108.001 - 1 Keystone RI, KELSO, NSW 2795 Storing 018.2019.00000104.001 - 17 Dovey DR, KELSO, NSW 2795 Storing 010.2019.00000153.002 - 72 Piper ST, BATHURST, NSW 2795 Storing 010.2019.00000210.001 - 414 Howick ST, BATHURST, NSW 2795 Storing 010.2019.00000209.001 - 93 Logan ST, EGLINTON, NSW 2795 Storing 010.2019.00000207.001 - 311 Gestingthorpe RD, COW FLAT, NSW 2795 Collecting ATDIS feed data for berrigan... Storing 19.20.DA.D6 - 21 KAMAROOKA STREET, BAROOGA, NSW 3644 Storing 20.20.DA.D9 - 3365 BAROOGA-TOCUMWAL ROAD, FINLEY, NSW 3644 Storing 17.20.DA.DM - 243 MCCULLOCHS ROAD, TOCUMWAL, NSW 2714 Storing 18.20.DA.DO - 83 NGAWE ROAD, BAROOGA, NSW 3644 Storing 14.20.DA.DM - 11 MURRAY STREET, BERRIGAN, NSW 2714 Storing 16.20.DA.D5 - 48 BUCHANANS ROAD, BAROOGA, NSW 3644 Storing 10.20.DA.D5 - 23 HOWE STREET, FINLEY, NSW 2713 Storing 11.20.DA.D3 - ENDEAVOUR STREET, FINLEY, NSW 2713 Storing 9.20.DA.DO - 60 MORRIS DRIVE, TOCUMWAL, NSW 2714 Storing 8.20.DA.DM - 33 MURRAY STREET, FINLEY, NSW 2713 Storing 7.20.DA.D1 - 119 NGAWE ROAD, BAROOGA, NSW 3644 Collecting ATDIS feed data for dubbo... D, [2019-08-17T22:47:09.236801 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:47:14.885534 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=4 D, [2019-08-17T22:47:19.525234 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=5 D, [2019-08-17T22:47:23.060595 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=6 D, [2019-08-17T22:47:26.390135 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=7 D, [2019-08-17T22:47:29.894872 #18] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=8 D, [2019-08-17T22:47:31.891602 #18] DEBUG -- : Fetching Storing 010.2019.00000374.001 - 13A Nanima CR, WELLINGTON, NSW 2820 Storing 010.2019.00000372.001 - 410 Fitzroy ST, DUBBO, NSW 2830 Storing 010.2019.00000378.001 - 18 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000380.001 - 128 Birch AVE, DUBBO, NSW 2830 Storing 010.2019.00000371.001 - 22 Wollomombi PDE, DUBBO, NSW 2830 Storing 010.2019.00000379.001 - 8 Dulhunty AVE, DUBBO, NSW 2830 Storing 010.2019.00000375.001 - 5 Villiers AVE, DUBBO, NSW 2830 Storing 010.2019.00000377.001 - 22 Nanima CR, WELLINGTON, NSW 2820 Storing 010.2019.00000373.001 - 3 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000369.001 - Talbragar ST, DUBBO, NSW 2830 Storing 010.2017.00000607.002 - Keswick PKWY, DUBBO, NSW 2830 Storing 010.2019.00000367.001 - Boyd AVE, DUBBO, NSW 2830 Storing 010.2019.00000343.001 - 110 Palmer ST, DUBBO, NSW 2830 Storing 016.2019.00000052.001 - 125-127 Erskine ST, DUBBO, NSW 2830 Storing 010.2019.00000339.001 - 30 Avon RD, NORTH YEOVAL, NSW 2868 Storing 010.2019.00000335.001 - 6586 Mitchell HWY, CUNDUMBUL, NSW 2866 Storing 010.2019.00000368.001 - 9 Quinn ST, DUBBO, NSW 2830 Storing 010.2019.00000345.001 - 31 Molong ST, STUART TOWN, NSW 2820 Storing 010.2019.00000334.001 - 89 Caves RD, APSLEY, NSW 2820 Storing 010.2019.00000325.001 - 711 Ponto Falls RD, MARYVALE, NSW 2820 Storing 010.2019.00000322.001 - 77-79 Wellington ST, GEURIE, NSW 2818 Storing 016.2019.00000051.001 - 6 Wave CT, DUBBO, NSW 2830 Storing 010.2010.00000053.004 - 42R Obley RD, DUBBO, NSW 2830 Storing 010.2019.00000366.001 - 15 Rhyana CT, DUBBO, NSW 2830 Storing 010.2019.00000365.001 - 17L Mayfield RD, DUBBO, NSW 2830 Storing 010.2019.00000352.001 - 88 Macquarie ST, DUBBO, NSW 2830 Storing 010.2019.00000346.001 - 16 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000364.001 - 3 Avalon PL, DUBBO, NSW 2830 Storing 010.2019.00000336.001 - 13L North Burrabadine RD, DUBBO, NSW 2830 Storing 010.2019.00000362.001 - 4 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000025.002 - 169 Boundary RD, DUBBO, NSW 2830 Storing 010.2018.00000648.002 - 5 Ivy CT, DUBBO, NSW 2830 Storing 010.2019.00000363.001 - 7 Lesmurdie PDE, DUBBO, NSW 2830 Storing 010.2019.00000337.001 - 17 Alder PL, DUBBO, NSW 2830 Storing 010.2019.00000347.001 - 8L Bulwarra DR, DUBBO, NSW 2830 Storing 016.2019.00000048.001 - 56 Church ST, DUBBO, NSW 2830 Storing 010.2019.00000349.001 - 17 Torryburn WY, DUBBO, NSW 2830 Storing 010.2019.00000361.001 - 7 Castlereagh AVE, DUBBO, NSW 2830 Storing 016.2019.00000050.001 - 6R Kurrajong DR, DUBBO, NSW 2830 Storing 010.2019.00000360.001 - 1 Lee ST, WELLINGTON, NSW 2820 Storing 010.2019.00000358.001 - 104 Gladstone RD, BODANGORA, NSW 2820 Storing 010.2019.00000359.001 - 4 Wave CT, DUBBO, NSW 2830 Storing 010.2018.00000569.002 - 30 Waterfall CRES, DUBBO, NSW 2830 Storing 010.2019.00000357.001 - 80R Lagoon Creek RD, MINORE, NSW 2830 Storing 010.2019.00000356.001 - 6 Cloonawillin CL, DUBBO, NSW 2830 Storing 010.2019.00000353.001 - 23 Cormorant CRES, DUBBO, NSW 2830 Storing 016.2019.00000047.001 - 15 Peel PL, DUBBO, NSW 2830 Storing 010.2019.00000342.001 - 46L Warrie RD, DUBBO, NSW 2830 Storing 010.2019.00000329.001 - 8R Burrabadine RD, DUBBO, NSW 2830 Storing 010.2019.00000350.001 - Gilgandra RD, DUBBO, NSW 2830 Storing 010.2019.00000348.001 - 15 Shetland AVE, DUBBO, NSW 2830 Storing 010.2019.00000351.001 - 12 Osborne PL, DUBBO, NSW 2830 Storing 010.2019.00000344.001 - 57 Talbragar ST, DUBBO, NSW 2830 Storing 010.2019.00000340.001 - 7 Turon CR, DUBBO, NSW 2830 Storing 010.2019.00000338.001 - 18 Blueridge DR, DUBBO, NSW 2830 Storing 010.2019.00000341.001 - 66R Cooreena RD, DUBBO, NSW 2830 Storing 016.2019.00000046.001 - 22-30 Whylandra ST, DUBBO, NSW 2830 Storing 010.2019.00000331.001 - 32 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000333.001 - 13 Macintyre CRCT, DUBBO, NSW 2830 Storing 010.2019.00000324.001 - 11 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000332.001 - 13A Nanima CR, WELLINGTON, NSW 2820 Storing 010.2019.00000328.001 - 70-72 Narragal ST, GEURIE, NSW 2818 Storing 010.2019.00000330.001 - 6L Delroy RD, MINORE, NSW 2830 Storing 010.2018.00000630.002 - 18 Jannali RD, DUBBO, NSW 2830 Storing 010.2019.00000327.001 - 37 Mitchell ST, GEURIE, NSW 2818 Storing 010.2019.00000326.001 - 10 Commercial AVE, DUBBO, NSW 2830 Storing 010.2019.00000323.001 - 3 Macgregor ST, DUBBO, NSW 2830 Collecting ATDIS feed data for kiama... D, [2019-08-17T22:48:01.993356 #18] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 D, [2019-08-17T22:48:06.408372 #18] DEBUG -- : Fetching Storing 010.2019.00000144.001 - 131 Riberry LANE, BROUGHTON VILLAGE, NSW 2534 Storing 010.2019.00000142.001 - 75 Johnson ST, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000141.001 - 19 Railway AV, MINNAMURRA, NSW 2533 Storing 010.2019.00000140.001 - 23 Bridges RD, GERRINGONG, NSW 2534 Storing 010.2019.00000139.001 - 19 Caliope ST, KIAMA, NSW 2533 Storing 010.2019.00000138.001 - 1 Beach ST, MINNAMURRA, NSW 2533 Storing 010.2019.00000136.001 - 2 Weir ST, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000137.001 - 2 Weir ST, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000134.001 - 3/65 Manning ST, KIAMA, NSW 2533 Storing 010.2019.00000131.001 - 8 Bass ST, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000132.001 - 45 Jerrara RD, JERRARA, NSW 2533 Storing 010.2019.00000128.001 - 72 Kalang RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000011.002 - 47 McBrien DR, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000133.001 - 17 Elanora RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000130.001 - 89 Fern ST, GERRINGONG, NSW 2534 Storing 010.2019.00000129.001 - 35 Elanora RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000125.001 - 40 Cullen DR, KIAMA DOWNS, NSW 2533 Storing 010.2017.00000331.002 - 43 Surfleet PL, KIAMA, NSW 2533 Storing 010.2019.00000126.001 - 36 Surfleet PL, KIAMA, NSW 2533 Storing 010.2018.00000106.002 - 16 Wilson AV, GERRINGONG, NSW 2534 Storing 010.2019.00000127.001 - 29 South Kiama DR, KIAMA HEIGHTS, NSW 2533 Collecting ATDIS feed data for upper_hunter... Storing 023.2007.00000924.002 - 48 Main ST, PARKVILLE, NSW 2337 Storing 023.2019.00002732.001 - Bobs Camp RD, GUNDY, NSW 2337 Storing 023.2019.00002731.001 - 2002 Hunter Rd, GUNDY, NSW 2337 Collecting ATDIS feed data for armidale... D, [2019-08-17T22:48:30.094394 #18] DEBUG -- : Fetching Storing 263329 - 45 Vernon Street, GUYRA, NSW 2365 Storing 263320 - 33 Old Inverell Road, ARMIDALE, NSW 2350 Storing 263339 - 152 Allingham Street, ARMIDALE, NSW 2350 Storing 263236 - 9 Oak Tree Drive, ARMIDALE, NSW 2350 Storing 263216 - 115 Beardy Street, ARMIDALE, NSW 2350 Storing 263206 - 166 Brown Street, ARMIDALE, NSW 2350 Storing 263186 - 100 Jessie Street, ARMIDALE, NSW 2350 Storing 263113 - 115 Beardy Street, ARMIDALE, NSW 2350 Storing 263061 - 4A Burgess Street, ARMIDALE, NSW 2350 Storing 262902 - 9 Lynches Road, ARMIDALE, NSW 2350 Storing 262872 - 10558 New England Highway, ARMIDALE, NSW 2350 Collecting ATDIS feed data for ashfield... Storing 010.2019.00000120.001 - 11 Lackey Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000121.001 - 155 Ramsay Street, HABERFIELD, NSW 2045 Storing 010.2019.00000119.001 - 2 Wellesley Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000118.001 - 1 Loftus Street, ASHFIELD, NSW 2131 Storing 010.2019.00000115.001 - 212 Hawthorne Parade, HABERFIELD, NSW 2045 Storing 010.2019.00000114.001 - 22 Hugh Street, ASHFIELD, NSW 2131 Storing 010.2019.00000113.001 - 23 Service Avenue, ASHFIELD, NSW 2131 Storing 010.2019.00000112.001 - 30 Stanton Road, HABERFIELD, NSW 2045 Storing 010.2017.00000234.002 - 17 Shepherd Street, ASHFIELD, NSW 2131 Storing 010.2015.00000136.002 - 72 Georges River Road, CROYDON PARK, NSW 2133 Collecting ATDIS feed data for leeton... leeton: ERROR: Failed to open TCP connection to 203.58.97.252:80 (Connection refused - connect(2) for "203.58.97.252" port 80) /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:101:in `timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:878:in `connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:863:in `do_start' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:852:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' Collecting ATDIS feed data for muswellbrook... D, [2019-08-17T22:48:38.447796 #18] DEBUG -- : Fetching https://datracker.muswellbrook.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-08-17&lodgement_date_start=2019-07-18&page=3 W, [2019-08-17T22:48:39.644503 #18] WARN -- : No/invalid pagination, assuming no records/aborting Storing 005.2019.00000069.001 - 26 Queen ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000068.001 - 9 Manning ST, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000043.001 - 132 Woodland Ridge RD, MUSCLE CREEK, NSW 2333 Storing 005.2019.00000067.001 - 420 Wybong P O RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000066.001 - 7 Calgaroo AVE, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000065.001 - 15 Strathmore RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000064.001 - 21 Paxton ST, DENMAN, NSW 2328 Storing 005.2019.00000063.001 - 1 Foley ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000061.001 - 119 Ironbark RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000062.001 - 96 Ironbark RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000060.001 - 8 Malbec ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000059.001 - 4 Sheppard AVE, MUSWELLBROOK, NSW 2333 Collecting ATDIS feed data for walgett... Collecting ATDIS feed data for newcastle... walgett: ERROR: Failed to open TCP connection to myhorizon.walgett.nsw.gov.au:80 (Connection refused - connect(2) for "myhorizon.walgett.nsw.gov.au" port 80) /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:882:in `rescue in block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:879:in `block in connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/timeout.rb:101:in `timeout' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:878:in `connect' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:863:in `do_start' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:852:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' newcastle: ERROR: 500 Internal Server Error E, [2019-08-17T22:50:11.575116 #18] ERROR -- : 500 Internal Server Error /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:223:in `exception_with_response' D, [2019-08-17T22:50:11.575235 #18] DEBUG -- : /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:223:in `exception_with_response' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:103:in `return!' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:103:in `return!' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:809:in `process_result' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:809:in `process_result' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:725:in `block in transmit' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:853:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:725:in `block in transmit' /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/net/http.rb:853:in `start' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:47:in `<main>' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' scraper.rb:66:in `<main>': There were earlier errors. See output for details (RuntimeError)

Data

Downloaded 1665 times by openaustralia DevAppProject mattykn

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (652 KB) Use the API

rows 10 / 1330

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to authority_label
010.2019.00000164.001
119 Lochview Farm RD, LOCHIEL, NSW 2549
Installation of above ground swimming pool
2019-06-06
2019-05-07
bega_valley
010.2012.00000402.002
5 Bells PL, DOCTOR GEORGE MOUNTAIN, NSW 2550
Modification Erection of a dwelling & detached garage/studio & carport
2019-06-06
2019-05-07
2019-05-23
2019-06-06
bega_valley
018.2019.00005032.001
10 Willie Wagtail PL, ALSTONVILLE, NSW 2477
PCA CDC - New Dwelling - Single Residence
2019-06-06
2019-05-07
ballina
010.2019.00000283.001
2/188-202 Southern Cross DR, BALLINA, NSW 2478
Change of Use and Alterations to Commercial Building Change of use from a high technology industry to general industry involving the assembly, manufacture and fitting of prosthetic limbs and alterations to the building
2019-06-06
2019-05-07
ballina
010.2019.00000284.001
84 Meridian DR, COOLGARDIE, NSW 2478
New Dwelling - Single Residence Construction of a two storey dwelling house and associated studio as depicted in plans by Dean Poile Designs for 64 Meridian Drive Coolgardie dated 2 May 2019
2019-06-06
2019-05-07
ballina
010.2019.00000139.001
141 Keppel ST, BATHURST, NSW 2795
Stage 1 - Five lot torens title subdivision (four residential lots and one development lot) Stage 2 - Seven lot strata title subdivision
2019-06-06
2019-05-07
bathurst
018.2019.00000051.001
10 Newlands CR, KELSO, NSW 2795
Construction of a Single storey dwelling with attached garage
2019-06-06
2019-05-07
bathurst
010.2019.00000138.001
82 Graham DR, KELSO, NSW 2795
Dual Occupancy and two lot residential subdivision
2019-06-06
2019-05-07
bathurst
010.2019.00000078.001
21 Boyd ST, MINNAMURRA, NSW 2533
dwelling & air conditioning unit
2019-06-06
2019-05-07
kiama
010.2019.00000080.001
133 Headland DR, GERROA, NSW 2534
detached storage shed
2019-06-06
2019-05-07
2019-05-23
2019-06-06
kiama

Statistics

Average successful run time: 6 minutes

Total run time: about 9 hours

Total cpu time used: 3 minutes

Total disk space used: 3.68 MB

History

  • Auto ran revision 987eb14c and failed .
    282 records added, 282 records removed in the database
  • Auto ran revision 987eb14c and failed .
    411 records added, 368 records removed in the database
  • Auto ran revision 987eb14c and failed .
    393 records added, 389 records removed in the database
  • Auto ran revision 987eb14c and failed .
    401 records added, 384 records removed in the database
  • Auto ran revision 987eb14c and failed .
    386 records added, 374 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_atdis / scraper.rb