planningalerts-scrapers / multiple_atdis

Scrapes multiple authorities that have ATDIS feed


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git  Fetching concurrent-ruby 1.1.5  Fetching minitest 5.11.3  Fetching thread_safe 0.3.6  Installing minitest 5.11.3  Installing thread_safe 0.3.6  Fetching public_suffix 3.1.0  Installing concurrent-ruby 1.1.5  Installing public_suffix 3.1.0  Fetching multi_json 1.13.1  Installing multi_json 1.13.1  Fetching unf_ext 0.0.7.6  Fetching mime-types-data 3.2019.0331  Installing unf_ext 0.0.7.6 with native extensions  Installing mime-types-data 3.2019.0331  Fetching netrc 0.11.0  Fetching rgeo 2.0.1  Installing netrc 0.11.0  Fetching httpclient 2.8.3  Installing rgeo 2.0.1 with native extensions  Installing httpclient 2.8.3  Fetching sqlite3 1.4.1  Installing sqlite3 1.4.1 with native extensions  Using bundler 1.15.2  Fetching safe_yaml 1.0.5  Installing safe_yaml 1.0.5  Fetching hashdiff 0.4.0  Installing hashdiff 0.4.0  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching tzinfo 1.2.5  Installing tzinfo 1.2.5  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching i18n 1.6.0  Installing i18n 1.6.0  Fetching mime-types 3.2.2  Fetching unf 0.1.4  Installing mime-types 3.2.2  Installing unf 0.1.4  Fetching crack 0.4.3  Fetching rgeo-geojson 2.1.1  Installing rgeo-geojson 2.1.1  Fetching activesupport 5.2.3  Installing crack 0.4.3  Installing activesupport 5.2.3  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching webmock 3.6.0  Installing webmock 3.6.0  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching activemodel 5.2.3  Installing activemodel 5.2.3  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching atdis 0.4.1  Installing atdis 0.4.1  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching scraperwiki 3.0.2  Installing scraperwiki 3.0.2  Fetching scraperwiki-morph 0.1.1  Installing scraperwiki-morph 0.1.1  Using atdisplanningalertsfeed 0.1.0 from git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git (at master@a7a7ce7)  Bundle complete! 4 Gemfile dependencies, 34 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from i18n:  HEADS UP! i18n 1.1 changed fallbacks to exclude default locale.  But that may break your application.  Please check your Rails app for 'config.i18n.fallbacks = true'.  If you're using I18n (>= 1.1.0) and Rails (< 5.2.2), this should be  'config.i18n.fallbacks = [I18n.default_locale]'.  If not, fallbacks will be broken in your app by I18n 1.1.x.  For more info see:  https://github.com/svenfuchs/i18n/releases/tag/v1.1.0  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (18.83s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting configuration and compiling... Injecting scraper and running... The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45. Collecting ATDIS feed data for bega_valley... D, [2019-12-06T03:25:30.705958 #16] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=3 D, [2019-12-06T03:25:40.937002 #16] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=4 D, [2019-12-06T03:25:50.965149 #16] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=5 D, [2019-12-06T03:26:02.693688 #16] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=6 D, [2019-12-06T03:26:14.868449 #16] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=7 W, [2019-12-06T03:26:15.283157 #16] WARN -- : No/invalid pagination, assuming no records/aborting Storing 010.2019.00000412.001 - 3052 Princes HWY, MILLINGANDI, NSW 2549 Storing 010.2019.00000425.001 - 405 Warrigal Range RD, BROGO, NSW 2550 Storing 010.2019.00000419.001 - 3 Market ST, MERIMBULA, NSW 2548 Storing 010.2019.00000421.001 - 10 Seaview AVE, MERIMBULA, NSW 2548 Storing 010.2019.00000422.001 - Tathra Bermagui RD, NELSON, NSW 2550 Storing 010.2019.00000408.001 - 2 Wave ST, EDEN, NSW 2551 Storing 010.2019.00000403.001 - 409 Wandella RD, COBARGO, NSW 2550 Storing 010.2019.00000102.002 - 58 Lakeview AVE, MERIMBULA, NSW 2548 Storing 010.2019.00000407.001 - 1/1 Dunns LA, MERIMBULA, NSW 2548 Storing 010.2019.00000410.001 - 38 Max Slater DR, BEGA, NSW 2550 Storing 010.2019.00000423.001 - 7 Keating DR, BERMAGUI, NSW 2546 Storing 010.2016.00000457.004 - 10380 Princes HWY, COBARGO, NSW 2550 Storing 010.2019.00000404.001 - 4 Kurrajong CR, KALARU, NSW 2550 Storing 010.2019.00000299.002 - 17 Millowine LA, BEGA, NSW 2550 Storing 010.2019.00000418.001 - 46 Ridge RD, COOLAGOLITE, NSW 2550 Storing 010.2019.00000420.001 - 57 Dilkera RD, TATHRA, NSW 2550 Storing 010.2015.00000278.002 - Reedy Swamp RD, REEDY SWAMP, NSW 2550 Storing 010.2018.00000085.002 - 25 Scott ST, WOLUMLA, NSW 2550 Storing 010.2019.00000417.001 - 10 Kowara CR, MERIMBULA, NSW 2548 Storing 010.2019.00000405.001 - 14 Kurrajong CR, KALARU, NSW 2550 Storing 010.2019.00000406.001 - 66 Bournda CCT, TURA BEACH, NSW 2548 Storing 010.2019.00000402.001 - 1934 Big Jack Mountain RD, ROCKY HALL, NSW 2550 Storing 010.2019.00000392.001 - 7 Gannet CT, MIRADOR, NSW 2548 Storing 010.2018.00000206.002 - 9 Cemetery RD, CANDELO, NSW 2550 Storing 010.2019.00000416.001 - 293 Head Of Cuttagee RD, CUTTAGEE, NSW 2546 Storing 010.2019.00000409.001 - 6 Bay View DR, TATHRA, NSW 2550 Storing 010.2019.00000411.001 - 63 The Crest, MIRADOR, NSW 2548 Storing 010.2019.00000415.001 - 19 Oaklands RD, PAMBULA, NSW 2549 Storing 010.2019.00000413.001 - 16 Jacaranda RD, MIRADOR, NSW 2548 Storing 010.2019.00000414.001 - 41 Lynjohn DR, BEGA, NSW 2550 Storing 010.2019.00000401.001 - Pambula Beach RD, PAMBULA, NSW 2549 Storing 010.2019.00000394.001 - 1/14 Golf CCT, TURA BEACH, NSW 2548 Storing 010.2019.00000400.001 - 55 Princes HWY, COBARGO, NSW 2550 Storing 010.2019.00000399.001 - 5 Bay ST, TATHRA, NSW 2550 Storing 010.2019.00000398.001 - 130 Bournda RD, WALLAGOOT, NSW 2550 Storing 010.2019.00000397.001 - 69 Lakewood DR, MERIMBULA, NSW 2548 Storing 010.2019.00000396.001 - 1576 Tathra Bermagui RD, TANJA, NSW 2550 Storing 010.2019.00000395.001 - Francis RD, PAMBULA, NSW 2549 Storing 010.2018.00000476.003 - 157 Black Marlin DR, BERMAGUI, NSW 2546 Storing 010.2019.00000057.002 - 4 Kangaroo Run, TURA BEACH, NSW 2548 Storing 018.2019.00002108.001 - 2 Merimbula DR, MERIMBULA, NSW 2548 Storing 010.2019.00000178.002 - 76 Applegum CL, BEGA, NSW 2550 Storing 010.2019.00000387.001 - 28 Sapphire Coast DR, MERIMBULA, NSW 2548 Storing 010.2019.00000388.001 - Bay View DR, TATHRA, NSW 2550 Storing 010.2019.00000393.001 - 2 Peden ST, BEGA, NSW 2550 Storing 010.2019.00000391.001 - 139 O'Shea RD, MURRAH, NSW 2546 Storing 010.2019.00000390.001 - 92 Woodlands LA, MILLINGANDI, NSW 2549 Storing 010.2019.00000389.001 - 4C Guboo PL, BERMAGUI, NSW 2546 Storing 010.2017.00000135.003 - 27 Whittles RD, WAPENGO, NSW 2550 Storing 010.2014.00000389.002 - 41 Narira Park LA, COBARGO, NSW 2550 Collecting ATDIS feed data for ballina... D, [2019-12-06T03:26:34.394127 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=3 D, [2019-12-06T03:26:47.588805 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=4 D, [2019-12-06T03:26:58.378167 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=5 D, [2019-12-06T03:27:11.231663 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=6 D, [2019-12-06T03:27:23.730310 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=7 D, [2019-12-06T03:27:34.279175 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=8 D, [2019-12-06T03:27:45.815025 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=9 D, [2019-12-06T03:27:58.772935 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=10 D, [2019-12-06T03:28:10.904179 #16] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=11 D, [2019-12-06T03:28:17.296782 #16] DEBUG -- : Fetching Storing 010.2019.00000778.001 - 9 Rutherford ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000750.001 - 3 Tipperary PL, BALLINA, NSW 2478 Storing 010.2019.00000243.002 - 25 Burnet ST, BALLINA, NSW 2478 Storing 010.2019.00000776.001 - 38 De-Havilland CR, BALLINA, NSW 2478 Storing 010.2018.00000301.003 - 28 Old Byron Bay RD, NEWRYBAR, NSW 2479 Storing 010.2019.00000759.001 - 10 Wattle CR, EAST BALLINA, NSW 2478 Storing 010.2019.00000757.001 - 2 Triton St, LENNOX HEAD, NSW 2478 Storing 010.2019.00000777.001 - 4 Hoop Pine CT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000775.001 - 4 Maple DR, ALSTONVILLE, NSW 2477 Storing 010.2019.00000773.001 - 45 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000772.001 - 9 Alexander CCT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000770.001 - 13 Byron ST, LENNOX HEAD, NSW 2478 Storing 018.2019.00005097.001 - 19 The Avenue, ALSTONVILLE, NSW 2477 Storing 010.2019.00000769.001 - 9 Teal St, BALLINA, NSW 2478 Storing 010.2019.00000599.002 - Riverside DR, WEST BALLINA, NSW 2478 Storing 018.2019.00005100.001 - 3 Eclipse CR, CUMBALUM, NSW 2478 Storing 010.2019.00000768.001 - 15 Karalauren CT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000767.001 - 32 Spring Creek PL, WOLLONGBAR, NSW 2477 Storing 010.2019.00000762.001 - 249 Moylans LA, EMPIRE VALE, NSW 2478 Storing 010.2019.00000755.001 - 9 Dolphin DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000350.002 - 195 Old Byron Bay RD, NEWRYBAR, NSW 2479 Storing 010.2019.00000502.002 - 2-12 Greenwood PL, LENNOX HEAD, NSW 2478 Storing 010.2018.00000130.004 - 15 Karalauren CT, LENNOX HEAD, NSW 2478 Storing 010.2018.00000054.002 - 7 Jabiru PL, EAST BALLINA, NSW 2478 Storing 010.2011.00000358.005 - 23 North Creek RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000774.001 - 38 Catherine CR, BALLINA, NSW 2478 Storing 010.2019.00000766.001 - 25 Kellie-Ann CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000728.001 - 211A Ballina RD, ALSTONVILLE, NSW 2477 Storing 010.2019.00000763.001 - 8 Brooklet RD, NEWRYBAR, NSW 2479 Storing 010.2019.00000760.001 - North Teven RD, TEVEN, NSW 2478 Storing 010.2019.00000756.001 - 16 Grandview ST, EAST BALLINA, NSW 2478 Storing 018.2019.00005088.001 - 2/97 Tamar ST, BALLINA, NSW 2478 Storing 010.2019.00000725.001 - 40 Avalon AVE, WOLLONGBAR, NSW 2477 Storing 018.2019.00005093.001 - 1 Dorset PL, WOLLONGBAR, NSW 2477 Storing 010.2019.00000761.001 - 64 Pine AVE, EAST BALLINA, NSW 2478 Storing 010.2019.00000743.001 - 586 River St, WEST BALLINA, NSW 2478 Storing 010.2019.00000758.001 - 4 Ambrose LA, ALSTONVILLE, NSW 2477 Storing 010.2019.00000771.001 - 30 River DR, EAST WARDELL, NSW 2477 Storing 010.2019.00000754.001 - 2/29 Bayview DR, EAST BALLINA, NSW 2478 Storing 018.2019.00005091.001 - 31 Summerhill CR, CUMBALUM, NSW 2478 Storing 018.2019.00005086.001 - 4 Willie Wagtail PL, ALSTONVILLE, NSW 2477 Storing 010.2019.00000735.001 - 249 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000765.001 - 167 Rous RD, ROUS, NSW 2477 Storing 018.2019.00005090.001 - 63-65 Ballina ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000751.001 - 39 Outrigger RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000748.001 - 62 Horizon DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000764.001 - 43 Pacific PDE, LENNOX HEAD, NSW 2478 Storing 010.2019.00000752.001 - 3 Stonehenge PL, LENNOX HEAD, NSW 2478 Storing 010.2016.00000146.002 - 38 Cliff Murray LA, LENNOX HEAD, NSW 2478 Storing 018.2019.00005099.001 - 16 Millbrook TCE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000745.001 - 603 Teven RD, TEVEN, NSW 2478 Storing 010.2019.00000753.001 - 14 Dent CR, CUMBALUM, NSW 2478 Storing 010.2019.00000719.001 - 97 Burns Point Ferry RD, WEST BALLINA, NSW 2478 Storing 010.2019.00000749.001 - 42 Avalon AVE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000747.001 - 197 Moylans LA, EMPIRE VALE, NSW 2478 Storing 010.2019.00000746.001 - 26 Boeing AVE, BALLINA, NSW 2478 Storing 010.2019.00000741.001 - 407 Fernleigh RD, FERNLEIGH, NSW 2479 Storing 010.2019.00000742.001 - 486 Gap RD, ALSTONVILLE, NSW 2477 Storing 010.2019.00000740.001 - 35 Waterford PDE, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000736.001 - 16 Tara DWN, LENNOX HEAD, NSW 2478 Storing 010.2019.00000739.001 - 8 Lawrence RI, CUMBALUM, NSW 2478 Storing 010.2018.00000673.003 - 1/61 Dress Circle DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000737.001 - 55 Teven RD, ALSTONVILLE, NSW 2477 Storing 010.2018.00000130.003 - 15 Karalauren CT, LENNOX HEAD, NSW 2478 Storing 010.2018.00000711.003 - 20 Camoola AVE, BALLINA, NSW 2478 Storing 010.2019.00000738.001 - 12 Megan CR, LENNOX HEAD, NSW 2478 Storing 010.2018.00000439.002 - 20 Newport ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000729.001 - 74 De-Havilland CR, BALLINA, NSW 2478 Storing 010.2019.00000733.001 - 89 Chickiba DR, EAST BALLINA, NSW 2478 Storing 010.2019.00000329.002 - 13 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000734.001 - 2/8 Sunrise CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000717.001 - 84 Kerr ST, BALLINA, NSW 2478 Storing 010.2019.00000732.001 - 13 Angus Kennedy CL, LENNOX HEAD, NSW 2478 Storing 010.2016.00000110.002 - 58 Fenwick DR, EAST BALLINA, NSW 2478 Storing 010.2019.00000731.001 - 37 Outrigger RD, LENNOX HEAD, NSW 2478 Storing 010.2018.00000703.002 - 10 Kirklands LA, TEVEN, NSW 2478 Storing 010.2019.00000744.001 - 486 Gap RD, ALSTONVILLE, NSW 2477 Storing 010.2018.00000385.002 - 5 Cedar CR, EAST BALLINA, NSW 2478 Storing 010.2017.00000313.004 - 40 Blue Seas PDE, LENNOX HEAD, NSW 2478 Storing 010.2019.00000730.001 - 16 Ahern CCT, CUMBALUM, NSW 2478 Storing 010.2017.00000329.002 - 6A Pinehurst CT, ALSTONVILLE, NSW 2477 Storing 018.2019.00005096.001 - 2/97 Tamar ST, BALLINA, NSW 2478 Storing 018.2019.00005085.001 - 2A Eclipse CR, CUMBALUM, NSW 2478 Storing 018.2019.00005082.001 - 63 Seaswell CR, LENNOX HEAD, NSW 2478 Storing 018.2019.00005095.001 - 329 River ST, BALLINA, NSW 2478 Storing 010.2019.00000727.001 - 16 Scarlett CT, WOLLONGBAR, NSW 2477 Storing 010.2019.00000724.001 - 38-50 Swift ST, BALLINA, NSW 2478 Storing 010.2019.00000721.001 - 10 Hamilton LA, BALLINA, NSW 2478 Storing 010.2019.00000720.001 - 11 Fern ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000107.002 - 59 Fig Tree Hill DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000722.001 - 6 Vera PL, BALLINA, NSW 2478 Storing 010.2019.00000723.001 - 10 Tidepool ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000716.001 - 11 Martin ST, BALLINA, NSW 2478 Storing 018.2019.00005092.001 - 70 Fig Tree Hill DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000726.001 - 29 Jameson AVE, EAST BALLINA, NSW 2478 Storing 010.2019.00000714.001 - 53 Waterford PDE, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000718.001 - 2/44 Stewart ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000713.001 - 100 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 018.2019.00005087.001 - 14 Millbrook TCE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000715.001 - 132 Pine ST, WARDELL, NSW 2477 Storing 018.2019.00005084.001 - 26 Boeing AVE, BALLINA, NSW 2478 Collecting ATDIS feed data for bathurst... D, [2019-12-06T03:28:27.247869 #16] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=3 D, [2019-12-06T03:28:30.042254 #16] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=4 D, [2019-12-06T03:28:33.072994 #16] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=5 D, [2019-12-06T03:28:37.353337 #16] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=6 D, [2019-12-06T03:28:41.245762 #16] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=7 D, [2019-12-06T03:28:43.528443 #16] DEBUG -- : Fetching Storing 018.2019.00000197.001 - 54 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000383.001 - 134 George ST, BATHURST, NSW 2795 Storing 018.2019.00000195.001 - 50 Newlands CR, KELSO, NSW 2795 Storing 010.2019.00000367.001 - 105 Stewart ST, BATHURST, NSW 2795 Storing 010.2019.00000381.001 - 123 Graham DR, KELSO, NSW 2795 Storing 010.2019.00000353.001 - 2 Peard CL, EGLINTON, NSW 2795 Storing 010.2019.00000377.001 - 29 Jagoe DR, KELSO, NSW 2795 Storing 010.2019.00000375.001 - 24 Pryce PDE, ABERCROMBIE, NSW 2795 Storing 018.2019.00000196.001 - 97 Graham DR, KELSO, NSW 2795 Storing 010.2019.00000349.001 - 143 Brilliant ST, BATHURST, NSW 2795 Storing 010.2019.00000373.001 - 4/108 William ST, BATHURST, NSW 2795 Storing 010.2019.00000365.001 - 144 Rankin ST, BATHURST, NSW 2795 Storing 010.2019.00000380.001 - 8 Christie ST, RAGLAN, NSW 2795 Storing 018.2019.00000194.001 - 27 Dovey DR, KELSO, NSW 2795 Storing 010.2019.00000360.001 - 7 Lee ST, KELSO, NSW 2795 Storing 018.2019.00000193.001 - 72 Hamilton ST, EGLINTON, NSW 2795 Storing 010.2019.00000359.001 - 13 Windemere RD, ROBIN HILL, NSW 2795 Storing 010.2019.00000358.001 - 78 Graham DR, KELSO, NSW 2795 Storing 010.2019.00000379.001 - 5475 Great Western HWY, RAGLAN, NSW 2795 Storing 018.2019.00000189.001 - 31 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000183.001 - 3 Darvall DR, KELSO, NSW 2795 Storing 010.2019.00000378.001 - 457 Conrod STGT, MOUNT PANORAMA, NSW 2795 Storing 018.2019.00000191.001 - 23 Dovey DR, KELSO, NSW 2795 Storing 010.2019.00000374.001 - 505 Conrod STGT, MOUNT PANORAMA, NSW 2795 Storing 010.2019.00000372.001 - 32 Lew AVE, EGLINTON, NSW 2795 Storing 010.2019.00000243.002 - 32 Lew AVE, EGLINTON, NSW 2795 Storing 010.2019.00000371.001 - 103 Bant ST, SOUTH BATHURST, NSW 2795 Storing 018.2019.00000190.001 - 4 Bolton ST, KELSO, NSW 2795 Storing 018.2019.00000188.001 - 4 Darvall DR, KELSO, NSW 2795 Storing 010.2019.00000370.001 - 2992 O'Connell RD, O'CONNELL, NSW 2795 Storing 010.2019.00000369.001 - 166A William ST, BATHURST, NSW 2795 Storing 010.2019.00000368.001 - 1 Vista PL, WHITE ROCK, NSW 2795 Storing 018.2019.00000185.001 - 11 Connolly DR, KELSO, NSW 2795 Storing 010.2017.00000383.002 - 1 Morgan PL, LLANARTH, NSW 2795 Storing 010.2019.00000361.001 - 15 Boyd ST, KELSO, NSW 2795 Storing 010.2019.00000366.001 - 60 Corporation AVE, ROBIN HILL, NSW 2795 Storing 010.2019.00000364.001 - 6 Corporation AVE, ROBIN HILL, NSW 2795 Storing 010.2019.00000362.001 - Havannah ST, BATHURST, NSW 2795 Storing 010.2016.00000437.002 - 58 Dempsey ST, PEEL, NSW 2795 Storing 018.2019.00000186.001 - 8 Darvall DR, KELSO, NSW 2795 Storing 010.2019.00000363.001 - 7 Cousins PL, WINDRADYNE, NSW 2795 Storing 018.2019.00000184.001 - 29 Barker CCT, KELSO, NSW 2795 Storing 010.2019.00000356.001 - 1554 Turondale RD, MILLAH MURRAH, NSW 2795 Storing 010.2017.00000221.003 - 2 Matthews ST, WINDRADYNE, NSW 2795 Storing 010.2019.00000350.001 - 17 Suttor ST, WEST BATHURST, NSW 2795 Storing 018.2019.00000182.001 - 11 Katandra PL, KELSO, NSW 2795 Storing 010.2019.00000357.001 - 1 Connolly DR, KELSO, NSW 2795 Storing 010.2019.00000355.001 - 67 Havannah ST, BATHURST, NSW 2795 Storing 018.2019.00000178.001 - 63 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000181.001 - 7 Connolly DR, KELSO, NSW 2795 Storing 010.2019.00000352.001 - 10 Collins CL, KELSO, NSW 2795 Storing 010.2019.00000354.001 - 2 Fairleigh PL, KELSO, NSW 2795 Storing 018.2019.00000179.001 - 2 Fairleigh PL, KELSO, NSW 2795 Storing 010.2019.00000348.001 - 133 George ST, BATHURST, NSW 2795 Storing 018.2019.00000177.001 - 18 Gell PL, ABERCROMBIE, NSW 2795 Storing 010.2019.00000351.001 - 63 Landseer ST, RAGLAN, NSW 2795 Storing 018.2019.00000176.001 - 1404 Freemantle RD, WATTON, NSW 2795 Collecting ATDIS feed data for berrigan... Storing 80.20.DA.D1 - 2577 MURRAY STREET, FINLEY, NSW 2646 Storing 83.20.DA.DM - 8 DENILIQUIN STREET, TOCUMWAL, NSW 2714 Storing 82.20.DA.D2 - 239 MURRAY STREET, FINLEY, NSW 2713 Storing 81.20.DA.D5 - 17 BAROOGA STREET, BERRIGAN, NSW 2714 Storing 79.20.DA.D8 - 1 MURRAY STREET, FINLEY, NSW 2714 Storing 75.20.DA.D5 - 5 MALONE MEWS, FINLEY, NSW 2713 Storing 74.20.DA.D5 - 22 ANTHONY AVENUE, FINLEY, NSW 2714 Storing 77.20.DA.D1 - 4 BUSHLANDS ROAD, FINLEY, NSW 2714 Storing 73.20.DA.D5 - 8 RIVERVIEW COURT, BAROOGA, NSW 3644 Storing 71.20.DA.D1 - (NO NAME) (NO TYPE), FINLEY, NSW 2713 Storing 72.20.DA.DO - 134 BRUNKER STREET, BERRIGAN, NSW 2712 Storing 70.20.DA.D5 - 36 TUPPAL STREET, FINLEY, NSW 2713 Storing 69.20.DA.D1 - 1 RIVERVIEW COURT, FINLEY, NSW 3644 Storing 68.20.DA.D5 - 56 MURRAY STREET, TOCUMWAL, NSW 2714 Collecting ATDIS feed data for dubbo... D, [2019-12-06T03:28:54.672997 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=3 D, [2019-12-06T03:28:58.446453 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=4 D, [2019-12-06T03:29:01.867643 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=5 D, [2019-12-06T03:29:05.689575 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=6 D, [2019-12-06T03:29:09.032808 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=7 D, [2019-12-06T03:29:12.488295 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=8 D, [2019-12-06T03:29:16.200328 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=9 D, [2019-12-06T03:29:19.570431 #16] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=10 D, [2019-12-06T03:29:21.221240 #16] DEBUG -- : Fetching Storing 010.2019.00000596.001 - 56 Windsor PDE, DUBBO, NSW 2830 Storing 010.2019.00000603.001 - 2 Kings Park WY, DUBBO, NSW 2830 Storing 010.2019.00000602.001 - 3 Houston DR, DUBBO, NSW 2830 Storing 010.2019.00000601.001 - 24 Champagne DR, DUBBO, NSW 2830 Storing 010.2019.00000600.001 - 31 Merrilea RD, DUBBO, NSW 2830 Storing 010.2019.00000566.001 - 12A Bundemar ST, WONGARBON, NSW 2831 Storing 016.2019.00000093.001 - 56 Windsor PDE, DUBBO, NSW 2830 Storing 010.2019.00000589.001 - 4 Marine CT, DUBBO, NSW 2830 Storing 010.2018.00000056.002 - 10 Commercial AVE, DUBBO, NSW 2830 Storing 010.2019.00000599.001 - 27 Augusta AVE, DUBBO, NSW 2830 Storing 010.2017.00000221.002 - 4-30 Cobbora RD, DUBBO, NSW 2830 Storing 010.2019.00000587.001 - 11L Pinedale RD, DUBBO, NSW 2830 Storing 010.2019.00000598.001 - 22 Boyd AVE, DUBBO, NSW 2830 Storing 010.2019.00000591.001 - Strathmore RD, BENOLONG, NSW 2818 Storing 010.2019.00000597.001 - 31 Catherine DR, DUBBO, NSW 2830 Storing 010.2019.00000595.001 - 15 Sandringham PL, DUBBO, NSW 2830 Storing 010.2019.00000594.001 - 8 Cyril Towers ST, DUBBO, NSW 2830 Storing 010.2019.00000592.001 - 56 Boundary RD, DUBBO, NSW 2830 Storing 016.2019.00000091.001 - 23 Ivy CT, DUBBO, NSW 2830 Storing 016.2019.00000092.001 - 20 Ivy CT, DUBBO, NSW 2830 Storing 010.2019.00000593.001 - 5 Lesmurdie PDE, DUBBO, NSW 2830 Storing 016.2019.00000090.001 - 19 Ivy CT, DUBBO, NSW 2830 Storing 016.2019.00000089.001 - 27 Ivy CT, DUBBO, NSW 2830 Storing 016.2019.00000088.001 - 9 Turon CR, DUBBO, NSW 2830 Storing 010.2019.00000556.001 - 10 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000588.001 - 32 Waterfall CRES, DUBBO, NSW 2830 Storing 010.2019.00000590.001 - 26L Angle RD, DUBBO, NSW 2830 Storing 016.2019.00000081.002 - 6 Turon CR, DUBBO, NSW 2830 Storing 016.2019.00000087.001 - 2 Drysdale CL, DUBBO, NSW 2830 Storing 016.2019.00000082.001 - 8 Bayou AVE, DUBBO, NSW 2830 Storing 010.2018.00000257.002 - 1R Old Dubbo RD, DUBBO, NSW 2830 Storing 010.2019.00000579.001 - 115-129 Lee ST, WELLINGTON, NSW 2820 Storing 010.2019.00000585.001 - 69 Holmwood DR, DUBBO, NSW 2830 Storing 010.2019.00000580.001 - 13 Snowy CR, DUBBO, NSW 2830 Storing 010.2019.00000586.001 - 10 Lesmurdie PDE, DUBBO, NSW 2830 Storing 010.2019.00000578.001 - 174 Darling ST, DUBBO, NSW 2830 Storing 010.2019.00000561.001 - 8 Bell ST, STUART TOWN, NSW 2820 Storing 010.2019.00000550.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000549.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000531.001 - 29 Alcheringa ST, DUBBO, NSW 2830 Storing 010.2019.00000548.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000536.001 - 12 Sandringham PL, DUBBO, NSW 2830 Storing 010.2019.00000582.001 - 47 Lee ST, WELLINGTON, NSW 2820 Storing 010.2019.00000547.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000545.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 016.2019.00000083.001 - 29 Walker CR, WELLINGTON, NSW 2820 Storing 010.2019.00000544.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000543.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000555.001 - 2 Sherrard CRES, DUBBO, NSW 2830 Storing 010.2019.00000542.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000568.001 - Johnson ST, DUBBO, NSW 2830 Storing 010.2019.00000571.001 - Johnson ST, DUBBO, NSW 2830 Storing 010.2019.00000575.001 - 1A Nanima CR, WELLINGTON, NSW 2820 Storing 016.2019.00000086.001 - 52 Champagne DR, DUBBO, NSW 2830 Storing 010.2019.00000541.001 - 40 Morgan ST, DUBBO, NSW 2830 Storing 010.2019.00000584.001 - 21R Bulwarra DR, DUBBO, NSW 2830 Storing 016.2019.00000085.001 - 6 Drysdale CL, DUBBO, NSW 2830 Storing 010.2019.00000581.001 - 6 Tudor PL, DUBBO, NSW 2830 Storing 010.2019.00000583.001 - 6 Ballindoch PL, DUBBO, NSW 2830 Storing 010.2019.00000574.001 - 155 Darling ST, DUBBO, NSW 2830 Storing 010.2019.00000577.001 - 149 Wingewarra ST, DUBBO, NSW 2830 Storing 010.2019.00000570.001 - 58 Raymond ST, WELLINGTON, NSW 2820 Storing 010.2019.00000576.001 - 144 Brisbane ST, DUBBO, NSW 2830 Storing 010.2019.00000557.001 - 5 Arthur ST, DUBBO, NSW 2830 Storing 010.2019.00000532.001 - 175 Bunglegumbie RD, DUBBO, NSW 2830 Storing 010.2019.00000551.001 - 128 Falls RD, WELLINGTON, NSW 2820 Storing 010.2019.00000567.001 - Argyle AVE, DUBBO, NSW 2830 Storing 010.2019.00000569.001 - 14L Yarrandale RD, DUBBO, NSW 2830 Storing 010.2019.00000564.001 - 1 Aqua CT, DUBBO, NSW 2830 Storing 010.2019.00000546.001 - 12L Pinedale RD, DUBBO, NSW 2830 Storing 010.2019.00000572.001 - 19 Potter CL, DUBBO, NSW 2830 Storing 010.2019.00000565.001 - 75 Jubilee ST, DUBBO, NSW 2830 Storing 010.2019.00000573.001 - 15 Snowy CR, DUBBO, NSW 2830 Storing 010.2018.00000111.002 - 69 Cobra ST, DUBBO, NSW 2830 Storing 010.2019.00000563.001 - 54 Kinghorn ST, NEUREA, NSW 2820 Storing 010.2019.00000067.002 - 12 Pindari GR, MONTEFIORES, NSW 2820 Storing 010.2019.00000562.001 - 8 Lago CT, DUBBO, NSW 2830 Storing 010.2019.00000560.001 - Sheraton RD, DUBBO, NSW 2830 Storing 010.2019.00000539.001 - 7A Burge PL, DUBBO, NSW 2830 Storing 010.2019.00000540.001 - 122 Curra Creek RD, CURRA CREEK, NSW 2820 Storing 010.2019.00000554.001 - 33 Boyd AVE, DUBBO, NSW 2830 Storing 010.2019.00000559.001 - 12L Pinedale RD, DUBBO, NSW 2830 Storing 010.2019.00000535.001 - 235-241 Cobra ST, DUBBO, NSW 2830 Storing 010.2019.00000552.001 - 70 Cobra ST, DUBBO, NSW 2830 Storing 010.2019.00000553.001 - 100 Bultje ST, DUBBO, NSW 2830 Storing 010.2019.00000533.001 - 5 Briarwood CL, DUBBO, NSW 2830 Storing 010.2019.00000538.001 - 24 Lincoln PKY, DUBBO, NSW 2830 Storing 016.2019.00000081.001 - 6 Turon CR, DUBBO, NSW 2830 Storing 016.2019.00000080.001 - 4 Drysdale CL, DUBBO, NSW 2830 Storing 010.2019.00000537.001 - 81 Windsor PDE, DUBBO, NSW 2830 Storing 010.2019.00000534.001 - 128A Wingewarra ST, DUBBO, NSW 2830 Collecting ATDIS feed data for kiama... D, [2019-12-06T03:30:02.432876 #16] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=3 D, [2019-12-06T03:30:08.755499 #16] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-12-06&lodgement_date_start=2019-11-06&page=4 D, [2019-12-06T03:30:11.321618 #16] DEBUG -- : Fetching Storing 010.2019.00000214.001 - Curramore RD, CURRAMORE, NSW 2533 Storing 010.2019.00000206.001 - 35 Pacific AV, WERRI BEACH, NSW 2534 Storing 010.2019.00000203.001 - 41 Hothersal ST, KIAMA, NSW 2533 Storing 010.2019.00000201.001 - 44 Golfers PDE, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000211.001 - 85 Merrick CCT, KIAMA, NSW 2533 Storing 010.2015.00000279.003 - 138 Headland DR, GERROA, NSW 2534 Storing 010.2018.00000111.002 - 9 Chapman ST, KIAMA, NSW 2533 Storing 010.2012.00000262.003 - 17 Farmer ST, KIAMA, NSW 2533 Storing 010.2019.00000209.001 - 18 Tarrant AV, KIAMA DOWNS, NSW 2533 Storing 010.2016.00000281.005 - 28 Fern ST, GERRINGONG, NSW 2534 Storing 010.2019.00000210.001 - 64 Cathedral Rocks AV, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000207.001 - 20 Hutchinson ST, BOMBO, NSW 2533 Storing 010.2019.00000198.001 - 77 Kalang RD, KIAMA HEIGHTS, NSW 2533 Storing 010.2019.00000196.001 - 20 Kaleula CR, KIAMA, NSW 2533 Storing 010.2019.00000205.001 - 128 Belinda ST, GERRINGONG, NSW 2534 Storing 010.2019.00000202.001 - 9 Jerrara AV, KIAMA, NSW 2533 Storing 010.2019.00000200.001 - 2 Bong Bong ST, KIAMA, NSW 2533 Storing 010.2019.00000199.001 - 9 Northpoint PL, BOMBO, NSW 2533 Storing 010.2019.00000195.001 - 68 Cathedral Rocks AV, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000208.001 - 63 Barton DR, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000204.001 - 165 Belinda ST, GERRINGONG, NSW 2534 Storing 010.2019.00000037.002 - 25 Riverleigh AV, GERROA, NSW 2534 Storing 010.2015.00000178.002 - 23 Saddleback Mountain RD, KIAMA, NSW 2533 Storing 010.2012.00000176.004 - 17 Noble ST, GERRINGONG, NSW 2534 Storing 010.2019.00000194.001 - 98 Headland DR, GERROA, NSW 2534 Collecting ATDIS feed data for upper_hunter... Storing 023.2009.00001473.002 - 405 Westwood RD, GUNGAL, NSW 2333 Storing 023.2009.00001264.002 - 12 Queen ST, BUNNAN, NSW 2337 Storing 023.2019.00002749.001 - 27 Hall RD, MERRIWA, NSW 2329 Storing 023.2019.00002748.001 - 1227 Dartbrook RD, DARTBROOK, NSW 2336 Collecting ATDIS feed data for armidale... Storing 267128 - 7 Pipeclay Street, EBOR, NSW 2453 Storing 266892 - 81 Brackin Street, HILLGROVE, NSW 2350 Storing 266882 - 7 Spearmount Drive, ARMIDALE, NSW 2350 Storing 266774 - 27 Sunrise Crescent, ARMIDALE, NSW 2350 Storing 266638 - 67 Cookes Road, ARMIDALE, NSW 2350 Storing 266482 - 35 Old Inverell Road, ARMIDALE, NSW 2350 Storing 266291 - 152 Dangar Street, ARMIDALE, NSW 2350 Storing 266265 - 347 Dangarsleigh Road, ARMIDALE, NSW 2350 Collecting ATDIS feed data for ashfield... Storing 010.2019.00000185.001 - 32 Empire Street, HABERFIELD, NSW 2045 Storing 010.2019.00000184.001 - 50 Henson Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000181.001 - 9 Chapman Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000180.001 - 34 Hawthorne Parade, HABERFIELD, NSW 2045 Storing 010.2019.00000178.001 - 108 Liverpool Road, ASHFIELD, NSW 2131 Storing 010.2019.00000097.002 - 30 Ramsay Street, HABERFIELD, NSW 2045 Collecting ATDIS feed data for leeton... leeton: ERROR: Timed out connecting to server /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:731:in `rescue in transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:647:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' Collecting ATDIS feed data for muswellbrook... D, [2019-12-06T03:31:49.319960 #16] DEBUG -- : Fetching Storing 005.2019.00000107.001 - 35 Cabernet ST, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000078.001 - 72-78 Brook ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000105.001 - 2 Wilson ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000104.001 - Thomas Mitchell DR, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000079.001 - 6 Edinglassie DR, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000077.001 - 31 Pamger DR, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000074.001 - 20B Grey Gum RD, DENMAN, NSW 2328 Storing 005.2019.00000101.001 - 20 Cabernet ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000100.001 - 17 Ruth White AVE, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000102.001 - 1333 Merriwa RD, DENMAN, NSW 2328 Storing 017.2019.00000075.001 - 72-78 Brook ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000099.001 - 159 Martindale RD, DENMAN, NSW 2328 Storing 017.2019.00000072.001 - 4 Lonhro PL, MUSWELLBROOK, NSW 2333 Collecting ATDIS feed data for walgett... Storing 020.2019.00000016.001 - Aerodrome Road, LIGHTNING RIDGE, NSW 2834 Collecting ATDIS feed data for newcastle... newcastle: ERROR: Timed out connecting to server /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:731:in `rescue in transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:647:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' scraper.rb:66:in `<main>': There were earlier errors. See output for details (RuntimeError)

Data

Downloaded 3096 times by openaustralia DevAppProject mattykn

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.39 MB) Use the API

rows 10 / 2868

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to authority_label
010.2019.00000164.001
119 Lochview Farm RD, LOCHIEL, NSW 2549
Installation of above ground swimming pool
2019-06-06
2019-05-07
bega_valley
010.2012.00000402.002
5 Bells PL, DOCTOR GEORGE MOUNTAIN, NSW 2550
Modification Erection of a dwelling & detached garage/studio & carport
2019-06-06
2019-05-07
2019-05-23
2019-06-06
bega_valley
018.2019.00005032.001
10 Willie Wagtail PL, ALSTONVILLE, NSW 2477
PCA CDC - New Dwelling - Single Residence
2019-06-06
2019-05-07
ballina
010.2019.00000283.001
2/188-202 Southern Cross DR, BALLINA, NSW 2478
Change of Use and Alterations to Commercial Building Change of use from a high technology industry to general industry involving the assembly, manufacture and fitting of prosthetic limbs and alterations to the building
2019-06-06
2019-05-07
ballina
010.2019.00000284.001
84 Meridian DR, COOLGARDIE, NSW 2478
New Dwelling - Single Residence Construction of a two storey dwelling house and associated studio as depicted in plans by Dean Poile Designs for 64 Meridian Drive Coolgardie dated 2 May 2019
2019-06-06
2019-05-07
ballina
010.2019.00000139.001
141 Keppel ST, BATHURST, NSW 2795
Stage 1 - Five lot torens title subdivision (four residential lots and one development lot) Stage 2 - Seven lot strata title subdivision
2019-06-06
2019-05-07
bathurst
018.2019.00000051.001
10 Newlands CR, KELSO, NSW 2795
Construction of a Single storey dwelling with attached garage
2019-06-06
2019-05-07
bathurst
010.2019.00000138.001
82 Graham DR, KELSO, NSW 2795
Dual Occupancy and two lot residential subdivision
2019-06-06
2019-05-07
bathurst
010.2019.00000078.001
21 Boyd ST, MINNAMURRA, NSW 2533
dwelling & air conditioning unit
2019-06-06
2019-05-07
kiama
010.2019.00000080.001
133 Headland DR, GERROA, NSW 2534
detached storage shed
2019-06-06
2019-05-07
2019-05-23
2019-06-06
kiama

Statistics

Average successful run time: 6 minutes

Total run time: 1 day

Total cpu time used: 8 minutes

Total disk space used: 4.43 MB

History

  • Auto ran revision 987eb14c and failed .
    370 records added, 348 records removed in the database
  • Auto ran revision 987eb14c and failed .
    359 records added, 351 records removed in the database
  • Auto ran revision 987eb14c and failed .
    364 records added, 342 records removed in the database
  • Auto ran revision 987eb14c and failed .
    269 records added, 242 records removed in the database
  • Auto ran revision 987eb14c and failed .
    344 records added, 342 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_atdis / scraper.rb