planningalerts-scrapers / multiple_atdis

Scrapes multiple authorities that have ATDIS feed


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git  Fetching concurrent-ruby 1.1.5  Fetching minitest 5.11.3  Fetching thread_safe 0.3.6  Installing minitest 5.11.3  Installing thread_safe 0.3.6  Fetching public_suffix 3.1.0  Installing concurrent-ruby 1.1.5  Installing public_suffix 3.1.0  Fetching multi_json 1.13.1  Installing multi_json 1.13.1  Fetching unf_ext 0.0.7.6  Fetching mime-types-data 3.2019.0331  Installing mime-types-data 3.2019.0331  Installing unf_ext 0.0.7.6 with native extensions  Fetching netrc 0.11.0  Fetching rgeo 2.0.1  Installing netrc 0.11.0  Installing rgeo 2.0.1 with native extensions  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching sqlite3 1.4.1  Installing sqlite3 1.4.1 with native extensions  Using bundler 1.15.2  Fetching safe_yaml 1.0.5  Installing safe_yaml 1.0.5  Fetching hashdiff 0.4.0  Installing hashdiff 0.4.0  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching tzinfo 1.2.5  Installing tzinfo 1.2.5  Fetching addressable 2.6.0  Fetching i18n 1.6.0  Installing addressable 2.6.0  Installing i18n 1.6.0  Fetching mime-types 3.2.2  Fetching unf 0.1.4  Installing mime-types 3.2.2  Fetching crack 0.4.3  Installing unf 0.1.4  Fetching rgeo-geojson 2.1.1  Installing rgeo-geojson 2.1.1  Installing crack 0.4.3  Fetching activesupport 5.2.3  Installing activesupport 5.2.3  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching webmock 3.6.0  Installing webmock 3.6.0  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching activemodel 5.2.3  Installing activemodel 5.2.3  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching atdis 0.4.1  Installing atdis 0.4.1  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching scraperwiki 3.0.2  Installing scraperwiki 3.0.2  Fetching scraperwiki-morph 0.1.1  Installing scraperwiki-morph 0.1.1  Using atdisplanningalertsfeed 0.1.0 from git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git (at master@a7a7ce7)  Bundle complete! 4 Gemfile dependencies, 34 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from i18n:  HEADS UP! i18n 1.1 changed fallbacks to exclude default locale.  But that may break your application.  Please check your Rails app for 'config.i18n.fallbacks = true'.  If you're using I18n (>= 1.1.0) and Rails (< 5.2.2), this should be  'config.i18n.fallbacks = [I18n.default_locale]'.  If not, fallbacks will be broken in your app by I18n 1.1.x.  For more info see:  https://github.com/svenfuchs/i18n/releases/tag/v1.1.0  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (16.60s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45. Collecting ATDIS feed data for bega_valley... D, [2020-07-01T17:54:13.560636 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=3 D, [2020-07-01T17:54:25.572872 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=4 D, [2020-07-01T17:54:36.862186 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=5 D, [2020-07-01T17:54:47.355393 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=6 D, [2020-07-01T17:54:57.593362 #17] DEBUG -- : Fetching Storing 010.2020.00000206.001 - 1183 Princes HWY, KIAH, NSW 2551 Storing 010.2020.00000226.001 - 345 Wandella RD, COBARGO, NSW 2550 Storing 010.2020.00000225.001 - 157 Christophers RD, QUAAMA, NSW 2550 Storing 010.2020.00000203.001 - 55 Wumbalwarra DR, BEGA, NSW 2550 Storing 010.2020.00000209.001 - 10534 Princes HWY, COBARGO, NSW 2550 Storing 018.2020.00002056.001 - Market ST, MERIMBULA, NSW 2548 Storing 010.2020.00000222.001 - 538 Illawambra Valley RD, YOWRIE, NSW 2550 Storing 010.2020.00000223.001 - 10 Maling ST, EDEN, NSW 2551 Storing 010.2020.00000190.001 - 126 Bourkes RD, YOWRIE, NSW 2550 Storing 010.2019.00000080.003 - 4243 Tathra Bermagui RD, BERMAGUI, NSW 2546 Storing 010.2020.00000224.001 - 7 Weemilah DR, PAMBULA BEACH, NSW 2549 Storing 018.2020.00002055.001 - Walls Flat RD, NUMBUGGA, NSW 2550 Storing 010.2020.00000228.001 - King ST, SOUTH PAMBULA, NSW 2549 Storing 010.2020.00000227.001 - 2-110 Ben Boyd PDE, BOYDTOWN, NSW 2551 Storing 010.2020.00000220.001 - 105 Strathmore CR, KALARU, NSW 2550 Storing 010.2020.00000221.001 - 16 Kurrajong CR, KALARU, NSW 2550 Storing 010.2020.00000219.001 - 11 Kiah Store RD, KIAH, NSW 2551 Storing 018.2020.00002069.001 - 507 Sapphire Coast DR, BOURNDA, NSW 2548 Storing 010.2017.00000123.002 - Pacific WY, TURA BEACH, NSW 2548 Storing 010.2020.00000216.001 - 219 Nethercote RD, EDEN, NSW 2551 Storing 010.2020.00000217.001 - 196 Mirador DR, MIRADOR, NSW 2548 Storing 010.2020.00000204.001 - 13 Gillespie ST, COBARGO, NSW 2550 Storing 010.2020.00000215.001 - 30 Ike Game RD, KALARU, NSW 2550 Storing 010.2020.00000211.001 - 9 Andy Poole DR, TATHRA, NSW 2550 Storing 010.2020.00000212.001 - 30-32 Kameruka ST, BEMBOKA, NSW 2550 Storing 010.2020.00000218.001 - 8 Adelaide AVE, WONBOYN, NSW 2551 Storing 010.2020.00000027.002 - 13 Kanangra ST, PAMBULA BEACH, NSW 2549 Storing 010.2020.00000205.001 - 311 Reedy Swamp RD, TARRAGANDA, NSW 2550 Storing 010.2020.00000208.001 - 11 Merimbula DR, MERIMBULA, NSW 2548 Storing 010.2020.00000210.001 - 846 Mogilla RD, TANTAWANGALO, NSW 2550 Storing 010.2020.00000214.001 - 31 Bungo ST, EDEN, NSW 2551 Storing 010.2020.00000188.001 - 14 Wheeler AVE, TATHRA, NSW 2550 Storing 010.2020.00000199.001 - 31 Kallata LA, SOUTH WOLUMLA, NSW 2550 Storing 018.2020.00002057.001 - 8 Hollydale PL, EDEN, NSW 2551 Storing 010.2020.00000194.001 - 18 Timber CL, WALLAGOOT, NSW 2550 Storing 010.2020.00000200.001 - 1353 Upper Brogo RD, BROGO, NSW 2550 Storing 010.2020.00000207.001 - 246 Tathra RD, TATHRA, NSW 2550 Storing 010.2020.00000213.001 - 67 Mulloway CCT, MERIMBULA, NSW 2548 Storing 010.2020.00000189.001 - Barretts RD, BEMBOKA, NSW 2550 Storing 010.2020.00000187.001 - 1382 Cobargo Bermagui RD, COBARGO, NSW 2550 Storing 010.2020.00000202.001 - 16 Blackbutt DR, COBARGO, NSW 2550 Storing 010.2020.00000186.001 - 131 Rilys RD, COOLAGOLITE, NSW 2550 Storing 010.2020.00000193.001 - 361 Princes Highway (south), BEGA, NSW 2550 Storing 010.2018.00000411.002 - Nutleys Creek RD, BERMAGUI, NSW 2546 Storing 010.2020.00000198.001 - 424 Upper Kiah RD, KIAH, NSW 2551 Storing 010.2020.00000195.001 - Brisbane ST, WYNDHAM, NSW 2550 Storing 010.2020.00000196.001 - 10 Sapphire Coast DR, MERIMBULA, NSW 2548 Storing 010.2020.00000197.001 - 9 Erinna LA, ANGLEDALE, NSW 2550 Storing 018.2020.00002051.001 - 8 Cornubia PL, BOYDTOWN, NSW 2551 Storing 010.2020.00000191.001 - 546 Nullica RD, NETHERCOTE, NSW 2549 Storing 010.2020.00000185.001 - 4 Bega ST, WOLUMLA, NSW 2550 Storing 010.2020.00000184.001 - Wumbalwarra DR, BEGA, NSW 2550 Storing 010.2019.00000341.002 - 190 Pambula Beach RD, PAMBULA BEACH, NSW 2549 Collecting ATDIS feed data for ballina... D, [2020-07-01T17:55:36.568101 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=3 D, [2020-07-01T17:55:50.439645 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=4 D, [2020-07-01T17:56:10.107849 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=5 D, [2020-07-01T17:56:22.939930 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=6 D, [2020-07-01T17:56:36.097630 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=7 D, [2020-07-01T17:56:49.234145 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=8 D, [2020-07-01T17:57:07.330199 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=9 D, [2020-07-01T17:57:21.832530 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=10 D, [2020-07-01T17:57:36.726219 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=11 D, [2020-07-01T17:57:50.564132 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=12 D, [2020-07-01T17:57:53.832949 #17] DEBUG -- : Fetching Storing 010.2020.00000385.001 - 2/81 Stewart ST, LENNOX HEAD, NSW 2478 Storing 010.2018.00000447.002 - 53 Swift ST, BALLINA, NSW 2478 Storing 010.2020.00000382.001 - 60 Survey ST, LENNOX HEAD, NSW 2478 Storing 010.2020.00000420.001 - 9 Byron Bay RD, LENNOX HEAD, NSW 2478 Storing 010.2020.00000395.001 - 440 South Ballina Beach RD, SOUTH BALLINA, NSW 2478 Storing 010.2020.00000397.001 - 13 Outrigger RD, LENNOX HEAD, NSW 2478 Storing 010.2020.00000384.001 - 2/2 Cummings CR, CUMBALUM, NSW 2478 Storing 010.2020.00000396.001 - 11 Eyles DR, EAST BALLINA, NSW 2478 Storing 010.2018.00000524.002 - Teven RD, TEVEN, NSW 2478 Storing 010.2020.00000394.001 - 197 Bartletts LA, MEERSCHAUM VALE, NSW 2477 Storing 010.2015.00000491.003 - 59 Blue Seas PDE, LENNOX HEAD, NSW 2478 Storing 010.2020.00000393.001 - 1/11 Henry Philp AVE, BALLINA, NSW 2478 Storing 010.2020.00000387.001 - 30 Victoria Park LA, DALWOOD, NSW 2477 Storing 010.2020.00000374.001 - 44 Riverside DR, WEST BALLINA, NSW 2478 Storing 010.2020.00000419.001 - 34 Liffey AVE, CUMBALUM, NSW 2478 Storing 010.2020.00000418.001 - 67 Northumberland DR, EAST BALLINA, NSW 2478 Storing 010.2020.00000417.001 - 76 Silver Gull DR, EAST BALLINA, NSW 2478 Storing 010.2020.00000398.001 - 35 Millbrook TCE, WOLLONGBAR, NSW 2477 Storing 010.2020.00000416.001 - 19 Talgarno LA, BROOKLET, NSW 2479 Storing 010.2020.00000415.001 - 21 Minley CR, EAST BALLINA, NSW 2478 Storing 010.2020.00000413.001 - 11 Dent CR, CUMBALUM, NSW 2478 Storing 010.2020.00000383.001 - 11 Coral ST, ALSTONVILLE, NSW 2477 Storing 010.2020.00000079.002 - 17 Teven RD, ALSTONVILLE, NSW 2477 Storing 010.2020.00000378.001 - 29 Pine AVE, EAST BALLINA, NSW 2478 Storing 010.2020.00000369.001 - 11 Angus Kennedy CL, LENNOX HEAD, NSW 2478 Storing 010.2020.00000412.001 - 18 Summerhill CR, CUMBALUM, NSW 2478 Storing 010.2020.00000379.001 - 24 Fenwick DR, EAST BALLINA, NSW 2478 Storing 010.2020.00000411.001 - 1 Murrogun PL, WOLLONGBAR, NSW 2477 Storing 018.2020.00005044.001 - 68 Ballina ST, LENNOX HEAD, NSW 2478 Storing 010.2020.00000410.001 - 32 Dolphin DR, WEST BALLINA, NSW 2478 Storing 010.2020.00000409.001 - 841 Fernleigh RD, BROOKLET, NSW 2479 Storing 010.2020.00000380.001 - 15 Fox ST, BALLINA, NSW 2478 Storing 010.2020.00000381.001 - 2-12 Greenwood PL, LENNOX HEAD, NSW 2478 Storing 010.2018.00000650.002 - 6 Yabsley ST, EAST BALLINA, NSW 2478 Storing 010.2020.00000366.001 - 18 Fox Valley WY, LENNOX HEAD, NSW 2478 Storing 010.2020.00000373.001 - 1 Burke TCE, EAST BALLINA, NSW 2478 Storing 010.2020.00000364.001 - 14 Kamala PL, TINTENBAR, NSW 2478 Storing 010.2020.00000375.001 - 28 Kalinga ST, WEST BALLINA, NSW 2478 Storing 010.2020.00000408.001 - 174 Leadbeatters LA, ALSTONVILLE, NSW 2477 Storing 010.2020.00000372.001 - 30 Pacific PDE, LENNOX HEAD, NSW 2478 Storing 010.2020.00000407.001 - 273 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2020.00000406.001 - 1/2 Fern ST, LENNOX HEAD, NSW 2478 Storing 010.2020.00000358.001 - 62 Horizon DR, WEST BALLINA, NSW 2478 Storing 010.2020.00000405.001 - 3 Stonehenge PL, LENNOX HEAD, NSW 2478 Storing 010.2020.00000404.001 - 2 Page CT, LENNOX HEAD, NSW 2478 Storing 010.2020.00000403.001 - Uralba RD, URALBA, NSW 2477 Storing 010.2020.00000388.001 - 34 Ridgeview CR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000386.001 - 2/10 Tanamera DR, ALSTONVILLE, NSW 2477 Storing 018.2020.00005046.001 - 133 Hutley DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000345.001 - 7 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2020.00000402.001 - 7 Bahama AVE, ALSTONVILLE, NSW 2477 Storing 010.2020.00000368.001 - 29 Sandbreak CR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000401.001 - 968 Wardell RD, MEERSCHAUM VALE, NSW 2477 Storing 010.2020.00000354.001 - 17 Shoalhaven ST, ALSTONVILLE, NSW 2477 Storing 010.2016.00000473.004 - 663 Fernleigh RD, BROOKLET, NSW 2479 Storing 010.2020.00000371.001 - 27 Ballina ST, LENNOX HEAD, NSW 2478 Storing 010.2020.00000400.001 - 71 Crane ST, BALLINA, NSW 2478 Storing 010.2020.00000370.001 - 47 Carlisle ST, WARDELL, NSW 2477 Storing 010.2020.00000367.001 - 8 Olivia CCT, LENNOX HEAD, NSW 2478 Storing 010.2020.00000032.002 - 14 Douglas ST, EAST BALLINA, NSW 2478 Storing 010.2016.00000379.003 - 2 Condon DR, EAST BALLINA, NSW 2478 Storing 010.2020.00000399.001 - 110 Ballina RD, ALSTONVILLE, NSW 2477 Storing 018.2020.00005043.001 - 51 Jameson AVE, EAST BALLINA, NSW 2478 Storing 010.2020.00000377.001 - 33 Horizon DR, WEST BALLINA, NSW 2478 Storing 010.2020.00000376.001 - 70 Fig Tree Hill DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000355.001 - 32 Cedar CR, EAST BALLINA, NSW 2478 Storing 010.2020.00000342.001 - 32 Stanley Park RD, WOLLONGBAR, NSW 2477 Storing 010.2020.00000365.001 - 24 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000410.002 - 72 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2016.00000628.004 - 4 Henderson PL, LENNOX HEAD, NSW 2478 Storing 010.2020.00000332.001 - 223 Hutley DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000363.001 - 22 Ross ST, BALLINA, NSW 2478 Storing 010.2020.00000359.001 - 24 Morton WY, SKENNARS HEAD, NSW 2478 Storing 010.2020.00000361.001 - 1 Convair AVE, BALLINA, NSW 2478 Storing 010.2020.00000348.001 - 17 Scenic CT, ALSTONVILLE, NSW 2477 Storing 010.2020.00000392.001 - 12 Angus Kennedy CL, LENNOX HEAD, NSW 2478 Storing 010.2020.00000362.001 - 86 Temple ST, BALLINA, NSW 2478 Storing 010.2020.00000391.001 - 13 Angus Kennedy CL, LENNOX HEAD, NSW 2478 Storing 010.2020.00000390.001 - 127 Montwood DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000389.001 - 27 The Serpentine, EAST BALLINA, NSW 2478 Storing 018.2020.00005042.001 - 44 Rifle Range RD, WOLLONGBAR, NSW 2477 Storing 010.2020.00000360.001 - 56 Prospect ST, EAST BALLINA, NSW 2478 Storing 010.2020.00000349.001 - 21 McLeish RD, KINVARA, NSW 2478 Storing 018.2020.00005045.001 - 8-20 Robertson ST, ALSTONVILLE, NSW 2477 Storing 010.2020.00000346.001 - 2 Fredericks LA, TINTENBAR, NSW 2478 Storing 010.2020.00000350.001 - 8 Clement PL, LENNOX HEAD, NSW 2478 Storing 010.2020.00000347.001 - 55 Survey ST, LENNOX HEAD, NSW 2478 Storing 010.2020.00000351.001 - 40 Moon ST, BALLINA, NSW 2478 Storing 010.2020.00000344.001 - 55 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000357.001 - 24 Caloola RD, LENNOX HEAD, NSW 2478 Storing 010.2020.00000352.001 - 3 Daintree DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000356.001 - 19 Ridgeview CR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000353.001 - 35 Pinnacle ROW, LENNOX HEAD, NSW 2478 Storing 010.2020.00000340.001 - 33 Pacific Heights DR, CUMBALUM, NSW 2478 Storing 010.2020.00000341.001 - 1/58 Bayview DR, EAST BALLINA, NSW 2478 Storing 010.2015.00000545.002 - 38 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000337.001 - 19 Curlew CT, EAST BALLINA, NSW 2478 Storing 010.2020.00000343.001 - 82 Pine AVE, EAST BALLINA, NSW 2478 Storing 010.2020.00000333.001 - 64 Kerr ST, BALLINA, NSW 2478 Storing 010.2020.00000338.001 - 3 Pintail LA, LENNOX HEAD, NSW 2478 Storing 010.2019.00000260.002 - 28 Old Byron Bay RD, NEWRYBAR, NSW 2479 Storing 010.2020.00000336.001 - 13 Foley AVE, CUMBALUM, NSW 2478 Storing 010.2020.00000339.001 - 13 Liffey AVE, CUMBALUM, NSW 2478 Storing 010.2020.00000334.001 - 26 Caloola RD, LENNOX HEAD, NSW 2478 Storing 010.2020.00000335.001 - 125 Montwood DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000331.001 - 24 Elevation DR, LENNOX HEAD, NSW 2478 Storing 010.2020.00000330.001 - 39 Ballina ST, LENNOX HEAD, NSW 2478 Storing 010.2020.00000329.001 - 246-250 Lismore RD, WOLLONGBAR, NSW 2477 Storing 010.2020.00000328.001 - 5 Ingrams RD, CUMBALUM, NSW 2478 Storing 010.2017.00000551.002 - 4 Old Byron Bay RD, NEWRYBAR, NSW 2479 Collecting ATDIS feed data for bathurst... D, [2020-07-01T17:58:08.621177 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=3 D, [2020-07-01T17:58:14.565736 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=4 D, [2020-07-01T17:58:23.053195 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=5 D, [2020-07-01T17:58:28.415168 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=6 D, [2020-07-01T17:58:34.824614 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=7 D, [2020-07-01T17:58:38.433236 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=8 W, [2020-07-01T17:58:38.890107 #17] WARN -- : No/invalid pagination, assuming no records/aborting Storing 018.2020.00000097.001 - 10 Keystone RI, KELSO, NSW 2795 Storing 010.2020.00000207.001 - 11 McGillan DR, KELSO, NSW 2795 Storing 018.2020.00000099.001 - 6 Burlington RI, KELSO, NSW 2795 Storing 010.2020.00000185.002 - 3 Pat O'Leary DR, KELSO, NSW 2795 Storing 010.2020.00000197.001 - 1730 Limekilns RD, CLEAR CREEK, NSW 2795 Storing 018.2020.00000096.001 - 4 Fairleigh PL, KELSO, NSW 2795 Storing 018.2020.00000095.001 - 50 Meagher ST, LLANARTH, NSW 2795 Storing 010.2020.00000203.001 - 8 Fraser DR, EGLINTON, NSW 2795 Storing 010.2020.00000205.001 - 67 Woodside DR, MOUNT RANKIN, NSW 2795 Storing 010.2020.00000179.001 - 40 Sunbright RD, KELSO, NSW 2795 Storing 010.2020.00000084.002 - 67 Lambert ST, BATHURST, NSW 2795 Storing 010.2020.00000191.001 - 55 Graham DR, KELSO, NSW 2795 Storing 010.2020.00000170.001 - Alexander ST, EGLINTON, NSW 2795 Storing 010.2020.00000204.001 - 289 Lachlan RD, ROCKLEY, NSW 2795 Storing 010.2020.00000184.001 - 5 Grimes ST, WINDRADYNE, NSW 2795 Storing 010.2017.00000043.002 - 234 Eglinton RD, ABERCROMBIE, NSW 2795 Storing 010.2020.00000186.001 - 280 Redbank RD, TRIANGLE FLAT, NSW 2795 Storing 018.2020.00000094.001 - 22 Tyndall ST, KELSO, NSW 2795 Storing 018.2020.00000093.001 - 32 Ignatius PL, KELSO, NSW 2795 Storing 010.2020.00000202.001 - 2A Keppel ST, BATHURST, NSW 2795 Storing 010.2020.00000198.001 - 107 Mountain STGT, MOUNT PANORAMA, NSW 2795 Storing 010.2020.00000201.001 - 4 Keppel ST, BATHURST, NSW 2795 Storing 010.2020.00000200.001 - 4 Keppel ST, BATHURST, NSW 2795 Storing 010.2020.00000196.001 - 5 View ST, KELSO, NSW 2795 Storing 010.2020.00000199.001 - 4 Keppel ST, BATHURST, NSW 2795 Storing 010.2019.00000236.002 - 302 Howick ST, BATHURST, NSW 2795 Storing 010.2020.00000195.001 - 42 Country WAY, ABERCROMBIE, NSW 2795 Storing 010.2020.00000194.001 - 250 Stewart ST, BATHURST, NSW 2795 Storing 018.2020.00000082.001 - 11 Peard CL, EGLINTON, NSW 2795 Storing 018.2020.00000092.001 - 48 Meagher ST, LLANARTH, NSW 2795 Storing 010.2020.00000188.001 - 143 Seymour ST, BATHURST, NSW 2795 Storing 010.2020.00000189.001 - 3249 O'Connell RD, BREWONGLE, NSW 2795 Storing 018.2020.00000091.001 - 8 Lockwood RI, KELSO, NSW 2795 Storing 010.2020.00000176.001 - 210 Howick ST, BATHURST, NSW 2795 Storing 018.2020.00000090.001 - 83 Blue Ridge DR, WHITE ROCK, NSW 2795 Storing 010.2020.00000193.001 - 35 Vale RD, SOUTH BATHURST, NSW 2795 Storing 010.2020.00000172.001 - 3821 Limekilns RD, WATTLE FLAT, NSW 2795 Storing 010.2020.00000183.001 - 78 Gilmour ST, KELSO, NSW 2795 Storing 010.2020.00000192.001 - 80-82 William ST, BATHURST, NSW 2795 Storing 010.2020.00000182.001 - 6 Marble CL, KELSO, NSW 2795 Storing 018.2020.00000089.001 - 28 Lew AVE, EGLINTON, NSW 2795 Storing 018.2020.00000086.001 - 44 Meagher ST, LLANARTH, NSW 2795 Storing 010.2020.00000181.001 - 34 Cherry LA, ROBIN HILL, NSW 2795 Storing 010.2020.00000178.001 - 106 Hope ST, BATHURST, NSW 2795 Storing 018.2020.00000087.001 - 99 Graham DR, KELSO, NSW 2795 Storing 018.2020.00000088.001 - 5 Bayliss ST, ABERCROMBIE, NSW 2795 Storing 010.2020.00000190.001 - 1078 Lachlan RD, CALOOLA, NSW 2795 Storing 010.2020.00000185.001 - 3 Pat O'Leary DR, KELSO, NSW 2795 Storing 018.2020.00000084.001 - 3 Meagher ST, LLANARTH, NSW 2795 Storing 018.2020.00000085.001 - 24 Darling ST, EGLINTON, NSW 2795 Storing 010.2020.00000177.001 - 21 Queen ST, PERTHVILLE, NSW 2795 Storing 010.2020.00000187.001 - 26 Bradwardine RD, ROBIN HILL, NSW 2795 Storing 018.2020.00000083.001 - 16 Cain DR, KELSO, NSW 2795 Storing 010.2020.00000180.001 - Limekilns RD, KELSO, NSW 2795 Storing 010.2019.00000133.002 - 19 Durham ST, BATHURST, NSW 2795 Storing 010.2020.00000173.001 - 7 Strathmore DR, FOREST GROVE, NSW 2795 Storing 010.2020.00000171.001 - 28 Simmons PL, KELSO, NSW 2795 Storing 010.2020.00000169.001 - 1588 Trunkey RD, GEORGES PLAINS, NSW 2795 Collecting ATDIS feed data for berrigan... Collecting ATDIS feed data for dubbo... D, [2020-07-01T17:59:01.534638 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=3 D, [2020-07-01T17:59:06.141844 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=4 D, [2020-07-01T17:59:10.164286 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=5 D, [2020-07-01T17:59:15.345756 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=6 D, [2020-07-01T17:59:18.904035 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=7 D, [2020-07-01T17:59:22.574824 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=8 D, [2020-07-01T17:59:25.385225 #17] DEBUG -- : Fetching Storing 010.2020.00000296.001 - 6R Tinks RD, DUBBO, NSW 2830 Storing 010.2020.00000291.001 - 22R Narromine RD, DUBBO, NSW 2830 Storing 010.2019.00000236.002 - 31 Azure AVE, DUBBO, NSW 2830 Storing 010.2019.00000357.002 - 80R Lagoon Creek RD, MINORE, NSW 2830 Storing 010.2020.00000290.001 - 15-19 Depot RD, DUBBO, NSW 2830 Storing 010.2020.00000295.001 - 52 Spears DR, DUBBO, NSW 2830 Storing 010.2020.00000300.001 - 167 Arthur ST, WELLINGTON, NSW 2820 Storing 010.2020.00000301.001 - 87 Victoria ST, DUBBO, NSW 2830 Storing 010.2020.00000297.001 - 24 Ron Gordon PL, DUBBO, NSW 2830 Storing 010.2020.00000298.001 - 135R Obley RD, DUBBO, NSW 2830 Storing 010.2020.00000294.001 - 57 Lincoln PKY, DUBBO, NSW 2830 Storing 010.2020.00000292.001 - 92L Boothenba RD, DUBBO, NSW 2830 Storing 010.2020.00000299.001 - 95 Champagne DR, DUBBO, NSW 2830 Storing 010.2020.00000288.001 - 6 Old Homestead DR, DUBBO, NSW 2830 Storing 010.2020.00000293.001 - 25 Lindsay PL, DUBBO, NSW 2830 Storing 010.2020.00000289.001 - 133 Wingewarra ST, DUBBO, NSW 2830 Storing 010.2020.00000246.001 - 12 O'Connor PL, DUBBO, NSW 2830 Storing 010.2020.00000283.001 - 10 Ferrier DR, DUBBO, NSW 2830 Storing 010.2020.00000282.001 - 15 Chifley DR, DUBBO, NSW 2830 Storing 010.2020.00000279.001 - 50 Champagne DR, DUBBO, NSW 2830 Storing 010.2020.00000255.001 - 9 Champagne DR, DUBBO, NSW 2830 Storing 010.2020.00000275.001 - 39 Boyd AVE, DUBBO, NSW 2830 Storing 010.2020.00000287.001 - 2L Veechs RD, WONGARBON, NSW 2831 Storing 010.2020.00000286.001 - 31 Norfolk CRES, DUBBO, NSW 2830 Storing 010.2020.00000285.001 - 76 Argyle AVE, DUBBO, NSW 2830 Storing 010.2020.00000284.001 - 19 Nagle DR, DUBBO, NSW 2830 Storing 010.2020.00000056.002 - 32 Welchman ST, DUBBO, NSW 2830 Storing 010.2017.00000654.002 - 127-129 Whiteley ST, WELLINGTON, NSW 2820 Storing 010.2020.00000253.001 - 15 Clearwater PL, DUBBO, NSW 2830 Storing 010.2020.00000272.001 - 5833 Burrendong WY, STUART TOWN, NSW 2820 Storing 010.2020.00000276.001 - 14A Aqua CT, DUBBO, NSW 2830 Storing 010.2019.00000600.002 - 31 Merrilea RD, DUBBO, NSW 2830 Storing 010.2020.00000280.001 - 11 Stonehaven AVE, DUBBO, NSW 2830 Storing 010.2020.00000278.001 - 13 Meadowbank DR, DUBBO, NSW 2830 Storing 010.2020.00000277.001 - 94R Narromine RD, DUBBO, NSW 2830 Storing 010.2020.00000105.002 - 70 Boundary RD, DUBBO, NSW 2830 Storing 010.2020.00000274.001 - 18 Marine CT, DUBBO, NSW 2830 Storing 016.2019.00000080.002 - 4 Drysdale CL, DUBBO, NSW 2830 Storing 010.2020.00000145.002 - 48 Tamworth ST, DUBBO, NSW 2830 Storing 010.2020.00000273.001 - 4L Winbar RD, DUBBO, NSW 2830 Storing 010.2020.00000265.001 - 26 Purvis LA, DUBBO, NSW 2830 Storing 010.2019.00000458.002 - 1 John Roach CL, DUBBO, NSW 2830 Storing 010.2013.00000499.006 - 145 Cobbora RD, DUBBO, NSW 2830 Storing 010.2020.00000270.001 - 5 King ST, MONTEFIORES, NSW 2820 Storing 010.2020.00000266.001 - 45 Amadeus AVE, DUBBO, NSW 2830 Storing 010.2020.00000271.001 - 7L Boundary Creek RD, DUBBO, NSW 2830 Storing 010.2020.00000269.001 - 19 Nicholii ST, MONTEFIORES, NSW 2820 Storing 010.2020.00000268.001 - 10 Dawson ST, DUBBO, NSW 2830 Storing 010.2020.00000260.001 - 21-23 Swift ST, WELLINGTON, NSW 2820 Storing 010.2020.00000267.001 - 40 Waterfall CRES, DUBBO, NSW 2830 Storing 010.2020.00000263.001 - 107R Old Dubbo RD, DUBBO, NSW 2830 Storing 010.2020.00000262.001 - 6 Thorby AVE, DUBBO, NSW 2830 Storing 010.2020.00000264.001 - 12 Severn CIR, DUBBO, NSW 2830 Storing 010.2020.00000261.001 - 5 Eddy CT, DUBBO, NSW 2830 Storing 010.2020.00000257.001 - 79-91 Talbragar ST, DUBBO, NSW 2830 Storing 010.2020.00000250.001 - 2A Alexandrina AVE, DUBBO, NSW 2830 Storing 010.2020.00000181.002 - 6 Yarra PL, DUBBO, NSW 2830 Storing 010.2020.00000249.001 - 6 Williams CRCT, DUBBO, NSW 2830 Storing 010.2020.00000259.001 - 9 Alluvial CT, DUBBO, NSW 2830 Storing 010.2020.00000258.001 - 135 Arthur ST, WELLINGTON, NSW 2820 Storing 010.2020.00000248.001 - 112 Wingewarra ST, DUBBO, NSW 2830 Storing 016.2020.00000025.001 - 80 Gipps ST, DUBBO, NSW 2830 Storing 016.2020.00000024.001 - 55 Stream AVE, DUBBO, NSW 2830 Storing 010.2020.00000256.001 - 10 St Andrews DR, DUBBO, NSW 2830 Storing 010.2020.00000254.001 - 15 Buckingham DR, DUBBO, NSW 2830 Storing 016.2020.00000022.001 - 45 Boyd AVE, DUBBO, NSW 2830 Storing 010.2020.00000252.001 - 95-105 Curtis ST, WELLINGTON, NSW 2820 Storing 016.2019.00000096.002 - 6 Lesmurdie PDE, DUBBO, NSW 2830 Storing 016.2020.00000023.001 - 26 Baird ST, DUBBO, NSW 2830 Storing 010.2020.00000177.002 - 15B Fairview ST, DUBBO, NSW 2830 Storing 010.2020.00000251.001 - 23 Derribong ST, WONGARBON, NSW 2831 Storing 010.2020.00000247.001 - 22 Dalton ST, DUBBO, NSW 2830 Storing 010.2020.00000244.001 - 13 Marine CT, DUBBO, NSW 2830 Collecting ATDIS feed data for kiama... D, [2020-07-01T17:59:47.977245 #17] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=3 D, [2020-07-01T17:59:55.117866 #17] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2020-07-01&lodgement_date_start=2020-06-01&page=4 D, [2020-07-01T17:59:58.735356 #17] DEBUG -- : Fetching Storing 010.2020.00000097.001 - 216 Knights Hill RD, KNIGHTS HILL, NSW 2577 Storing 010.2020.00000096.001 - 46 Allowrie ST, JAMBEROO, NSW 2533 Storing 010.2020.00000094.001 - 20 South Kiama DR, KIAMA HEIGHTS, NSW 2533 Storing 010.2018.00000224.002 - 157 Charles AV, MINNAMURRA, NSW 2533 Storing 010.2019.00000191.002 - 21 Collins ST, KIAMA, NSW 2533 Storing 010.2018.00000159.003 - 20 Alexander AV, KIAMA DOWNS, NSW 2533 Storing 010.2018.00000289.001 - 139 Princes HWY, GERRINGONG, NSW 2534 Storing 010.2020.00000095.001 - 1/42 Collins ST, KIAMA, NSW 2533 Storing 010.2020.00000091.001 - 62 Pacific AV, WERRI BEACH, NSW 2534 Storing 010.2020.00000092.001 - Mount Brandon RD, JAMBEROO, NSW 2533 Storing 010.2020.00000093.001 - 12 Tate PL, JAMBEROO, NSW 2533 Storing 010.2020.00000085.001 - 150 Wyalla RD, JAMBEROO, NSW 2533 Storing 010.2020.00000090.001 - 493 Jamberoo RD, JAMBEROO, NSW 2533 Storing 010.2020.00000012.002 - 223 Fern ST, GERRINGONG, NSW 2534 Storing 010.2020.00000089.001 - 37 Tasman DR, GERRINGONG, NSW 2534 Storing 010.2018.00000220.002 - 150 Charles AV, MINNAMURRA, NSW 2533 Storing 010.2020.00000088.001 - 20 Armstrong AV, GERRINGONG, NSW 2534 Storing 010.2019.00000235.002 - 5 The Circuit, KIAMA DOWNS, NSW 2533 Storing 010.2020.00000084.001 - 48 Pacific AV, WERRI BEACH, NSW 2534 Storing 010.2020.00000086.001 - 88 Merrick CCT, KIAMA, NSW 2533 Storing 010.2020.00000083.001 - 13 Beattie ST, JAMBEROO, NSW 2533 Storing 010.2020.00000087.001 - 40 Tingira CR, KIAMA, NSW 2533 Storing 010.2020.00000080.001 - 71 Fern ST, GERRINGONG, NSW 2534 Storing 010.2020.00000082.001 - 59 Kiarama AV, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000211.002 - 85 Merrick CCT, KIAMA, NSW 2533 Storing 010.2020.00000081.001 - 46 Bonaira ST, KIAMA, NSW 2533 Storing 010.2019.00000177.002 - 13 Moona AV, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000012.002 - 20 Tomlins RD, BROUGHTON VILLAGE, NSW 2534 Storing 010.2020.00000079.001 - Bridges RD, GERRINGONG, NSW 2534 Storing 010.2020.00000078.001 - 4 Pacific AV, WERRI BEACH, NSW 2534 Storing 010.2020.00000077.001 - 111 Bland ST, KIAMA, NSW 2533 Storing 010.2019.00000092.002 - 1 Pheasant Point DR, KIAMA, NSW 2533 Collecting ATDIS feed data for upper_hunter... Storing 023.2009.00001201.002 - 91 Kiernans Creek RD, UPPER DARTBROOK, NSW 2336 Storing 023.2005.00000678.002 - 1034 Flaggs RD, MERRIWA, NSW 2329 Storing 023.2003.00001811.002 - 49 Allan Cunningham RD, SCONE, NSW 2337 Storing 023.2020.00002767.001 - 27 Old Scone RD, MERRIWA, NSW 2329 Collecting ATDIS feed data for armidale... Storing 273585 - 158 Woodmans Road, BEN LOMOND, NSW 2365 Storing 273555 - 4774 New England Highway, FALCONER, NSW 2365 Storing 273475 - 178 Andersons Road, CASTLE DOYLE, NSW 2350 Collecting ATDIS feed data for ashfield... Collecting ATDIS feed data for leeton... leeton: ERROR: Timed out connecting to server /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:731:in `rescue in transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:647:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' Collecting ATDIS feed data for muswellbrook... D, [2020-07-01T18:01:24.582082 #17] DEBUG -- : Fetching Storing 005.2019.00000088.002 - 60-82 Bridge ST, MUSWELLBROOK, NSW 2333 Storing 005.2020.00000063.001 - 72-78 Brook ST, MUSWELLBROOK, NSW 2333 Storing 005.2020.00000062.001 - 3 Jillaroo WY, MUSWELLBROOK, NSW 2333 Storing 005.2020.00000059.001 - 49-51 Maitland ST, MUSWELLBROOK, NSW 2333 Storing 005.2020.00000060.001 - 190 Woodland Ridge RD, MUSCLE CREEK, NSW 2333 Storing 005.2020.00000061.001 - 15 Grey Gum RD, DENMAN, NSW 2328 Storing 005.2020.00000056.001 - 86 Babbler CR, MUSCLE CREEK, NSW 2333 Storing 005.2020.00000055.001 - 20 Ogilvie ST, DENMAN, NSW 2328 Storing 005.2020.00000057.001 - 95-107 Maitland ST, MUSWELLBROOK, NSW 2333 Storing 017.2020.00000014.001 - 280 Scrumlo RD, HEBDEN, NSW 2330 Storing 005.2020.00000054.001 - 74 Aberdeen ST, MUSWELLBROOK, NSW 2333 Storing 005.2020.00000053.001 - 81 Babbler CR, MUSCLE CREEK, NSW 2333 Storing 005.2020.00000052.001 - 20 Tindale ST, MUSWELLBROOK, NSW 2333 Collecting ATDIS feed data for walgett... Storing 020.2020.00000004.002 - Pitt Street, WALGETT, NSW 2832 Storing 020.2020.00000001.002 - 34 Fox Street, WALGETT, NSW 2832 Storing 020.2020.00000012.001 - 18 Colin Street, CARINDA, NSW 2831 Storing 020.2020.00000010.001 - Kaolin Street, LIGHTNING RIDGE, NSW 2834 Storing 020.2020.00000011.001 - 20753 Castlereagh Highway, LIGHTNING RIDGE, NSW 2834 Storing 020.2020.00000008.001 - Kaolin Street, LIGHTNING RIDGE, NSW 2834 Storing 020.2020.00000009.001 - Kaolin Street, LIGHTNING RIDGE, NSW 2834 Collecting ATDIS feed data for newcastle... newcastle: ERROR: Timed out connecting to server /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:731:in `rescue in transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:647:in `transmit' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute' /app/vendor/bundle/ruby/2.3.0/gems/rest-client-2.0.2/lib/restclient.rb:67:in `get' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/model.rb:76:in `read_url' /app/vendor/bundle/ruby/2.3.0/gems/atdis-0.4.1/lib/atdis/feed.rb:71:in `applications' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/vendor/bundle/ruby/2.3.0/bundler/gems/atdisplanningalertsfeed-a7a7ce749691/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:53:in `block in <main>' scraper.rb:47:in `each' scraper.rb:47:in `<main>' scraper.rb:66:in `<main>': There were earlier errors. See output for details (RuntimeError)

Data

Downloaded 5802 times by openaustralia DevAppProject mattykn vietbaracon

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.4 MB) Use the API

rows 10 / 4973

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to authority_label
010.2019.00000164.001
119 Lochview Farm RD, LOCHIEL, NSW 2549
Installation of above ground swimming pool
2019-06-06
2019-05-07
bega_valley
010.2012.00000402.002
5 Bells PL, DOCTOR GEORGE MOUNTAIN, NSW 2550
Modification Erection of a dwelling & detached garage/studio & carport
2019-06-06
2019-05-07
2019-05-23
2019-06-06
bega_valley
018.2019.00005032.001
10 Willie Wagtail PL, ALSTONVILLE, NSW 2477
PCA CDC - New Dwelling - Single Residence
2019-06-06
2019-05-07
ballina
010.2019.00000283.001
2/188-202 Southern Cross DR, BALLINA, NSW 2478
Change of Use and Alterations to Commercial Building Change of use from a high technology industry to general industry involving the assembly, manufacture and fitting of prosthetic limbs and alterations to the building
2019-06-06
2019-05-07
ballina
010.2019.00000284.001
84 Meridian DR, COOLGARDIE, NSW 2478
New Dwelling - Single Residence Construction of a two storey dwelling house and associated studio as depicted in plans by Dean Poile Designs for 64 Meridian Drive Coolgardie dated 2 May 2019
2019-06-06
2019-05-07
ballina
010.2019.00000139.001
141 Keppel ST, BATHURST, NSW 2795
Stage 1 - Five lot torens title subdivision (four residential lots and one development lot) Stage 2 - Seven lot strata title subdivision
2019-06-06
2019-05-07
bathurst
018.2019.00000051.001
10 Newlands CR, KELSO, NSW 2795
Construction of a Single storey dwelling with attached garage
2019-06-06
2019-05-07
bathurst
010.2019.00000138.001
82 Graham DR, KELSO, NSW 2795
Dual Occupancy and two lot residential subdivision
2019-06-06
2019-05-07
bathurst
010.2019.00000078.001
21 Boyd ST, MINNAMURRA, NSW 2533
dwelling & air conditioning unit
2019-06-06
2019-05-07
kiama
010.2019.00000080.001
133 Headland DR, GERROA, NSW 2534
detached storage shed
2019-06-06
2019-05-07
2019-05-23
2019-06-06
kiama

Statistics

Average successful run time: 6 minutes

Total run time: 2 days

Total cpu time used: 17 minutes

Total disk space used: 5.44 MB

History

  • Auto ran revision 987eb14c and failed .
    353 records added, 346 records removed in the database
  • Auto ran revision 987eb14c and failed .
    356 records added, 331 records removed in the database
  • Auto ran revision 987eb14c and failed .
    283 records added, 263 records removed in the database
  • Auto ran revision 987eb14c and failed .
    314 records added, 314 records removed in the database
  • Auto ran revision 987eb14c and failed .
    331 records added, 322 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_atdis / scraper.rb