planningalerts-scrapers / multiple_atdis

Scrapes multiple authorities that have ATDIS feed


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git  Fetching concurrent-ruby 1.1.5  Fetching minitest 5.11.3  Fetching thread_safe 0.3.6  Installing minitest 5.11.3  Installing thread_safe 0.3.6  Fetching public_suffix 3.1.0  Installing concurrent-ruby 1.1.5  Fetching multi_json 1.13.1  Installing public_suffix 3.1.0  Installing multi_json 1.13.1  Fetching unf_ext 0.0.7.6  Fetching mime-types-data 3.2019.0331  Installing mime-types-data 3.2019.0331  Installing unf_ext 0.0.7.6 with native extensions  Fetching netrc 0.11.0  Fetching rgeo 2.0.1  Installing netrc 0.11.0  Installing rgeo 2.0.1 with native extensions  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching sqlite3 1.4.1  Installing sqlite3 1.4.1 with native extensions  Using bundler 1.15.2  Fetching safe_yaml 1.0.5  Installing safe_yaml 1.0.5  Fetching hashdiff 0.4.0  Installing hashdiff 0.4.0  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching tzinfo 1.2.5  Installing tzinfo 1.2.5  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching i18n 1.6.0  Installing i18n 1.6.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching rgeo-geojson 2.1.1  Installing rgeo-geojson 2.1.1  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching activesupport 5.2.3  Installing activesupport 5.2.3  Fetching webmock 3.6.0  Installing webmock 3.6.0  Fetching activemodel 5.2.3  Installing activemodel 5.2.3  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching atdis 0.4.1  Installing atdis 0.4.1  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching scraperwiki 3.0.2  Installing scraperwiki 3.0.2  Fetching scraperwiki-morph 0.1.1  Installing scraperwiki-morph 0.1.1  Using atdisplanningalertsfeed 0.1.0 from git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git (at master@a7a7ce7)  Bundle complete! 4 Gemfile dependencies, 34 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from i18n:  HEADS UP! i18n 1.1 changed fallbacks to exclude default locale.  But that may break your application.  Please check your Rails app for 'config.i18n.fallbacks = true'.  If you're using I18n (>= 1.1.0) and Rails (< 5.2.2), this should be  'config.i18n.fallbacks = [I18n.default_locale]'.  If not, fallbacks will be broken in your app by I18n 1.1.x.  For more info see:  https://github.com/svenfuchs/i18n/releases/tag/v1.1.0  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (18.08s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45. Collecting ATDIS feed data for bega_valley... D, [2019-06-18T16:17:38.979700 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=3 D, [2019-06-18T16:17:48.875150 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=4 D, [2019-06-18T16:17:58.730764 #17] DEBUG -- : Fetching http://datracker.begavalley.nsw.gov.au/ATDIS/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=5 D, [2019-06-18T16:18:03.722044 #17] DEBUG -- : Fetching Storing 010.2019.00000213.001 - Field Buckets RD, QUAAMA, NSW 2550 Storing 010.2019.00000199.001 - 14B Elizabeth PDE, TURA BEACH, NSW 2548 Storing 010.2019.00000196.001 - 268 Carp ST, BEGA, NSW 2550 Storing 010.2019.00000198.001 - 22 Sapphire Coast DR, MERIMBULA, NSW 2548 Storing 010.2019.00000208.001 - Cattle Bay RD, EDEN, NSW 2551 Storing 018.2019.00002052.001 - 26 Endeavour DR, WALLAGA LAKE, NSW 2546 Storing 010.2019.00000212.001 - 121 Gipps ST, BEGA, NSW 2550 Storing 010.2019.00000194.001 - 3 Corkhill PL, BEGA, NSW 2550 Storing 010.2019.00000190.001 - 11 Short ST, SOUTH PAMBULA, NSW 2549 Storing 010.2018.00000290.002 - 874 Cobargo Bermagui RD, COOLAGOLITE, NSW 2550 Storing 010.2001.00001748.002 - 57 Green Point RD, MILLINGANDI, NSW 2549 Storing 010.2016.00000237.003 - Mount Darragh RD, SOUTH PAMBULA, NSW 2549 Storing 010.2019.00000211.001 - 70 Tilba RD, WALLAGA LAKE, NSW 2546 Storing 010.2019.00000184.001 - 11/13 Tura Beach DR, TURA BEACH, NSW 2548 Storing 010.2019.00000210.001 - 24 Camilla CT, MIRADOR, NSW 2548 Storing 010.2019.00000193.001 - 32 Ocean View TCE, TATHRA, NSW 2550 Storing 010.2019.00000206.001 - 6 Apoona ST, MERIMBULA, NSW 2548 Storing 010.2019.00000189.001 - 32 Culgoa CR, PAMBULA BEACH, NSW 2549 Storing 010.2019.00000205.001 - 43 Scenic DR, BERMAGUI, NSW 2546 Storing 010.2019.00000209.001 - 12 Kangaroo Run, TURA BEACH, NSW 2548 Storing 018.2019.00002049.001 - 307 Verona RD, VERONA, NSW 2550 Storing 010.2019.00000207.001 - 50 Bungo ST, EDEN, NSW 2551 Storing 010.2019.00000195.001 - 5 Calle Calle ST, EDEN, NSW 2551 Storing 010.2019.00000192.001 - 215 Carp ST, BEGA, NSW 2550 Storing 010.2019.00000181.001 - 850 Snowy Mountains HWY, NUMBUGGA, NSW 2550 Storing 010.2019.00000191.001 - 1/6 Sanctuary PL, TATHRA, NSW 2550 Storing 010.2019.00000204.001 - 115-127 Main ST, MERIMBULA, NSW 2548 Storing 010.2019.00000202.001 - 162 Arthur Kaine DR, PAMBULA, NSW 2549 Storing 010.2019.00000203.001 - Wallaga Lake RD, WALLAGA LAKE, NSW 2546 Storing 010.2019.00000201.001 - 96A Calle Calle ST, EDEN, NSW 2551 Storing 010.2019.00000186.001 - 10 Moore Wren RD, TARRAGANDA, NSW 2550 Storing 010.2019.00000200.001 - 36 Fishpen RD, MERIMBULA, NSW 2548 Storing 010.2017.00000223.002 - 288 Quinlans RD, VERONA, NSW 2550 Storing 010.2019.00000185.001 - 603 Upper Brogo RD, VERONA, NSW 2550 Storing 010.2018.00000120.002 - 43 Mulloway CCT, MERIMBULA, NSW 2548 Storing 018.2019.00002041.001 - 8 Oriole CT, MIRADOR, NSW 2548 Storing 010.2019.00000197.001 - 7 Bay View DR, TATHRA, NSW 2550 Storing 010.2019.00000188.001 - 23 Mulloway CCT, MERIMBULA, NSW 2548 Storing 010.2019.00000187.001 - 234 Pacific WY, TURA BEACH, NSW 2548 Storing 010.2015.00000502.004 - Tura Beach DR, TURA BEACH, NSW 2548 Storing 010.2019.00000183.001 - 80 Emerald CR, WALLAGOOT, NSW 2550 Storing 010.2019.00000182.001 - 42 Billaroy RD, COBARGO, NSW 2550 Collecting ATDIS feed data for ballina... D, [2019-06-18T16:18:52.214166 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=3 D, [2019-06-18T16:19:07.704986 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=4 D, [2019-06-18T16:19:22.268720 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=5 D, [2019-06-18T16:19:43.925521 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=6 D, [2019-06-18T16:20:04.072991 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=7 D, [2019-06-18T16:20:20.613668 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=8 D, [2019-06-18T16:20:42.580183 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=9 D, [2019-06-18T16:21:03.349734 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=10 D, [2019-06-18T16:21:22.078504 #17] DEBUG -- : Fetching http://da.ballina.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=11 D, [2019-06-18T16:21:38.407910 #17] DEBUG -- : Fetching Storing 010.2019.00000316.001 - 20 Canal RD, BALLINA, NSW 2478 Storing 010.2019.00000374.001 - 24 Calnan CR, CUMBALUM, NSW 2478 Storing 010.2019.00000383.001 - 2 Owens LA, EAST WARDELL, NSW 2477 Storing 010.2018.00000568.002 - 1 Seaview ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000380.001 - 9 Sandstone CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000370.001 - 253 Wardell RD, LYNWOOD, NSW 2477 Storing 010.2019.00000319.001 - 2 Scenic CT, ALSTONVILLE, NSW 2477 Storing 010.2019.00000358.001 - 52 Greenfield RD, LENNOX HEAD, NSW 2478 Storing 010.2019.00000400.001 - 97 Fredericks LA, TINTENBAR, NSW 2478 Storing 010.2019.00000308.002 - 8 Kookaburra ST, BALLINA, NSW 2478 Storing 010.2019.00000327.001 - 20 Elevation DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000399.001 - 137 Phoenix DR, TINTENBAR, NSW 2478 Storing 010.2019.00000398.001 - 15 Sandbreak CR, LENNOX HEAD, NSW 2478 Storing 018.2019.00005039.001 - 13 Short ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000353.001 - 3 Kings Park CT, WOLLONGBAR, NSW 2477 Storing 010.2019.00000352.001 - 178 Fox ST, BALLINA, NSW 2478 Storing 010.2019.00000351.001 - 29-31 Smith DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000330.001 - 19 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000397.001 - 61 Amber DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000396.001 - 32 Sunray CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000343.001 - 54 North Creek RD, BALLINA, NSW 2478 Storing 010.2019.00000381.001 - 66 Gibsons RD, ALSTONVALE, NSW 2477 Storing 010.2019.00000377.001 - 21 Spinnaker CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000378.001 - 188 Nashua RD, FERNLEIGH, NSW 2479 Storing 010.2019.00000395.001 - 9 Houghlahans Creek RD, TEVEN, NSW 2478 Storing 010.2019.00000366.001 - 18 Pacific Heights DR, CUMBALUM, NSW 2478 Storing 010.2019.00000321.001 - 1684 Eltham RD, TEVEN, NSW 2478 Storing 010.2019.00000318.001 - 4 Sunrise CR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000394.001 - 20 Longboard ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000393.001 - 80 Kirklands LA, FERNLEIGH, NSW 2479 Storing 010.2019.00000392.001 - 20 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000391.001 - 37 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000390.001 - 18 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000371.001 - 231 Hutley DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000372.001 - 25 Kemp ST, CUMBALUM, NSW 2478 Storing 010.2019.00000389.001 - 6 Willie Wagtail PL, ALSTONVILLE, NSW 2477 Storing 010.2019.00000369.001 - 7 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000388.001 - 62 Avalon AVE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000387.001 - 532 Wardell RD, DALWOOD, NSW 2477 Storing 010.2019.00000367.001 - 47 Quays DR, WEST BALLINA, NSW 2478 Storing 010.2019.00000386.001 - 11 Minley CR, EAST BALLINA, NSW 2478 Storing 010.2019.00000365.001 - 603 Uralba RD, LYNWOOD, NSW 2477 Storing 010.2019.00000363.001 - 102 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000361.001 - 233 Hutley DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000385.001 - 29 Millbrook TCE, WOLLONGBAR, NSW 2477 Storing 010.2019.00000368.001 - 112 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2018.00000666.002 - 87 Ballina ST, LENNOX HEAD, NSW 2478 Storing 010.2018.00000526.002 - 10 Howard CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000384.001 - 976 River DR, KEITH HALL, NSW 2478 Storing 010.2018.00000334.002 - 42 Riverside DR, WEST BALLINA, NSW 2478 Storing 010.2017.00000488.002 - 3 Mayo CT, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000375.001 - 15 Triton St, LENNOX HEAD, NSW 2478 Storing 010.2019.00000362.001 - 17 Opal CR, ALSTONVILLE, NSW 2477 Storing 010.2019.00000359.001 - 4 Brighton ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000100.002 - 8 Olivia CCT, LENNOX HEAD, NSW 2478 Storing 010.2017.00000145.003 - 7 Patchs Beach LA, PATCHS BEACH, NSW 2478 Storing 010.2019.00000355.001 - 8 Angus Kennedy CL, LENNOX HEAD, NSW 2478 Storing 010.2019.00000357.001 - 320 Picadilly Hill RD, NEWRYBAR, NSW 2479 Storing 010.2019.00000379.001 - 3/16 Shelly Beach RD, EAST BALLINA, NSW 2478 Storing 018.2019.00005037.001 - 2-30 Redford DR, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000354.001 - 18 Farrelly AVE, CUMBALUM, NSW 2478 Storing 010.2019.00000356.001 - 122 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000348.001 - 4 Easton PL, EAST BALLINA, NSW 2478 Storing 010.2019.00000350.001 - 195 Old Byron Bay RD, NEWRYBAR, NSW 2479 Storing 010.2019.00000349.001 - 18 Norton ST, BALLINA, NSW 2478 Storing 010.2019.00000346.001 - 44 Catherine CR, BALLINA, NSW 2478 Storing 010.2019.00000364.001 - 25 Lawrence RI, CUMBALUM, NSW 2478 Storing 010.2019.00000360.001 - 28 Ironbark RD, BALLINA, NSW 2478 Storing 010.2019.00000347.001 - 7 Tidepool ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000382.001 - 5-9 Sapphire CT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000345.001 - 16 Hindmarsh ST, EAST BALLINA, NSW 2478 Storing 010.2019.00000342.001 - 10 Triton St, LENNOX HEAD, NSW 2478 Storing 018.2019.00005038.001 - 29 Main ST, ALSTONVILLE, NSW 2477 Storing 010.2019.00000341.001 - 5 Claire CCT, WEST BALLINA, NSW 2478 Storing 010.2019.00000376.001 - 348 Rous RD, ROUS MILL, NSW 2477 Storing 010.2019.00000373.001 - 540 Pimlico RD, PIMLICO, NSW 2478 Storing 010.2019.00000344.001 - 63 Jameson AVE, EAST BALLINA, NSW 2478 Storing 010.2019.00000338.001 - 22 Teal St, BALLINA, NSW 2478 Storing 010.2019.00000336.001 - 246 Martins LA, KNOCKROW, NSW 2479 Storing 010.2019.00000340.001 - 27 Catherine CR, BALLINA, NSW 2478 Storing 018.2019.00005021.001 - 45 Highfield TCE, CUMBALUM, NSW 2478 Storing 010.2019.00000333.001 - 19 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000332.001 - 35 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000335.001 - 17 Longboard ST, LENNOX HEAD, NSW 2478 Storing 010.2019.00000334.001 - 6/39 Fox ST, BALLINA, NSW 2478 Storing 010.2019.00000331.001 - 59 Stoneyhurst DR, LENNOX HEAD, NSW 2478 Storing 010.2019.00000329.001 - 13 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000326.001 - 23 Leeson AVE, BALLINA, NSW 2478 Storing 010.2019.00000337.001 - 17 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000328.001 - 13 Lawrence RI, CUMBALUM, NSW 2478 Storing 010.2019.00000339.001 - 43 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000320.001 - 243 Hutley DR, SKENNARS HEAD, NSW 2478 Storing 010.2018.00000705.002 - 46 Fenwick DR, EAST BALLINA, NSW 2478 Storing 010.2019.00000325.001 - 26 Mosman CH, LENNOX HEAD, NSW 2478 Storing 010.2019.00000324.001 - 4 Lawrence RI, CUMBALUM, NSW 2478 Storing 018.2019.00005036.001 - 22 Perkins CL, CUMBALUM, NSW 2478 Storing 010.2009.00000133.002 - 46 Fenwick DR, EAST BALLINA, NSW 2478 Storing 010.2019.00000314.001 - 557 Byron Bay RD, BROKEN HEAD, NSW 2481 Storing 010.2019.00000322.001 - 17 Leach CR, WEST BALLINA, NSW 2478 Storing 010.2019.00000323.001 - 10 Olivia CCT, LENNOX HEAD, NSW 2478 Storing 010.2019.00000317.001 - 24 Teal St, BALLINA, NSW 2478 Storing 010.2019.00000315.001 - 21 McLeans ST, SKENNARS HEAD, NSW 2478 Storing 010.2019.00000313.001 - 41 Leach CR, WEST BALLINA, NSW 2478 Collecting ATDIS feed data for bathurst... D, [2019-06-18T16:21:56.331647 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=3 D, [2019-06-18T16:22:01.878386 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=4 D, [2019-06-18T16:22:08.839652 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=5 D, [2019-06-18T16:22:15.152471 #17] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=6 D, [2019-06-18T16:22:17.863536 #17] DEBUG -- : Fetching Storing 010.2019.00000180.001 - 51 Bathurst ST, PERTHVILLE, NSW 2795 Storing 010.2006.00000875.002 - 2455 Mid Western HWY, FITZGERALDS MOUNT, NSW 2799 Storing 010.2019.00000177.001 - 30 Logan ST, EGLINTON, NSW 2795 Storing 010.2019.00000179.001 - 256 Piper ST, BATHURST, NSW 2795 Storing 010.2019.00000175.001 - 153 Gormans Hill RD, GORMANS HILL, NSW 2795 Storing 010.2014.00000217.002 - 26 Maxwell DR, EGLINTON, NSW 2795 Storing 010.2019.00000178.001 - 745 Rockley RD, ROCKLEY MOUNT, NSW 2795 Storing 010.2019.00000176.001 - 166 Lambert ST, BATHURST, NSW 2795 Storing 010.2019.00000164.001 - 4 Glazebrooks RD, THE LAGOON, NSW 2795 Storing 018.2019.00000075.001 - 75 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000076.001 - 6 Connolly DR, KELSO, NSW 2795 Storing 010.2019.00000181.001 - 23 Keppel ST, BATHURST, NSW 2795 Storing 018.2019.00000074.001 - 91 Graham DR, KELSO, NSW 2795 Storing 010.2019.00000174.001 - 212 Peel ST, BATHURST, NSW 2795 Storing 010.2017.00000255.002 - 230-240 Sydney RD, KELSO, NSW 2795 Storing 010.2019.00000161.001 - 89 William ST, BATHURST, NSW 2795 Storing 010.2019.00000173.001 - 46 Loren ST, EGLINTON, NSW 2795 Storing 010.2019.00000172.001 - 1 Fraser DR, EGLINTON, NSW 2795 Storing 010.2019.00000152.001 - 54 Lew AVE, EGLINTON, NSW 2795 Storing 018.2019.00000073.001 - 22 Brennan DR, KELSO, NSW 2795 Storing 010.2019.00000153.001 - 72 Piper ST, BATHURST, NSW 2795 Storing 010.2019.00000171.001 - 44 McBrien DR, KELSO, NSW 2795 Storing 010.2019.00000170.001 - 92 Bentinck ST, BATHURST, NSW 2795 Storing 010.2019.00000169.001 - 1 Peard CL, EGLINTON, NSW 2795 Storing 010.2019.00000168.001 - 1 Peard CL, EGLINTON, NSW 2795 Storing 018.2019.00000072.001 - 11 Corporation AVE, ROBIN HILL, NSW 2795 Storing 018.2019.00000071.001 - 49 Fraser DR, EGLINTON, NSW 2795 Storing 010.2019.00000166.001 - 1 Links PL, ROBIN HILL, NSW 2795 Storing 018.2019.00000070.001 - 2 Alluvial PL, KELSO, NSW 2795 Storing 010.2019.00000163.001 - 60 Stack ST, WINDRADYNE, NSW 2795 Storing 010.2019.00000162.001 - 27 Commonwealth ST, WEST BATHURST, NSW 2795 Storing 018.2019.00000069.001 - 59 Newlands CR, KELSO, NSW 2795 Storing 018.2019.00000068.001 - 5 Matthews ST, WINDRADYNE, NSW 2795 Storing 010.2019.00000158.001 - 42 Mendel DR, KELSO, NSW 2795 Storing 010.2019.00000165.001 - 37 Godfrey ST, RAGLAN, NSW 2795 Storing 018.2019.00000064.001 - 16 Burlington RI, KELSO, NSW 2795 Storing 010.2019.00000156.001 - 265 Lambert ST, BATHURST, NSW 2795 Storing 018.2019.00000067.001 - 113 Graham DR, KELSO, NSW 2795 Storing 010.2019.00000160.001 - 49 Dempsey ST, PEEL, NSW 2795 Storing 010.2019.00000157.001 - 8 Dovey DR, KELSO, NSW 2795 Storing 010.2019.00000155.001 - 42 Durham ST, BATHURST, NSW 2795 Storing 018.2019.00000066.001 - 39 William ST, BATHURST, NSW 2795 Storing 018.2019.00000065.001 - 26 Fraser DR, EGLINTON, NSW 2795 Storing 010.2019.00000159.001 - 205 Howick ST, BATHURST, NSW 2795 Storing 010.2019.00000154.001 - 156 Stewart ST, BATHURST, NSW 2795 Storing 018.2019.00000063.001 - 86 Graham DR, KELSO, NSW 2795 Storing 018.2019.00000062.001 - 4 Alluvial PL, KELSO, NSW 2795 Collecting ATDIS feed data for berrigan... Storing 171.19.DA.D5 - 34 MURRAY STREET, TOCUMWAL, NSW 2714 Storing 168.19.DA.D9 - 82 HENNESSY STREET, TOCUMWAL, NSW 2714 Storing 169.19.DA.D1 - 4 MURRAY STREET, BAROOGA, NSW 3644 Storing 166.19.DA.D5 - 50 MURRAY STREET, FINLEY, NSW 2713 Storing 164.19.DA.D7 - 1 ARRAMAGONG STREET, BAROOGA, NSW 3644 Storing 165.19.DA.D1 - 38 LIBERATOR PLACE, FINLEY, NSW 2714 Storing 163.19.DA.D5 - 26 BRUTON STREET, TOCUMWAL, NSW 2714 Storing 162.19.DA.D5 - 32 DENISON STREET, FINLEY, NSW 2713 Storing 160.19.DA.D1 - 30 HADLEY STREET, TOCUMWAL, NSW 2714 Storing 157.19.DA.D1-M - 95 NGAWE ROAD, BAROOGA, NSW 3644 Storing 158.19.DA.DM - 10 BURKINSHAW STREET, BAROOGA, NSW 3644 Storing 155.19.DA.D1 - (NO NAME) (NO TYPE), FINLEY, NSW 2713 Collecting ATDIS feed data for dubbo... D, [2019-06-18T16:22:36.999439 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=3 D, [2019-06-18T16:22:40.740401 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=4 D, [2019-06-18T16:22:44.037269 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=5 D, [2019-06-18T16:22:47.100628 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=6 D, [2019-06-18T16:22:50.375037 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=7 D, [2019-06-18T16:22:53.595393 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=8 D, [2019-06-18T16:22:55.101725 #17] DEBUG -- : Fetching https://planning.dubbo.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=9 W, [2019-06-18T16:22:55.954949 #17] WARN -- : No/invalid pagination, assuming no records/aborting Storing 010.2019.00000266.001 - 4 Ford ST, WELLINGTON, NSW 2820 Storing 010.2019.00000267.001 - 36 Narragal ST, GEURIE, NSW 2818 Storing 010.2019.00000261.001 - 5 Renshaw DR, DUBBO, NSW 2830 Storing 010.2019.00000255.001 - 59 Tamworth ST, DUBBO, NSW 2830 Storing 010.2019.00000265.001 - 21 Gipps ST, DUBBO, NSW 2830 Storing 010.2017.00000462.002 - 197 Wingewarra ST, DUBBO, NSW 2830 Storing 010.2019.00000264.001 - 19 Siren ST, DUBBO, NSW 2830 Storing 010.2019.00000232.001 - 44 Sterling ST, DUBBO, NSW 2830 Storing 010.2019.00000242.001 - 20 Bayou AVE, DUBBO, NSW 2830 Storing 010.2018.00000499.002 - 8 Gipps ST, MONTEFIORES, NSW 2820 Storing 010.2019.00000263.001 - Bradford CRCT, DUBBO, NSW 2830 Storing 010.2019.00000257.001 - 123 Boundary RD, DUBBO, NSW 2830 Storing 010.2019.00000262.001 - 50 Lincoln PKY, DUBBO, NSW 2830 Storing 010.2019.00000258.001 - 117-121 Boundary RD, DUBBO, NSW 2830 Storing 010.2019.00000259.001 - 169 Boundary RD, DUBBO, NSW 2830 Storing 010.2019.00000260.001 - 169 Boundary RD, DUBBO, NSW 2830 Storing 010.2019.00000256.001 - 169 Boundary RD, DUBBO, NSW 2830 Storing 010.2019.00000206.001 - 63-69 Wingewarra ST, DUBBO, NSW 2830 Storing 010.2019.00000244.001 - 1608 Arthurville RD, SUNTOP, NSW 2820 Storing 010.2019.00000216.001 - 30 Peel PL, DUBBO, NSW 2830 Storing 010.2019.00000234.001 - 16 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000240.001 - 776 Driell Creek RD, BODANGORA, NSW 2820 Storing 010.2019.00000243.001 - 26 Purvis LA, DUBBO, NSW 2830 Storing 010.2019.00000215.001 - 1 Wollondilly CRCT, DUBBO, NSW 2830 Storing 010.2019.00000237.001 - 47 Palmer ST, DUBBO, NSW 2830 Storing 010.2019.00000252.001 - 213 Wingewarra ST, DUBBO, NSW 2830 Storing 010.2019.00000251.001 - 67 Holmwood DR, DUBBO, NSW 2830 Storing 010.2019.00000254.001 - 27 Waterfall CRES, DUBBO, NSW 2830 Storing 010.2019.00000253.001 - 42 Waterfall CRES, DUBBO, NSW 2830 Storing 010.2019.00000241.001 - 13 Nancarrow ST, DUBBO, NSW 2830 Storing 010.2019.00000246.001 - 1 Mangrove CRES, DUBBO, NSW 2830 Storing 010.2019.00000214.001 - 5 Raffles CT, DUBBO, NSW 2830 Storing 010.2019.00000250.001 - 43R Plain Creek RD, WONGARBON, NSW 2831 Storing 010.2019.00000169.002 - 4 Spring CT, DUBBO, NSW 2830 Storing 010.2001.00000704.002 - 63 Websdale DR, DUBBO, NSW 2830 Storing 010.2019.00000249.001 - 6 Duke PL, DUBBO, NSW 2830 Storing 010.2019.00000207.001 - 5 Victoria ST, DUBBO, NSW 2830 Storing 010.2019.00000245.001 - 20 Bayou AVE, DUBBO, NSW 2830 Storing 010.2019.00000228.001 - 13 Chondelle CT, DUBBO, NSW 2830 Storing 010.2019.00000239.001 - 10 Jennings ST, GEURIE, NSW 2818 Storing 010.2018.00000364.002 - 112-120 Talbragar ST, DUBBO, NSW 2830 Storing 010.2018.00000513.002 - 2A Alexandrina AVE, DUBBO, NSW 2830 Storing 010.2019.00000238.001 - 13A Nanima CR, WELLINGTON, NSW 2820 Storing 016.2019.00000037.001 - 141 Sheraton RD, DUBBO, NSW 2830 Storing 010.2019.00000236.001 - 31 Azure AVE, DUBBO, NSW 2830 Storing 010.2019.00000235.001 - 14L Dunedoo RD, DUBBO, NSW 2830 Storing 010.2019.00000233.001 - 17 Severn CIR, DUBBO, NSW 2830 Storing 010.2019.00000071.002 - 94 Victoria ST, DUBBO, NSW 2830 Storing 010.2019.00000209.001 - 50 Lincoln PKY, DUBBO, NSW 2830 Storing 016.2019.00000036.001 - 685 Forestvale RD, GOLLAN, NSW 2820 Storing 010.2019.00000222.001 - 12 Susan PL, DUBBO, NSW 2830 Storing 010.2019.00000223.001 - 11 Pindari GR, MONTEFIORES, NSW 2820 Storing 010.2019.00000231.001 - Boundary RD, DUBBO, NSW 2830 Storing 010.2019.00000230.001 - Coronation DR, DUBBO, NSW 2830 Storing 010.2019.00000226.001 - 7 Shindys RD, DUBBO, NSW 2830 Storing 010.2019.00000212.001 - 8 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000220.001 - 10 Timgarlen AVE, DUBBO, NSW 2830 Storing 010.2019.00000213.001 - 44 Argyle AVE, DUBBO, NSW 2830 Storing 010.2019.00000229.001 - 95-105 Curtis ST, WELLINGTON, NSW 2820 Storing 010.2019.00000227.001 - 60L Collie RD, TERRAMUNGAMINE, NSW 2830 Storing 010.2019.00000217.001 - 3 Briarwood PL, DUBBO, NSW 2830 Storing 010.2019.00000225.001 - 12 Wirraway CL, DUBBO, NSW 2830 Storing 010.2019.00000141.002 - 18 Freshwater DR, DUBBO, NSW 2830 Storing 010.2019.00000224.001 - 11 Furney ST, DUBBO, NSW 2830 Storing 010.2019.00000221.001 - 36 Bradford CRCT, DUBBO, NSW 2830 Storing 010.2019.00000219.001 - 10 Bell ST, STUART TOWN, NSW 2820 Storing 010.2019.00000210.001 - 37 Macleay ST, DUBBO, NSW 2830 Storing 010.2019.00000218.001 - 61 Margaret CRES, DUBBO, NSW 2830 Storing 010.2019.00000211.001 - 121 Cobra ST, DUBBO, NSW 2830 Storing 010.2019.00000208.001 - 19 Beni ST, DUBBO, NSW 2830 Collecting ATDIS feed data for kiama... D, [2019-06-18T16:23:19.388370 #17] DEBUG -- : Fetching https://da.kiama.nsw.gov.au/atdis/1.0/applications.json?lodgement_date_end=2019-06-18&lodgement_date_start=2019-05-19&page=3 D, [2019-06-18T16:23:25.087925 #17] DEBUG -- : Fetching Storing 010.2019.00000103.001 - 10 Antrim ST, KIAMA, NSW 2533 Storing 010.2017.00000236.002 - 7 Blair ST, KIAMA, NSW 2533 Storing 010.2013.00000149.002 - 2 Isabella PL, KIAMA, NSW 2533 Storing 010.2019.00000098.001 - 7 Riversdale RD, JAMBEROO, NSW 2533 Storing 010.2019.00000096.001 - 70A Barton DR, KIAMA DOWNS, NSW 2533 Storing 010.2019.00000102.001 - 88 Johnson ST, KIAMA DOWNS, NSW 2533 Storing 010.2013.00000230.003 - 26 Tombonda DR, KIAMA, NSW 2533 Storing 010.2018.00000299.002 - 84 Headland DR, GERROA, NSW 2534 Storing 010.2019.00000094.001 - 55 Surfleet PL, KIAMA, NSW 2533 Storing 010.2019.00000093.001 - 65 Surfleet PL, KIAMA, NSW 2533 Storing 010.2019.00000100.001 - 110 Fountaindale RD, JAMBEROO, NSW 2533 Storing 010.2019.00000099.001 - 5 Dooley RD, TOOLIJOOA, NSW 2534 Storing 010.2015.00000020.002 - 45 Geering ST, GERRINGONG, NSW 2534 Storing 010.2019.00000095.001 - 20 Stafford ST, GERROA, NSW 2534 Storing 010.2019.00000097.001 - 38 Tingira CR, KIAMA, NSW 2533 Storing 010.2019.00000091.001 - 565 Fountaindale RD, SADDLEBACK MOUNTAIN, NSW 2533 Storing 010.2019.00000092.001 - 1 Pheasant Point DR, KIAMA, NSW 2533 Storing 010.2019.00000090.001 - 92 Renfrew RD, WERRI BEACH, NSW 2534 Storing 010.2019.00000089.001 - 34 Surfleet PL, KIAMA, NSW 2533 Storing 010.2018.00000301.002 - 25 Sandy Wha RD, GERRINGONG, NSW 2534 Collecting ATDIS feed data for upper_hunter... Storing 023.2005.00000412.002 - 7 Garnet ST, WINGEN, NSW 2337 Storing 023.2019.00002719.001 - 780 Moobi RD, SCONE, NSW 2337 Storing 023.2019.00002717.001 - 33 Timor RD, BLANDFORD, NSW 2338 Storing 023.2019.00002716.001 - 45A Hall RD, MERRIWA, NSW 2329 Collecting ATDIS feed data for armidale... Storing 260816 - 33 Old Inverell Road, ARMIDALE, NSW 2350 Storing 260638 - 6 Johnson Avenue, ARMIDALE, NSW 2350 Storing 260556 - 91 Swimming Pool Road, TINGHA, NSW 2369 Storing 260537 - 6 Yellowtail Court, ARMIDALE, NSW 2350 Storing 260324 - 55 Trevellie Lane, ARMIDALE, NSW 2350 Storing 260253 - 109 Blue Hole Road, CASTLE DOYLE, NSW 2350 Storing 260027 - 225 Dumaresq Street, ARMIDALE, NSW 2350 Storing 259955 - 21 Ailsa Crescent, ARMIDALE, NSW 2350 Collecting ATDIS feed data for ashfield... Storing 010.2019.00000087.001 - 380 Liverpool Road, ASHFIELD, NSW 2131 Storing 010.2019.00000085.001 - 15 St Davids Road, HABERFIELD, NSW 2045 Storing 010.2019.00000084.001 - 79 Smith Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000083.001 - 278 Hawthorne Parade, HABERFIELD, NSW 2045 Storing 010.2019.00000082.001 - 32 Chandos Street, ASHFIELD, NSW 2131 Storing 010.2019.00000081.001 - 150 Smith Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000080.001 - 25 Alt Street, ASHFIELD, NSW 2131 Storing 010.2019.00000077.001 - 12 Gillies Avenue, HABERFIELD, NSW 2045 Storing 010.2019.00000076.001 - 2 Oaklands Avenue, SUMMER HILL, NSW 2130 Storing 010.2019.00000074.001 - 206 Liverpool Road, ASHFIELD, NSW 2131 Storing 010.2018.00000012.002 - 11 Moonbie Street, SUMMER HILL, NSW 2130 Storing 010.2019.00000071.001 - 14 Hay Street, CROYDON PARK, NSW 2133 Storing 010.2019.00000070.001 - 10 New Street, ASHFIELD, NSW 2131 Collecting ATDIS feed data for leeton... Storing 010.2019.00000055.001 - 5 Waratah Street, LEETON, NSW 2705 Storing 010.2019.00000054.001 - 95 Young Road, WHITTON, NSW 2705 Storing 010.2019.00000053.001 - 6 Grevillia Street, LEETON, NSW 2705 Storing 010.2019.00000052.001 - 881 Whitton to Darlington Pt Road, WHITTON, NSW 2705 Storing 010.2017.00000073.002 - Yarmwal Road, MURRAMI, NSW 2705 Storing 010.2019.00000051.001 - 10 Massey Avenue, LEETON, NSW 2705 Storing 010.2019.00000049.001 - Dempsey Road, LEETON, NSW 2705 Storing 010.2019.00000050.001 - 1 Lansdowne Road, LEETON, NSW 2705 Storing 010.2019.00000048.001 - 34 Ridley Avenue, LEETON, NSW 2705 Storing 010.2019.00000047.001 - 10 Massey Avenue, LEETON, NSW 2705 Collecting ATDIS feed data for muswellbrook... D, [2019-06-18T16:24:06.906148 #17] DEBUG -- : Fetching Storing 017.2019.00000037.001 - Brougham PH, COUNTY DURHAM, NSW 2333 Storing 017.2019.00000036.001 - Denman RD, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000046.001 - 57 Maitland ST, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000045.001 - 160 Almond ST, DENMAN, NSW 2328 Storing 005.2019.00000043.001 - 10 Hermitage PL, MUSWELLBROOK, NSW 2333 Storing 005.2019.00000042.001 - 26 Turanville AVE, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000035.001 - 5 Honeyeater CL, DENMAN, NSW 2328 Storing 005.2019.00000044.001 - Bell ST, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000034.001 - 44 Cook ST, MUSWELLBROOK, NSW 2333 Storing 017.2019.00000032.001 - 22 Collins LA, MUSWELLBROOK, NSW 2333 Collecting ATDIS feed data for walgett... Storing 020.2017.00000030.002 - Castlereagh Highway, LIGHTNING RIDGE, NSW 2834

Data

Downloaded 72 times by openaustralia

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (214 KB) Use the API

rows 10 / 480

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to authority_label
010.2019.00000164.001
119 Lochview Farm RD, LOCHIEL, NSW 2549
Installation of above ground swimming pool
2019-06-06
2019-05-07
bega_valley
010.2012.00000402.002
5 Bells PL, DOCTOR GEORGE MOUNTAIN, NSW 2550
Modification Erection of a dwelling & detached garage/studio & carport
2019-06-06
2019-05-07
2019-05-23
2019-06-06
bega_valley
018.2019.00005032.001
10 Willie Wagtail PL, ALSTONVILLE, NSW 2477
PCA CDC - New Dwelling - Single Residence
2019-06-06
2019-05-07
ballina
010.2019.00000283.001
2/188-202 Southern Cross DR, BALLINA, NSW 2478
Change of Use and Alterations to Commercial Building Change of use from a high technology industry to general industry involving the assembly, manufacture and fitting of prosthetic limbs and alterations to the building
2019-06-06
2019-05-07
ballina
010.2019.00000284.001
84 Meridian DR, COOLGARDIE, NSW 2478
New Dwelling - Single Residence Construction of a two storey dwelling house and associated studio as depicted in plans by Dean Poile Designs for 64 Meridian Drive Coolgardie dated 2 May 2019
2019-06-06
2019-05-07
ballina
010.2019.00000139.001
141 Keppel ST, BATHURST, NSW 2795
Stage 1 - Five lot torens title subdivision (four residential lots and one development lot) Stage 2 - Seven lot strata title subdivision
2019-06-06
2019-05-07
bathurst
018.2019.00000051.001
10 Newlands CR, KELSO, NSW 2795
Construction of a Single storey dwelling with attached garage
2019-06-06
2019-05-07
bathurst
010.2019.00000138.001
82 Graham DR, KELSO, NSW 2795
Dual Occupancy and two lot residential subdivision
2019-06-06
2019-05-07
bathurst
010.2019.00000078.001
21 Boyd ST, MINNAMURRA, NSW 2533
dwelling & air conditioning unit
2019-06-06
2019-05-07
kiama
010.2019.00000080.001
133 Headland DR, GERROA, NSW 2534
detached storage shed
2019-06-06
2019-05-07
2019-05-23
2019-06-06
kiama

Statistics

Average successful run time: 6 minutes

Total run time: about 1 hour

Total cpu time used: half a minute

Total disk space used: 2.36 MB

History

  • Auto ran revision ac2b8d85 and completed successfully .
    340 records added, 322 records removed in the database
  • Auto ran revision ac2b8d85 and completed successfully .
    322 records added, 306 records removed in the database
  • Auto ran revision ac2b8d85 and completed successfully .
    321 records added, 321 records removed in the database
  • Auto ran revision ac2b8d85 and completed successfully .
    333 records added, 333 records removed in the database
  • Auto ran revision ac2b8d85 and failed .
    343 records added, 320 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_atdis / scraper.rb