StashProperty / multiple_masterview

Scrapes multiple authorities that have a masterview system


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What a Masterview website looks like

Sign up

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer AndreM101 njenkins

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: gunnedah, maranoa, broken_hill, gympie, fairfield, fraser_coast, hawkesbury, toowoomba, bundaberg, wingecarribee, albury, bogan, lismore, port_macquarie_hastings, port_stephens, singleton, camden Collecting feed data for gunnedah... Saving record 2017/94/2 - 221 Barlow Rd, Gunnedah 2380 NSW Saving record 2023/1047/1 - 66B Links Rd, Gunnedah 2380 NSW Saving record 2023/83/1 - 41-55 South St, Gunnedah 2380 NSW Saving record 2023/82/1 - 65 Avondale La, Curlewis 2381 NSW Saving record 2023/1050/1 - 48 Kerry Elizabeth Dr, Gunnedah 2380 NSW Saving record 2023/9/2 - 33 Alford Rd, Gunnedah 2380 NSW Saving record 2023/78/1 - 17 South St, Gunnedah 2380 NSW Saving record 2023/41/2 - 34 Talibah St, Gunnedah 2380 NSW Saving record 2023/79/1 - 1-15 Winder Pl, Gunnedah 2380 NSW Saving record 2012/617638/3 - 171-181 George St, Gunnedah 2380 NSW Saving record 2023/80/1 - 77 Hunter St, Gunnedah 2380 NSW Saving record 2023/74/1 - 415-417 Conadilly St, Gunnedah 2380 NSW Saving record 2023/1049/1 - 223 Conadilly St, Gunnedah 2380 NSW Saving record 2023/1048/1 - 72-74 Goran St, Curlewis 2381 NSW Saving record 2023/25/2 - 19 Denora Ave, Gunnedah 2380 NSW Saving record 2011/544933/4 - 95 Leyburn Pl, Gunnedah 2380 NSW Collecting feed data for maranoa... Saving record 22 - 2023 - 20890 - 3 - 30 Howard St, Roma 4455 QLD Saving record 22 - 2023 - 20890 - 2 - 30 Howard St, Roma 4455 QLD Saving record 22 - 2023 - 20994 - 1 - 150 Wallumbilla North Rd, Wallumbilla 4428 QLD Saving record 23 - 2023 - 21001 - 1 - 10 Denton Ct, Injune 4454 QLD Saving record 30 - 2023 - 21000 - 1 - 102 Wyndham St, Roma 4455 QLD Saving record 23 - 2023 - 20989 - 1 - 12 Denton Ct, Injune 4454 QLD Saving record 23 - 2023 - 20990 - 1 - 8 Denton Ct, Injune 4454 QLD Saving record 22 - 2023 - 20999 - 1 - 91A Burrowes St, Surat 4417 QLD Saving record 22 - 2023 - 20998 - 1 - 70 Raglan St, Roma 4455 QLD Saving record 23 - 2022 - 20629 - 1 - 95A Charles St, Roma 4455 QLD Saving record 22 - 2022 - 20629 - 1 - 95A Charles St, Roma 4455 QLD Saving record 23 - 2023 - 20996 - 1 - 478 Dargal Rd, Dargal Road 4455 QLD Saving record 22 - 2023 - 20995 - 1 - George St, Amby 4462 QLD Saving record 23 - 2023 - 20994 - 1 - 150 Wallumbilla North Rd, Wallumbilla 4428 QLD Saving record 23 - 2023 - 20993 - 1 - 9 Denton Ct, Injune 4454 QLD Saving record 22 - 2023 - 20992 - 1 - 41 Edwardes St, Roma 4455 QLD Saving record 30 - 2023 - 20992 - 1 - 41 Edwardes St, Roma 4455 QLD Saving record 30 - 2023 - 20991 - 1 - Fleming Dr, Roma 4455 QLD Saving record 22 - 2023 - 20967 - 1 - 8 Crawford St, Roma 4455 QLD Saving record 30 - 2023 - 20987 - 1 - 67 Cambridge St, Mitchell 4465 QLD Saving record 30 - 2023 - 20984 - 1 - 2 Conlan St, Roma 4455 QLD Saving record 30 - 2014 - 18971 - 6 - 167 Duke St, Roma 4455 QLD Saving record 30 - 2023 - 20983 - 1 - 191 Charles St, Roma 4455 QLD Saving record 30 - 2023 - 20986 - 1 - 112-142 Ona Ona Rd, Roma 4455 QLD Saving record 22 - 2023 - 20985 - 1 - 26 William St, Roma 4455 QLD Saving record 22 - 2023 - 20984 - 1 - 2 Conlan St, Roma 4455 QLD Saving record 22 - 2023 - 20983 - 1 - 191 Charles St, Roma 4455 QLD Saving record 30 - 2014 - 18971 - 7 - 167 Duke St, Roma 4455 QLD Saving record 22 - 2023 - 20982 - 1 - 123-135 Raglan St, Roma 4455 QLD Saving record 30 - 2023 - 20981 - 1 - 73 William St, Surat 4417 QLD Saving record 22 - 2023 - 20978 - 1 - Warrego Hwy, Mitchell 4465 QLD Saving record 30 - 2023 - 20980 - 1 - 1 Cartwright St, Roma 4455 QLD Saving record 22 - 2023 - 20979 - 1 - 66 Mary St, Mitchell 4465 QLD Saving record 23 - 2023 - 20978 - 1 - Warrego Hwy, Mitchell 4465 QLD Saving record 22 - 2023 - 20977 - 1 - 1E Bungil St, Roma 4455 QLD Saving record 23 - 2023 - 20976 - 1 - 150 Wallumbilla North Rd, Wallumbilla 4428 QLD Saving record 22 - 2023 - 20976 - 1 - 150 Wallumbilla North Rd, Wallumbilla 4428 QLD Saving record 23 - 2023 - 20975 - 1 - Robert St, Surat 4417 QLD Saving record 23 - 2023 - 20974 - 1 - 84 Winchester St, Mitchell 4465 QLD Saving record 23 - 2023 - 20973 - 1 - 5 Isabella St, Mitchell 4465 QLD Saving record 23 - 2023 - 20971 - 1 - 9 Isabella St, Mitchell 4465 QLD Saving record 23 - 2023 - 20972 - 1 - 7 Isabella St, Mitchell 4465 QLD Saving record 23 - 2023 - 20970 - 1 - 50-66 Bowen St, Roma 4455 QLD Saving record 22 - 2023 - 20969 - 1 - 105 Cambridge St, Mitchell 4465 QLD Saving record 23 - 2013 - 18600 - 1 - Carnarvon Hwy, Euthulla 4455 QLD Saving record 22 - 1995 - 20960 - 1 - 11 Mcdowall St, Roma 4455 QLD Saving record 30 - 2023 - 20965 - 1 - 32-34 Wormwell Dr, Roma 4455 QLD Saving record 22 - 2023 - 20966 - 1 - 123 Bungeworgorai La, Bungeworgorai 4455 QLD Saving record 30 - 2023 - 20964 - 1 - 485 Corfe Rd, Roma 4455 QLD Saving record 22 - 2023 - 20964 - 1 - 485 Corfe Rd, Roma 4455 QLD Saving record 30 - 2023 - 20963 - 1 - Spencer St, Roma 4455 QLD Saving record 30 - 2023 - 20962 - 1 - 41 Quintin St, Roma 4455 QLD Saving record 22 - 2023 - 20961 - 1 - 9 High St, Wallumbilla 4428 QLD Saving record 30 - 2023 - 20956 - 1 - 1-11 Wormwell Dr, Roma 4455 QLD Saving record 30 - 2023 - 20959 - 1 - 3387 Carnarvon Hwy, Eumamurrin 4455 QLD Saving record 22 - 2023 - 20958 - 1 - 2-28 Timbury St, Roma 4455 QLD Saving record 22 - 2023 - 20957 - 1 - 60 Raglan St, Roma 4455 QLD Collecting feed data for broken_hill... Saving record 10 - 2023 - 125 - 1 - 159 Burke St, Broken Hill 2880 NSW Saving record 10 - 2023 - 117 - 1 - 219 Piper St, Broken Hill 2880 NSW Saving record 10 - 2023 - 123 - 1 - 428 Oxide St, Broken Hill 2880 NSW Saving record 10 - 2021 - 132 - 2 - 90 Patton St, Broken Hill 2880 NSW Saving record 10 - 2023 - 120 - 1 - 264 Oxide St, Broken Hill 2880 NSW Saving record 10 - 2023 - 121 - 1 - 624 Cummins St, Broken Hill 2880 NSW Saving record 10 - 2023 - 119 - 1 - 149 Williams St, Broken Hill 2880 NSW Saving record 10 - 2023 - 115 - 1 - 48 Wyman St, Broken Hill 2880 NSW Saving record 10 - 2023 - 118 - 1 - 26-36 Oxide St, Broken Hill 2880 NSW Saving record 10 - 2023 - 116 - 1 - 514 Wyman Lane, Broken Hill 2880 NSW Saving record 10 - 2023 - 114 - 1 - 336A Mcculloch St, Broken Hill 2880 NSW Saving record 10 - 2023 - 113 - 1 - 413 Oxide St, Broken Hill 2880 NSW Collecting feed data for gympie... Saving record 15.2023.3000.1 - Fullerton Rd, Kybong 4570 QLD Saving record 15.2023.2999.1 - Fullerton Rd, Kybong 4570 QLD Saving record 7.2023.3094.1 - 17 Champagne La, Southside 4570 QLD Saving record 15.2023.3123.1 - 68-72 Exhibition Rd, Southside 4570 QLD Saving record 15.2023.3131.1 - 171 East Deep Creek Rd, East Deep Creek 4570 QLD Saving record 7.2023.2965.1 - Gericke Rd, Woondum 4570 QLD gympie: ERROR: Unknown value of determination type: Received /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' Collecting feed data for fairfield... /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record DA - 330.1/2023 - 20 Caulfield CRES ST JOHNS PARK, NSW Saving record DA - 331.1/2023 - 186 Hume HWY LANSVALE, NSW Saving record DA - 332.1/2023 - 62 Begovich CRES ABBOTSBURY, NSW Saving record DA - 333.1/2023 - 261 Mimosa RD GREENFIELD PARK, NSW Saving record DA - 334.1/2023 - 4 Latitude RD HORSLEY PARK, NSW Saving record DA - 335.1/2023 - 8A Jordan ST FAIRFIELD WEST, NSW Saving record DA - 336.1/2023 - 59 Marlborough ST SMITHFIELD, NSW Saving record DA - 337.1/2023 - 3 Johnston CRES HORSLEY PARK, NSW Saving record DA - 338.1/2023 - 3 Wagner LANE BONNYRIGG HEIGHTS, NSW Saving record DA - 339.1/2023 - 50 Begovich CRES ABBOTSBURY, NSW Saving record DA - 340.1/2023 - 2/151 Orchardleigh ST OLD GUILDFORD, NSW Saving record DA - 342.1/2023 - 20 Coventry RD CABRAMATTA, NSW Saving record DA - 343.1/2023 - 14 Curtin ST CABRAMATTA, NSW Saving record DA - 344.1/2023 - 46 Broughton ST OLD GUILDFORD, NSW Saving record DA - 345.1/2023 - 52-56 Mandarin ST FAIRFIELD EAST, NSW Saving record DA - 346.1/2023 - 83 Oliphant ST MT PRITCHARD, NSW Saving record DA - 347.1/2023 - 64 Polding ST FAIRFIELD, NSW Saving record DA - 348.1/2023 - 123 Campbell ST FAIRFIELD EAST, NSW Saving record DA - 349.1/2023 - 1/185A John ST CABRAMATTA, NSW Saving record DA - 350.1/2023 - 6 Sleigh PL WETHERILL PARK, NSW Saving record DA - 351.1/2023 - 66 Church ST CABRAMATTA, NSW Saving record DA - 352.1/2023 - 528 The Horsley DR FAIRFIELD, NSW Saving record DA - 353.1/2023 - 4 Allen PL WETHERILL PARK, NSW Saving record DA - 354.1/2023 - 77 Anthony ST FAIRFIELD, NSW Saving record DA - 355.1/2023 - 366 Hamilton RD FAIRFIELD WEST, NSW Saving record DA - 356.1/2023 - 12 Newbolt ST WETHERILL PARK, NSW Saving record DA - 357.1/2023 - 3 Whisson CL ABBOTSBURY, NSW Saving record DA - 358.1/2023 - 316 Prairie Vale RD PRAIRIEWOOD, NSW Saving record DA - 359.1/2023 - 7-9 Greenfield RD GREENFIELD PARK, NSW Saving record DA - 360.1/2023 - 130 Hamilton RD FAIRFIELD, NSW Saving record DA - 361.1/2023 - 428-440 Victoria ST WETHERILL PARK, NSW Saving record DA - 362.1/2023 - 39 Huon ST CABRAMATTA, NSW Saving record DA - 363.1/2023 - 852 The Horsley DR SMITHFIELD, NSW Collecting feed data for fraser_coast... fraser_coast: ERROR: 404 => Net::HTTPNotFound for https://pdonline.frasercoast.qld.gov.au/Modules/ApplicationMaster/default.aspx?page=found&1=31/10/2023&2=30/11/2023&4a=BPS%27,%27MC%27,%27OP%27,%27SB%27,%27MCU%27,%27ROL%27,%27OPWKS%27,%27QMCU%27,%27QRAL%27,%27QOPW%27,%27QDBW%27,%27QPOS%27,%27QSPS%27,%27QEXE%27,%27QCAR%27,%27ACA&6=F -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' Collecting feed data for hawkesbury... /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' hawkesbury: ERROR: Failed to open TCP connection to datrack.hawkesbury.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' Collecting feed data for toowoomba... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' toowoomba: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) Collecting feed data for bundaberg... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for wingecarribee... bundaberg: ERROR: 504 => Net::HTTPGatewayTimeOut for https://da.bundaberg.qld.gov.au/Application/GetApplications -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:1323:in `post_form' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:536:in `post' /app/lib/masterview_scraper/get_applications_api.rb:43:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for albury... wingecarribee: ERROR: Couldn't find table /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:165:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for bogan... albury: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for lismore... bogan: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 5.2023.161.1 - 4 Keoghan Dr, Goonellabah 2480 NSW Saving record 10.2023.161.1 - 4 Keoghan Dr, Goonellabah 2480 NSW Saving record 10.2023.181.1 - 32 Greenwood Dr, Goonellabah 2480 NSW Saving record 10.2022.339.1 - 64 Cowlong Rd, Mcleans Ridges 2480 NSW Saving record 5.2023.160.1 - 152 Keen St, Lismore 2480 NSW Saving record 10.2022.257.2 - 60 James St, Dunoon 2480 NSW Saving record 10.2023.305.1 - 3A Allen St, Girards Hill 2480 NSW Saving record 5.2023.305.1 - 3A Allen St, Girards Hill 2480 NSW Saving record 5.2023.299.1 - 417 Rosehill Rd, Blakebrook 2480 NSW Saving record 5.2021.266.3 - 27 Spurfield Rd, Mcleans Ridges 2480 NSW Saving record 5.2023.302.1 - 36 Mahogany Pde, Goonellabah 2480 NSW Saving record 10.2023.191.1 - 4 Evelyn Way, Nimbin 2480 NSW Saving record 10.2023.5.2 - 5 Ferguson Cl, Goonellabah 2480 NSW Saving record 5.2023.5.2 - 5 Ferguson Cl, Goonellabah 2480 NSW Saving record 5.2023.301.1 - 7 Booyong Rd, Clunes 2480 NSW Saving record 8.2023.70.2 - 50/95 Diadem St, Lismore 2480 NSW Saving record 10.2023.147.1 - 25A Walker St, Clunes 2480 NSW Saving record 5.2023.210.1 - 1224 Cawongla Rd, Larnook 2480 NSW Saving record 5.2023.254.1 - 30 Dunoon Rd, North Lismore 2480 NSW Saving record 5.2023.303.1 - 3 Pamela Dr, Chilcotts Grass 2480 NSW Saving record 5.2023.292.1 - 12 Industry Dr, East Lismore 2480 NSW Saving record 5.2023.283.1 - 75 Conway St, Lismore 2480 NSW Saving record 5.2022.381.2 - 1 Evelyn Way, Nimbin 2480 NSW Saving record 10.2022.381.2 - 1 Evelyn Way, Nimbin 2480 NSW Saving record 5.2023.298.1 - 1158 Pinchin Rd, The Channon 2480 NSW Saving record 13.2022.317.1 - 275 Arthur Rd, Corndale 2480 NSW Saving record 5.2023.300.1 - 14 Hillside Dr, Nimbin 2480 NSW Saving record 10.2017.80.2 - 28 Bruxner Hwy, South Lismore 2480 NSW Saving record 5.2023.293.1 - 17 Mandala Cres, Richmond Hill 2480 NSW Saving record 5.2021.388.2 - 14A Grace Rd, Bexhill 2480 NSW Saving record 5.2023.297.1 - 104 Conway St, Lismore 2480 NSW Saving record 10.2023.297.1 - 104 Conway St, Lismore 2480 NSW Saving record 5.2021.132.3 - 426 Ballina Rd, Lismore Heights 2480 NSW Saving record 8.2023.86.1 - 99 Molesworth St, Lismore 2480 NSW Saving record 5.2023.288.1 - 1205 Jiggi Rd, Jiggi 2480 NSW Saving record 5.2023.284.1 - 88 Bagotville Rd, Broadwater 2472 NSW Saving record 5.2004.532.9 - 30 Keoghan Dr, Goonellabah 2480 NSW Saving record 5.2023.247.1 - 697 Tregeagle Rd, Tregeagle 2480 NSW Saving record 5.2023.294.1 - 1566 Bangalow Rd, Clunes 2480 NSW Saving record 5.2023.15.2 - 96D Yeager Rd, Leycester 2480 NSW Saving record 5.2023.281.1 - 21 Stewarts Way, Nimbin 2480 NSW Saving record 5.2023.290.1 - 15 Main St, Clunes 2480 NSW Saving record 10.2023.156.1 - 25 Newbridge St, South Lismore 2480 NSW Saving record 8.2023.84.1 - 8 Ferguson Cl, Goonellabah 2480 NSW Saving record 10.2022.284.1 - 1/28 Cook St, South Lismore 2480 NSW Saving record 5.2023.285.1 - 19 Krauss Ave, South Lismore 2480 NSW Saving record 8.2023.83.1 - 29 Molesworth St, Lismore 2480 NSW Saving record 5.2019.65.2 - 628 Koonorigan Rd, Koonorigan 2480 NSW Saving record 8.2023.82.1 - 7/44 Carrington St, Lismore 2480 NSW Saving record 10.2023.176.1 - 21 Ryces Dr, Clunes 2480 NSW Saving record 8.2023.81.1 - 27 Homestead Ave, Goonellabah 2480 NSW Saving record 5.2023.287.1 - 115 Cameron Rd, Mcleans Ridges 2480 NSW Saving record 10.2023.287.1 - 115 Cameron Rd, Mcleans Ridges 2480 NSW Saving record 10.2023.265.1 - 4 Stewarts Way, Nimbin 2480 NSW Saving record 5.2023.239.1 - 640 Tregeagle Rd, Tregeagle 2480 NSW Saving record 13.2023.1007.1 - 329 Kyogle Rd, Tuncester 2480 NSW Saving record 5.2023.282.1 - 33 Waratah Way, Goonellabah 2480 NSW Saving record 5.2023.275.1 - 319 Arthur Rd, Dorroughby 2480 NSW Saving record 5.2023.248.1 - 48 Dudley Dr, Goonellabah 2480 NSW Saving record 10.2023.248.1 - 48 Dudley Dr, Goonellabah 2480 NSW Saving record 10.2023.257.1 - 10A Fredericks Rd, Caniaba 2480 NSW Saving record 5.2023.246.1 - 30 Evergreen Dr, Goonellabah 2480 NSW Saving record 5.2023.278.1 - 248 Arthur Rd, Corndale 2480 NSW Saving record 5.2023.277.1 - 21 Elm Rd, Goonellabah 2480 NSW Saving record 5.2023.276.1 - 8/4 Wallaby Rd, Stony Chute 2480 NSW Saving record 8.2023.80.1 - 19 Krauss Ave, South Lismore 2480 NSW Saving record 40.2023.739.1 - 27 Snow St, South Lismore 2480 NSW Collecting feed data for port_macquarie_hastings... port_macquarie_hastings: ERROR: end of file reached /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:189:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' Collecting feed data for port_stephens... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for singleton... port_stephens: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 8.2023.575.1 - 6 Maybon Cl, Branxton NSW 2335 Saving record 10.2023.486.1 - 79 Minimbah Dr, Whittingham NSW 2330 Collecting feed data for camden... singleton: ERROR: Unexpected field in: Determination Type: /app/lib/masterview_scraper/pages/detail.rb:198:in `block in extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:189:in `each' /app/lib/masterview_scraper/pages/detail.rb:189:in `extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:209:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record S96/2021/357/2 - 153-157 Macarthur Rd, Spring Farm 2570 NSW Saving record OC/2022/182/2 - 141 Olive Hill Dr, Cobbitty 2570 NSW Saving record DA/2023/662/1 - 26 Joseph Rd, Leppington 2179 NSW Saving record DA/2023/669/1 - 261 Dwyer Rd, Leppington 2179 NSW Saving record DA/2023/667/1 - 35-39 Argyle St, Camden 2570 NSW Saving record DA/2023/670/1 - 165 Argyle St, Camden 2570 NSW Saving record DA/2023/668/1 - 44 Topham Rd, Smeaton Grange 2567 NSW Saving record OC/2021/351/2 - 73 Bluebell Cres, Spring Farm 2570 NSW Saving record OC/2022/1074/1 - 44 Floyd St, Spring Farm 2570 NSW Saving record OC/2023/384/1 - 401 Oran Park Dr, Oran Park 2570 NSW Saving record CC/2023/431/1 - 32 Hungerford St, Catherine Field 2557 NSW Saving record CC/2022/1021/1 - 4 Cockatoo St, Gregory Hills 2557 NSW Saving record DA/2023/671/1 - 13 Templeton Rd, Elderslie 2570 NSW Saving record CC/2023/665/1 - 19 Elder Way, Mount Annan 2567 NSW Saving record DA/2023/665/1 - 19 Elder Way, Mount Annan 2567 NSW Saving record CC/2023/663/1 - 75 Lodges Rd, Elderslie 2570 NSW Saving record DA/2023/663/1 - 75 Lodges Rd, Elderslie 2570 NSW Saving record S96/2022/1033/2 - 1 Elizabeth Macarthur Ave, Camden South 2570 NSW Saving record DA/2023/664/1 - 9 Stimpson Cres, Grasmere 2570 NSW Saving record S96/2021/1675/2 - 64 Menangle Rd, Camden 2570 NSW Saving record DA/2023/660/1 - 26 Monash Ave, Gledswood Hills 2557 NSW Saving record DA/2023/646/1 - 4 Munday Pl, Currans Hill 2567 NSW Saving record CC/2023/657/1 - 1 Byrne Pl, Camden 2570 NSW Saving record DA/2023/657/1 - 1 Byrne Pl, Camden 2570 NSW Saving record DA/2023/666/1 - 5 Rock Fern Ave, Cobbitty 2570 NSW Saving record DA/2023/661/1 - 1-3 Rock Fern Ave, Cobbitty 2570 NSW Saving record OC/2021/481/2 - 47 Berkshire Cct, Leppington 2179 NSW Saving record OC/2020/706/2 - 36 Astley Rd, Catherine Field 2557 NSW Saving record OC/2022/847/1 - 89 Liz Kernohan Dr, Elderslie 2570 NSW Saving record CDC/2023/1074/1 - 2 Holborn Cct, Gledswood Hills 2557 NSW Saving record DA/2023/652/1 - 4 Chellaston St, Camden 2570 NSW Saving record DA/2023/653/1 - 40 Menangle Rd, Camden 2570 NSW Saving record DA/2023/659/1 - 2/2 Forge Pl, Narellan 2567 NSW Saving record DA/2023/645/1 - 14 Marshall Ave, Spring Farm 2570 NSW Saving record DA/2023/651/1 - 9 O'Dea Rd, Mount Annan 2567 NSW Saving record DA/2023/649/1 - 11 Mcpherson Rd, Smeaton Grange 2567 NSW Saving record DA/2023/648/1 - 1 Gregory Hills Dr, Gledswood Hills 2557 NSW Saving record CC/2023/573/1 - 35 Purcell St, Elderslie 2570 NSW Saving record DA/2023/654/1 - 3 Southwell Rd, Oran Park 2570 NSW Saving record CDC/2023/1067/1 - 5 Sunshine St, Oran Park 2570 NSW Saving record CDC/2023/1068/1 - 14 Rock Fern Ave, Cobbitty 2570 NSW Saving record CDC/2023/1070/1 - 81 Berkshire Cct, Leppington 2179 NSW Saving record CDC/2023/1071/1 - 7 Berkshire Cct, Leppington 2179 NSW Saving record S96/2021/1453/4 - 650 The Northern Rd, Oran Park 2570 NSW Saving record CDC/2023/1064/1 - 9 River Mint Ave, Leppington 2179 NSW Saving record OC/2019/1414/2 - 74 Kokoda Cct, Mount Annan 2567 NSW Saving record CC/2022/882/2 - 14-26 Central Hills Dr, Gregory Hills 2557 NSW Saving record CC/2023/24/1 - 90 Werombi Rd, Grasmere 2570 NSW Saving record S96/2022/15/2 - 23 Central Hills Dr, Gregory Hills 2557 NSW Saving record CDC/2023/1061/1 - 15 Dusty Way, Catherine Field 2557 NSW Saving record DA/2023/658/1 - 5 Walker St, Oran Park 2570 NSW Saving record DA/2023/655/1 - 8 Furlong Dr, Currans Hill 2567 NSW Saving record CDC/2023/1055/1 - 34 Fuyu St, Cobbitty 2570 NSW Saving record OC/2023/159/1 - 41 Cycads Way, Currans Hill 2567 NSW Saving record OC/2023/33/1 - 41 Cycads Way, Currans Hill 2567 NSW Saving record OC/2022/2292/2 - 91A Liz Kernohan Dr, Elderslie 2570 NSW Saving record OC/2022/1119/1 - 34 Cycads Way, Currans Hill 2567 NSW Saving record OC/2021/430/4 - 61 Leslie Way, Leppington 2179 NSW Saving record OC/2022/383/2 - 25 Ivory Curl St, Gregory Hills 2557 NSW Saving record CDC/2023/874/2 - 17 The Clearwater, Mount Annan 2567 NSW Saving record CDC/2022/284/2 - 16 Samphire St, Cobbitty 2570 NSW Saving record DA/2023/656/1 - 18 Berallier Dr, Camden South 2570 NSW Saving record DA/2023/650/1 - 59 Heath Rd, Leppington 2179 NSW Saving record DA/2023/640/1 - 31 Murrandah Ave, Camden 2570 NSW Saving record EngCC/2023/215/1 - 43 Charles Mcintosh Pwy, Cobbitty 2570 NSW Saving record OC/2022/1113/1 - 93A Liz Kernohan Dr, Elderslie 2570 NSW Saving record CDC/2023/861/2 - 5 Burgmann St, Oran Park 2570 NSW Saving record OC/2023/559/1 - 3 Clinton Dr, Narellan 2567 NSW Saving record CDC/2023/1053/1 - 15 Starling St, Cobbitty 2570 NSW Saving record DA/2023/647/1 - 5/61 Holdsworth Dr, Narellan Vale 2567 NSW Saving record DA/2023/644/1 - 15 Birdwing St, Leppington 2179 NSW Saving record EngCC/2022/69/12 - 114 Ridge Sq, Leppington 2179 NSW Saving record OC/2022/522/2 - 5 Mary Fairfax Dr, Oran Park 2570 NSW Saving record EngCC/2022/69/11 - 114 Ridge Sq, Leppington 2179 NSW Saving record CDC/2022/1900/2 - 21 Samphire St, Cobbitty 2570 NSW Saving record OC/2018/1377/2 - 8 Mornington Gr, Gledswood Hills 2557 NSW Saving record OC/2021/1502/2 - 4 Rymill Cres, Gledswood Hills 2557 NSW Saving record OC/2022/846/1 - 11 Ashbrook Dr, Catherine Field 2557 NSW Saving record OC/2022/1100/2 - 8 Equinox St, Oran Park 2570 NSW Saving record OC/2021/997/2 - 28 Saturn St, Leppington 2179 NSW Saving record OC/2022/836/1 - 35 Muntries St, Cobbitty 2570 NSW Saving record OC/2020/492/2 - 25 Fleece Loop, Oran Park 2570 NSW Saving record OC/2021/472/5 - 43 Loveday St, Oran Park 2570 NSW Saving record OC/2021/472/4 - 43 Loveday St, Oran Park 2570 NSW Saving record OC/2021/472/3 - 43 Loveday St, Oran Park 2570 NSW Saving record OC/2022/426/1 - 33 Thoroughbred Dr, Cobbitty 2570 NSW Saving record CDC/2023/1044/1 - 15 Herd St, Oran Park 2570 NSW Saving record OC/2021/384/2 - 27 Toovey Ave, Oran Park 2570 NSW Saving record OC/2022/303/2 - 3 Nectarine Cres, Cobbitty 2570 NSW Saving record OC/2019/111/2 - 11A Lowndes Dr, Oran Park 2570 NSW Saving record CC/2022/909/1 - 148 Waterworth Dr, Mount Annan 2567 NSW Saving record CC/2023/388/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CC/2023/355/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CC/2023/354/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CC/2023/353/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CDC/2023/1042/1 - 17 Softwood St, Spring Farm 2570 NSW Saving record CDC/2023/1041/1 - 8 Burke St, Oran Park 2570 NSW Saving record CDC/2023/1043/1 - 20 Henrietta Dr, Narellan Vale 2567 NSW Saving record CDC/2023/1040/1 - 13 Possum St, Cobbitty 2570 NSW Saving record CDC/2023/1039/1 - 153 Olive Hill Dr, Cobbitty 2570 NSW Saving record OC/2022/2301/1 - 24 Phillips Ave, Oran Park 2570 NSW Saving record DA/2023/630/1 - 6 Aotus Cct, Mount Annan 2567 NSW Saving record OC/2021/1112/3 - 25 Samphire St, Cobbitty 2570 NSW Saving record OC/2022/2121/2 - 43 Enterprise St, Gregory Hills 2557 NSW Saving record OC/2023/797/1 - 326 Camden Valley Way, Narellan 2567 NSW Saving record OC/2022/2294/1 - 115 Pluto Ave, Leppington 2179 NSW Saving record DA/2023/636/1 - 6 Birdwing St, Leppington 2179 NSW Saving record DA/2023/629/1 - 7 Antonio Way, Gregory Hills 2557 NSW Saving record CC/2023/560/1 - 33 Tussock Ave, Cobbitty 2570 NSW Saving record DA/2023/639/1 - 84 Easton Ave, Spring Farm 2570 NSW Saving record OC/2022/2063/1 - 96 Evergreen Dr, Oran Park 2570 NSW Saving record OC/2023/204/1 - 10 Cockatoo St, Gregory Hills 2557 NSW Saving record OC/2021/384/4 - 27 Toovey Ave, Oran Park 2570 NSW Saving record OC/2022/340/4 - 10 Cockatoo St, Gregory Hills 2557 NSW Saving record S96/2023/445/2 - 146 Werombi Rd, Ellis Lane 2570 NSW Saving record S96/2022/467/2 - 34 Pindari Ave, Camden 2570 NSW Saving record OC/2021/1137/2 - 43 Pleasant Cct, Gledswood Hills 2557 NSW Saving record S96/2022/915/2 - 6/31 Argyle St, Camden 2570 NSW Saving record OC/2022/2248/1 - 14 Swift Ave, Leppington 2179 NSW Saving record CDC/2023/1057/1 - 8 Heartfruit Ave, Cobbitty 2570 NSW Saving record CDC/2023/1056/1 - 11 Starling St, Cobbitty 2570 NSW Saving record DA/2023/643/1 - 98 Easton Ave, Spring Farm 2570 NSW Saving record DA/2023/642/1 - 19 Bertram Pl, Narellan Vale 2567 NSW Saving record DA/2023/632/1 - 751 The Northern Rd, Bringelly 2556 NSW Saving record DA/2023/637/1 - 24 Lord Eldon Dr, Harrington Park 2567 NSW Saving record OC/2021/1457/2 - 19 Corella Ave, Oran Park 2570 NSW Saving record OC/2021/384/3 - 27 Toovey Ave, Oran Park 2570 NSW Saving record OC/2022/2109/1 - 5 Cattle Way, Gregory Hills 2557 NSW Saving record OC/2022/942/1 - 1 Quince Way, Cobbitty 2570 NSW Saving record OC/2018/886/1 - 700 Cut Hill Rd, Cobbitty 2570 NSW Saving record OC/2022/77/2 - 4 Hughes Ave, Harrington Park 2567 NSW Saving record OC/2022/250/2 - 17-19 Mcpherson Rd, Smeaton Grange 2567 NSW Saving record CDC/2023/1048/1 - 214 Ingleburn Rd, Leppington 2179 NSW Saving record S96/2022/45/2 - 155 Ingleburn Rd, Leppington 2179 NSW Saving record DA/2023/641/1 - 40 Whitten Pde, Harrington Park 2567 NSW Saving record DA/2023/633/1 - 15 Burgmann St, Oran Park 2570 NSW Saving record OC/2023/684/1 - 36 Orbit St, Gregory Hills 2557 NSW Saving record CC/2023/611/1 - 10 Squires Ave, Cobbitty 2570 NSW Saving record OC/2023/812/2 - 17 Eastwood Rd, Leppington 2179 NSW Saving record OC/2022/639/2 - 30 Saturn St, Leppington 2179 NSW Saving record CDC/2023/1047/1 - 345 Bringelly Rd, Leppington 2179 NSW Saving record CDC/2023/1045/1 - 50 Heartfruit Ave, Cobbitty 2570 NSW Saving record DA/2023/624/1 - 206 Springs Rd, Spring Farm 2570 NSW Saving record EngCC/2021/1453/3 - 650 The Northern Rd, Oran Park 2570 NSW Saving record DA/2023/638/1 - 56 Merino Dr, Elderslie 2570 NSW Saving record DA/2023/631/1 - 62 Central Ave, Oran Park 2570 NSW Saving record OC/2022/1884/2 - 19A-19B Ettlesdale Rd, Spring Farm 2570 NSW Saving record OC/2023/243/1 - 29A-29B Herd St, Oran Park 2570 NSW Saving record S96/2021/1861/2 - 34 Woodpack St, Leppington 2179 NSW Saving record OC/2022/635/2 - 19 Cavallero Rise, Gledswood Hills 2557 NSW Saving record CDC/2023/1036/1 - 3 Somervaille Dr, Catherine Field 2557 NSW Saving record CC/2018/1065/1 - 43 Mimosa St, Gregory Hills 2557 NSW Saving record OC/2023/108/1 - 47 Canola St, Oran Park 2570 NSW Saving record OC/2023/252/1 - 40 Royal George Dr, Harrington Park 2567 NSW Saving record OC/2022/2219/1 - 24 Somervaille Dr, Catherine Field 2557 NSW Saving record OC/2019/673/3 - 4 Koonara Gra, Gledswood Hills 2557 NSW Saving record CDC/2023/1032/1 - 42 Harrison Ave, Harrington Park 2567 NSW Saving record OC/2022/535/2 - 12 Saltbush Ave, Cobbitty 2570 NSW Saving record SC/2022/309/1 - 70A-70B Water Gum Rd, Gregory Hills 2557 NSW Saving record OC/2021/1936/1 - 29 Mark Rd, Rossmore 2557 NSW Saving record OC/2021/1190/2 - 30 Saturn St, Leppington 2179 NSW Saving record OC/2022/1083/2 - 12 Brennan Rd, Elderslie 2570 NSW Saving record OC/2022/174/2 - 13 Cornforth Cres, Catherine Field 2557 NSW Saving record CDC/2023/1031/1 - 2 Brennan Rd, Elderslie 2570 NSW Saving record CDC/2023/1029/1 - 12 Cowra Pl, Gregory Hills 2557 NSW Saving record CC/2022/535/2 - 12 Saltbush Ave, Cobbitty 2570 NSW Saving record CC/2023/81/1 - 165 Kirkham Ln, Kirkham 2570 NSW Saving record EngCC/2023/303/1 - 25-37 Civic Way, Oran Park 2570 NSW Saving record CDC/2023/1028/1 - 4 Lawson Ave, Camden South 2570 NSW Saving record OC/2018/1618/2 - 82 Floyd St, Spring Farm 2570 NSW Saving record OC/2020/370/3 - 85 Kokoda Cct, Mount Annan 2567 NSW Saving record CDC/2023/1024/1 - 1 Terrier St, Oran Park 2570 NSW Saving record DA/2023/634/1 - 407 Catherine Fields Rd, Catherine Field 2557 NSW Saving record DA/2023/635/1 - 27 Jenolan Cct, Harrington Park 2567 NSW Saving record CC/2023/240/1 - 97 Werombi Rd, Grasmere 2570 NSW Saving record CC/2023/565/1 - 52 Belmont Ave, Spring Farm 2570 NSW Saving record OC/2022/2174/1 - 24 Swift Ave, Leppington 2179 NSW Saving record CDC/2023/1022/1 - 21 Karen Rd, Rossmore 2557 NSW Saving record CDC/2023/1021/1 - 351 Oran Park Dr, Oran Park 2570 NSW Saving record EngCC/2022/704/1 - 600J The Northern Rd, Oran Park 2570 NSW Saving record OC/2021/1424/1 - 60 Central Ave, Oran Park 2570 NSW Saving record OC/2020/456/3 - 40 Mantis Cct, Leppington 2179 NSW Saving record OC/2023/331/2 - 35-35A Woodland Cres, Narellan 2567 NSW Saving record CDC/2023/1020/1 - 9 Frank Brooking Cl, Camden South 2570 NSW Saving record CDC/2023/1019/1 - 20 Heartfruit Ave, Cobbitty 2570 NSW Saving record CDC/2023/1018/1 - 8 Sunshine St, Oran Park 2570 NSW Saving record CC/2023/346/1 - 80 Old Hume Hwy, Camden 2570 NSW Saving record SC/2023/433/1 - 680 The Northern Rd, Oran Park 2570 NSW Saving record EngCC/2023/37/1 - 15 Galaxy St, Oran Park 2570 NSW Saving record OC/2022/814/2 - 1 Falcon Rd, Oran Park 2570 NSW Saving record OC/2023/393/1 - 46 Haselgrove St, Gledswood Hills 2557 NSW Saving record S96/2022/836/2 - 35 Muntries St, Cobbitty 2570 NSW Saving record OC/2018/1067/3 - 56 Power Rdge, Oran Park 2570 NSW Saving record EngCC/2022/69/10 - 143 Heath Rd, Leppington 2179 NSW Saving record CDC/2023/1014/1 - 8 Cattle Way, Gregory Hills 2557 NSW Saving record SC/2021/164/1 - 31A-31B Long Reef Cct, Gregory Hills 2557 NSW Saving record OC/2023/493/1 - 181 Mount Annan Dr, Mount Annan 2567 NSW Saving record S96/2023/451/2 - 43 Gleeson Rise, Oran Park 2570 NSW Saving record OC/2022/892/2 - 6 Domenics Pl, Grasmere 2570 NSW Saving record OC/2023/171/1 - 61 Mccall Ave, Camden South 2570 NSW camden: ERROR: Unknown value of determination type: Completed *************************************************** /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' Now retrying authorities which earlier had failures /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' *************************************************** Collecting feed data for gympie... /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 15.2023.3000.1 - Fullerton Rd, Kybong 4570 QLD Saving record 15.2023.2999.1 - Fullerton Rd, Kybong 4570 QLD Saving record 7.2023.3094.1 - 17 Champagne La, Southside 4570 QLD Saving record 15.2023.3123.1 - 68-72 Exhibition Rd, Southside 4570 QLD Saving record 15.2023.3131.1 - 171 East Deep Creek Rd, East Deep Creek 4570 QLD Saving record 7.2023.2965.1 - Gericke Rd, Woondum 4570 QLD gympie: ERROR: Unknown value of determination type: Received /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' Collecting feed data for fraser_coast... /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' fraser_coast: ERROR: 404 => Net::HTTPNotFound for https://pdonline.frasercoast.qld.gov.au/Modules/ApplicationMaster/default.aspx?page=found&1=31/10/2023&2=30/11/2023&4a=BPS%27,%27MC%27,%27OP%27,%27SB%27,%27MCU%27,%27ROL%27,%27OPWKS%27,%27QMCU%27,%27QRAL%27,%27QOPW%27,%27QDBW%27,%27QPOS%27,%27QSPS%27,%27QEXE%27,%27QCAR%27,%27ACA&6=F -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' Collecting feed data for hawkesbury... /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' hawkesbury: ERROR: Failed to open TCP connection to datrack.hawkesbury.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' Collecting feed data for toowoomba... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for bundaberg... toowoomba: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for wingecarribee... bundaberg: ERROR: Net::ReadTimeout /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:1323:in `post_form' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:536:in `post' /app/lib/masterview_scraper/get_applications_api.rb:43:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for albury... wingecarribee: ERROR: Couldn't find table /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:165:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' albury: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' Collecting feed data for bogan... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for port_macquarie_hastings... bogan: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for port_stephens... port_macquarie_hastings: ERROR: end of file reached /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:189:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for singleton... port_stephens: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Saving record 8.2023.575.1 - 6 Maybon Cl, Branxton NSW 2335 Saving record 10.2023.486.1 - 79 Minimbah Dr, Whittingham NSW 2330 Collecting feed data for camden... singleton: ERROR: Unexpected field in: Determination Type: /app/lib/masterview_scraper/pages/detail.rb:198:in `block in extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:189:in `each' /app/lib/masterview_scraper/pages/detail.rb:189:in `extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:209:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Saving record S96/2021/357/2 - 153-157 Macarthur Rd, Spring Farm 2570 NSW Saving record OC/2022/182/2 - 141 Olive Hill Dr, Cobbitty 2570 NSW Saving record DA/2023/662/1 - 26 Joseph Rd, Leppington 2179 NSW Saving record DA/2023/669/1 - 261 Dwyer Rd, Leppington 2179 NSW Saving record DA/2023/667/1 - 35-39 Argyle St, Camden 2570 NSW Saving record DA/2023/670/1 - 165 Argyle St, Camden 2570 NSW Saving record DA/2023/668/1 - 44 Topham Rd, Smeaton Grange 2567 NSW Saving record OC/2021/351/2 - 73 Bluebell Cres, Spring Farm 2570 NSW Saving record OC/2022/1074/1 - 44 Floyd St, Spring Farm 2570 NSW Saving record OC/2023/384/1 - 401 Oran Park Dr, Oran Park 2570 NSW Saving record CC/2023/431/1 - 32 Hungerford St, Catherine Field 2557 NSW Saving record CC/2022/1021/1 - 4 Cockatoo St, Gregory Hills 2557 NSW Saving record DA/2023/671/1 - 13 Templeton Rd, Elderslie 2570 NSW Saving record CC/2023/665/1 - 19 Elder Way, Mount Annan 2567 NSW Saving record DA/2023/665/1 - 19 Elder Way, Mount Annan 2567 NSW Saving record CC/2023/663/1 - 75 Lodges Rd, Elderslie 2570 NSW Saving record DA/2023/663/1 - 75 Lodges Rd, Elderslie 2570 NSW Saving record S96/2022/1033/2 - 1 Elizabeth Macarthur Ave, Camden South 2570 NSW Saving record DA/2023/664/1 - 9 Stimpson Cres, Grasmere 2570 NSW Saving record S96/2021/1675/2 - 64 Menangle Rd, Camden 2570 NSW Saving record DA/2023/660/1 - 26 Monash Ave, Gledswood Hills 2557 NSW Saving record DA/2023/646/1 - 4 Munday Pl, Currans Hill 2567 NSW Saving record CC/2023/657/1 - 1 Byrne Pl, Camden 2570 NSW Saving record DA/2023/657/1 - 1 Byrne Pl, Camden 2570 NSW Saving record DA/2023/666/1 - 5 Rock Fern Ave, Cobbitty 2570 NSW Saving record DA/2023/661/1 - 1-3 Rock Fern Ave, Cobbitty 2570 NSW Saving record OC/2021/481/2 - 47 Berkshire Cct, Leppington 2179 NSW Saving record OC/2020/706/2 - 36 Astley Rd, Catherine Field 2557 NSW Saving record OC/2022/847/1 - 89 Liz Kernohan Dr, Elderslie 2570 NSW Saving record CDC/2023/1074/1 - 2 Holborn Cct, Gledswood Hills 2557 NSW Saving record DA/2023/652/1 - 4 Chellaston St, Camden 2570 NSW Saving record DA/2023/653/1 - 40 Menangle Rd, Camden 2570 NSW Saving record DA/2023/659/1 - 2/2 Forge Pl, Narellan 2567 NSW Saving record DA/2023/645/1 - 14 Marshall Ave, Spring Farm 2570 NSW Saving record DA/2023/651/1 - 9 O'Dea Rd, Mount Annan 2567 NSW Saving record DA/2023/649/1 - 11 Mcpherson Rd, Smeaton Grange 2567 NSW Saving record DA/2023/648/1 - 1 Gregory Hills Dr, Gledswood Hills 2557 NSW Saving record CC/2023/573/1 - 35 Purcell St, Elderslie 2570 NSW Saving record DA/2023/654/1 - 3 Southwell Rd, Oran Park 2570 NSW Saving record CDC/2023/1067/1 - 5 Sunshine St, Oran Park 2570 NSW Saving record CDC/2023/1068/1 - 14 Rock Fern Ave, Cobbitty 2570 NSW Saving record CDC/2023/1070/1 - 81 Berkshire Cct, Leppington 2179 NSW Saving record CDC/2023/1071/1 - 7 Berkshire Cct, Leppington 2179 NSW Saving record S96/2021/1453/4 - 650 The Northern Rd, Oran Park 2570 NSW Saving record CDC/2023/1064/1 - 9 River Mint Ave, Leppington 2179 NSW Saving record OC/2019/1414/2 - 74 Kokoda Cct, Mount Annan 2567 NSW Saving record CC/2022/882/2 - 14-26 Central Hills Dr, Gregory Hills 2557 NSW Saving record CC/2023/24/1 - 90 Werombi Rd, Grasmere 2570 NSW Saving record S96/2022/15/2 - 23 Central Hills Dr, Gregory Hills 2557 NSW Saving record CDC/2023/1061/1 - 15 Dusty Way, Catherine Field 2557 NSW Saving record DA/2023/658/1 - 5 Walker St, Oran Park 2570 NSW Saving record DA/2023/655/1 - 8 Furlong Dr, Currans Hill 2567 NSW Saving record CDC/2023/1055/1 - 34 Fuyu St, Cobbitty 2570 NSW Saving record OC/2023/159/1 - 41 Cycads Way, Currans Hill 2567 NSW Saving record OC/2023/33/1 - 41 Cycads Way, Currans Hill 2567 NSW Saving record OC/2022/2292/2 - 91A Liz Kernohan Dr, Elderslie 2570 NSW Saving record OC/2022/1119/1 - 34 Cycads Way, Currans Hill 2567 NSW Saving record OC/2021/430/4 - 61 Leslie Way, Leppington 2179 NSW Saving record OC/2022/383/2 - 25 Ivory Curl St, Gregory Hills 2557 NSW Saving record CDC/2023/874/2 - 17 The Clearwater, Mount Annan 2567 NSW Saving record CDC/2022/284/2 - 16 Samphire St, Cobbitty 2570 NSW Saving record DA/2023/656/1 - 18 Berallier Dr, Camden South 2570 NSW Saving record DA/2023/650/1 - 59 Heath Rd, Leppington 2179 NSW Saving record DA/2023/640/1 - 31 Murrandah Ave, Camden 2570 NSW Saving record EngCC/2023/215/1 - 43 Charles Mcintosh Pwy, Cobbitty 2570 NSW Saving record OC/2022/1113/1 - 93A Liz Kernohan Dr, Elderslie 2570 NSW Saving record CDC/2023/861/2 - 5 Burgmann St, Oran Park 2570 NSW Saving record OC/2023/559/1 - 3 Clinton Dr, Narellan 2567 NSW Saving record CDC/2023/1053/1 - 15 Starling St, Cobbitty 2570 NSW Saving record DA/2023/647/1 - 5/61 Holdsworth Dr, Narellan Vale 2567 NSW Saving record DA/2023/644/1 - 15 Birdwing St, Leppington 2179 NSW Saving record EngCC/2022/69/12 - 114 Ridge Sq, Leppington 2179 NSW Saving record OC/2022/522/2 - 5 Mary Fairfax Dr, Oran Park 2570 NSW Saving record EngCC/2022/69/11 - 114 Ridge Sq, Leppington 2179 NSW Saving record CDC/2022/1900/2 - 21 Samphire St, Cobbitty 2570 NSW Saving record OC/2018/1377/2 - 8 Mornington Gr, Gledswood Hills 2557 NSW Saving record OC/2021/1502/2 - 4 Rymill Cres, Gledswood Hills 2557 NSW Saving record OC/2022/846/1 - 11 Ashbrook Dr, Catherine Field 2557 NSW Saving record OC/2022/1100/2 - 8 Equinox St, Oran Park 2570 NSW Saving record OC/2021/997/2 - 28 Saturn St, Leppington 2179 NSW Saving record OC/2022/836/1 - 35 Muntries St, Cobbitty 2570 NSW Saving record OC/2020/492/2 - 25 Fleece Loop, Oran Park 2570 NSW Saving record OC/2021/472/5 - 43 Loveday St, Oran Park 2570 NSW Saving record OC/2021/472/4 - 43 Loveday St, Oran Park 2570 NSW Saving record OC/2021/472/3 - 43 Loveday St, Oran Park 2570 NSW Saving record OC/2022/426/1 - 33 Thoroughbred Dr, Cobbitty 2570 NSW Saving record CDC/2023/1044/1 - 15 Herd St, Oran Park 2570 NSW Saving record OC/2021/384/2 - 27 Toovey Ave, Oran Park 2570 NSW Saving record OC/2022/303/2 - 3 Nectarine Cres, Cobbitty 2570 NSW Saving record OC/2019/111/2 - 11A Lowndes Dr, Oran Park 2570 NSW Saving record CC/2022/909/1 - 148 Waterworth Dr, Mount Annan 2567 NSW Saving record CC/2023/388/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CC/2023/355/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CC/2023/354/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CC/2023/353/1 - 1 Campion Way, Spring Farm 2570 NSW Saving record CDC/2023/1042/1 - 17 Softwood St, Spring Farm 2570 NSW Saving record CDC/2023/1041/1 - 8 Burke St, Oran Park 2570 NSW Saving record CDC/2023/1043/1 - 20 Henrietta Dr, Narellan Vale 2567 NSW Saving record CDC/2023/1040/1 - 13 Possum St, Cobbitty 2570 NSW Saving record CDC/2023/1039/1 - 153 Olive Hill Dr, Cobbitty 2570 NSW Saving record OC/2022/2301/1 - 24 Phillips Ave, Oran Park 2570 NSW Saving record DA/2023/630/1 - 6 Aotus Cct, Mount Annan 2567 NSW Saving record OC/2021/1112/3 - 25 Samphire St, Cobbitty 2570 NSW Saving record OC/2022/2121/2 - 43 Enterprise St, Gregory Hills 2557 NSW Saving record OC/2023/797/1 - 326 Camden Valley Way, Narellan 2567 NSW Saving record OC/2022/2294/1 - 115 Pluto Ave, Leppington 2179 NSW Saving record DA/2023/636/1 - 6 Birdwing St, Leppington 2179 NSW Saving record DA/2023/629/1 - 7 Antonio Way, Gregory Hills 2557 NSW Saving record CC/2023/560/1 - 33 Tussock Ave, Cobbitty 2570 NSW Saving record DA/2023/639/1 - 84 Easton Ave, Spring Farm 2570 NSW Saving record OC/2022/2063/1 - 96 Evergreen Dr, Oran Park 2570 NSW Saving record OC/2023/204/1 - 10 Cockatoo St, Gregory Hills 2557 NSW Saving record OC/2021/384/4 - 27 Toovey Ave, Oran Park 2570 NSW Saving record OC/2022/340/4 - 10 Cockatoo St, Gregory Hills 2557 NSW Saving record S96/2023/445/2 - 146 Werombi Rd, Ellis Lane 2570 NSW Saving record S96/2022/467/2 - 34 Pindari Ave, Camden 2570 NSW Saving record OC/2021/1137/2 - 43 Pleasant Cct, Gledswood Hills 2557 NSW Saving record S96/2022/915/2 - 6/31 Argyle St, Camden 2570 NSW Saving record OC/2022/2248/1 - 14 Swift Ave, Leppington 2179 NSW Saving record CDC/2023/1057/1 - 8 Heartfruit Ave, Cobbitty 2570 NSW Saving record CDC/2023/1056/1 - 11 Starling St, Cobbitty 2570 NSW Saving record DA/2023/643/1 - 98 Easton Ave, Spring Farm 2570 NSW Saving record DA/2023/642/1 - 19 Bertram Pl, Narellan Vale 2567 NSW Saving record DA/2023/632/1 - 751 The Northern Rd, Bringelly 2556 NSW Saving record DA/2023/637/1 - 24 Lord Eldon Dr, Harrington Park 2567 NSW Saving record OC/2021/1457/2 - 19 Corella Ave, Oran Park 2570 NSW Saving record OC/2021/384/3 - 27 Toovey Ave, Oran Park 2570 NSW Saving record OC/2022/2109/1 - 5 Cattle Way, Gregory Hills 2557 NSW Saving record OC/2022/942/1 - 1 Quince Way, Cobbitty 2570 NSW Saving record OC/2018/886/1 - 700 Cut Hill Rd, Cobbitty 2570 NSW Saving record OC/2022/77/2 - 4 Hughes Ave, Harrington Park 2567 NSW Saving record OC/2022/250/2 - 17-19 Mcpherson Rd, Smeaton Grange 2567 NSW Saving record CDC/2023/1048/1 - 214 Ingleburn Rd, Leppington 2179 NSW Saving record S96/2022/45/2 - 155 Ingleburn Rd, Leppington 2179 NSW Saving record DA/2023/641/1 - 40 Whitten Pde, Harrington Park 2567 NSW Saving record DA/2023/633/1 - 15 Burgmann St, Oran Park 2570 NSW Saving record OC/2023/684/1 - 36 Orbit St, Gregory Hills 2557 NSW Saving record CC/2023/611/1 - 10 Squires Ave, Cobbitty 2570 NSW Saving record OC/2023/812/2 - 17 Eastwood Rd, Leppington 2179 NSW Saving record OC/2022/639/2 - 30 Saturn St, Leppington 2179 NSW Saving record CDC/2023/1047/1 - 345 Bringelly Rd, Leppington 2179 NSW Saving record CDC/2023/1045/1 - 50 Heartfruit Ave, Cobbitty 2570 NSW Saving record DA/2023/624/1 - 206 Springs Rd, Spring Farm 2570 NSW Saving record EngCC/2021/1453/3 - 650 The Northern Rd, Oran Park 2570 NSW Saving record DA/2023/638/1 - 56 Merino Dr, Elderslie 2570 NSW Saving record DA/2023/631/1 - 62 Central Ave, Oran Park 2570 NSW Saving record OC/2022/1884/2 - 19A-19B Ettlesdale Rd, Spring Farm 2570 NSW Saving record OC/2023/243/1 - 29A-29B Herd St, Oran Park 2570 NSW Saving record S96/2021/1861/2 - 34 Woodpack St, Leppington 2179 NSW Saving record OC/2022/635/2 - 19 Cavallero Rise, Gledswood Hills 2557 NSW Saving record CDC/2023/1036/1 - 3 Somervaille Dr, Catherine Field 2557 NSW Saving record CC/2018/1065/1 - 43 Mimosa St, Gregory Hills 2557 NSW Saving record OC/2023/108/1 - 47 Canola St, Oran Park 2570 NSW Saving record OC/2023/252/1 - 40 Royal George Dr, Harrington Park 2567 NSW Saving record OC/2022/2219/1 - 24 Somervaille Dr, Catherine Field 2557 NSW Saving record OC/2019/673/3 - 4 Koonara Gra, Gledswood Hills 2557 NSW Saving record CDC/2023/1032/1 - 42 Harrison Ave, Harrington Park 2567 NSW Saving record OC/2022/535/2 - 12 Saltbush Ave, Cobbitty 2570 NSW Saving record SC/2022/309/1 - 70A-70B Water Gum Rd, Gregory Hills 2557 NSW Saving record OC/2021/1936/1 - 29 Mark Rd, Rossmore 2557 NSW Saving record OC/2021/1190/2 - 30 Saturn St, Leppington 2179 NSW Saving record OC/2022/1083/2 - 12 Brennan Rd, Elderslie 2570 NSW Saving record OC/2022/174/2 - 13 Cornforth Cres, Catherine Field 2557 NSW Saving record CDC/2023/1031/1 - 2 Brennan Rd, Elderslie 2570 NSW Saving record CDC/2023/1029/1 - 12 Cowra Pl, Gregory Hills 2557 NSW Saving record CC/2022/535/2 - 12 Saltbush Ave, Cobbitty 2570 NSW Saving record CC/2023/81/1 - 165 Kirkham Ln, Kirkham 2570 NSW Saving record EngCC/2023/303/1 - 25-37 Civic Way, Oran Park 2570 NSW Saving record CDC/2023/1028/1 - 4 Lawson Ave, Camden South 2570 NSW Saving record OC/2018/1618/2 - 82 Floyd St, Spring Farm 2570 NSW Saving record OC/2020/370/3 - 85 Kokoda Cct, Mount Annan 2567 NSW Saving record CDC/2023/1024/1 - 1 Terrier St, Oran Park 2570 NSW Saving record DA/2023/634/1 - 407 Catherine Fields Rd, Catherine Field 2557 NSW Saving record DA/2023/635/1 - 27 Jenolan Cct, Harrington Park 2567 NSW Saving record CC/2023/240/1 - 97 Werombi Rd, Grasmere 2570 NSW Saving record CC/2023/565/1 - 52 Belmont Ave, Spring Farm 2570 NSW Saving record OC/2022/2174/1 - 24 Swift Ave, Leppington 2179 NSW Saving record CDC/2023/1022/1 - 21 Karen Rd, Rossmore 2557 NSW Saving record CDC/2023/1021/1 - 351 Oran Park Dr, Oran Park 2570 NSW Saving record EngCC/2022/704/1 - 600J The Northern Rd, Oran Park 2570 NSW Saving record OC/2021/1424/1 - 60 Central Ave, Oran Park 2570 NSW Saving record OC/2020/456/3 - 40 Mantis Cct, Leppington 2179 NSW Saving record OC/2023/331/2 - 35-35A Woodland Cres, Narellan 2567 NSW Saving record CDC/2023/1020/1 - 9 Frank Brooking Cl, Camden South 2570 NSW Saving record CDC/2023/1019/1 - 20 Heartfruit Ave, Cobbitty 2570 NSW Saving record CDC/2023/1018/1 - 8 Sunshine St, Oran Park 2570 NSW Saving record CC/2023/346/1 - 80 Old Hume Hwy, Camden 2570 NSW Saving record SC/2023/433/1 - 680 The Northern Rd, Oran Park 2570 NSW Saving record EngCC/2023/37/1 - 15 Galaxy St, Oran Park 2570 NSW Saving record OC/2022/814/2 - 1 Falcon Rd, Oran Park 2570 NSW Saving record OC/2023/393/1 - 46 Haselgrove St, Gledswood Hills 2557 NSW Saving record S96/2022/836/2 - 35 Muntries St, Cobbitty 2570 NSW Saving record OC/2018/1067/3 - 56 Power Rdge, Oran Park 2570 NSW Saving record EngCC/2022/69/10 - 143 Heath Rd, Leppington 2179 NSW Saving record CDC/2023/1014/1 - 8 Cattle Way, Gregory Hills 2557 NSW Saving record SC/2021/164/1 - 31A-31B Long Reef Cct, Gregory Hills 2557 NSW Saving record OC/2023/493/1 - 181 Mount Annan Dr, Mount Annan 2567 NSW Saving record S96/2023/451/2 - 43 Gleeson Rise, Oran Park 2570 NSW Saving record OC/2022/892/2 - 6 Domenics Pl, Grasmere 2570 NSW Saving record OC/2023/171/1 - 61 Mccall Ave, Camden South 2570 NSW camden: ERROR: Unknown value of determination type: Completed /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' scraper.rb:43:in `<main>': There were errors with the following authorities: [:gympie, :fraser_coast, :hawkesbury, :toowoomba, :bundaberg, :wingecarribee, :albury, :bogan, :port_macquarie_hastings, :port_stephens, :singleton, :camden]. See earlier output for details (RuntimeError)

Data

Downloaded 70 times by dcalde AndreM101 muzzie86 jamasalbertastash

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (16.9 MB) Use the API

rows 10 / 44084

council_reference address description info_url date_scraped date_received authority_label
10-2021-16-1
2 Angus St, Forbes 2871 NSW
New Garages/Sheds - Industrial
2021-03-16
2021-02-22
forbes
10-2021-15-1
613 Wongajong Rd, Forbes 2871 NSW
New Single Dwelling
2021-03-16
2021-02-18
forbes
10-2021-13-1
1829 Lachlan Valley Wy, Jemalong 2871 NSW
New Single Dwelling
2021-03-16
2021-02-15
forbes
10-2021-14-1
131A Wambat St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-02-16
forbes
10-2017-80-3
33-37 Sam St, Forbes 2871 NSW
New Commercial Building
2021-03-16
2021-03-03
forbes
10-2021-19-1
36A William St, Forbes 2871 NSW
Patio Cover
2021-03-16
2021-03-05
forbes
10-2021-20-1
2 Rae St, Forbes 2871 NSW
New Ancillary Residential Development-Shed/Carport
2021-03-16
2021-03-05
forbes
10-2021-18-1
12 Acacia Ave, Forbes 2871 NSW
New Ancillary Residential Development-Shed
2021-03-16
2021-03-02
forbes
10-2021-17-1
10 Thelma St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-03-02
forbes
10-2021-1-1
Ooma St, Forbes 2871 NSW
Ancillary Residential Development - Awning
2021-03-16
2021-02-25
forbes

Statistics

Average successful run time: about 7 hours

Total run time: about 2 months

Total cpu time used: about 4 hours

Total disk space used: 143 MB

History

  • Auto ran revision 028c1c13 and failed .
    393 records added, 366 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    488 records added, 460 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    527 records added, 485 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    443 records added, 427 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    486 records added, 486 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_masterview / scraper.rb