StashProperty / multiple_masterview

Injecting configuration and compiling... Injecting scraper and running... Default EXPECT_BAD: --- :bogan: https://github.com/planningalerts-scrapers/issues/issues/935 - Council website bad, does not publish Scraping authorities: albury, ballina, bega_valley, bogan, broken_hill, bundaberg, burwood, byron, cessnock, dubbo, fairfield, griffith, gunnedah, gympie, lismore, maranoa, muswellbrook, port_macquarie_hastings, port_stephens, shoalhaven, singleton, strathfield, upper_hunter Collecting feed data for albury, attempt: 1... Collecting feed data for ballina, attempt: 1... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 12 Edward Pl, Knockrow NSW 2479 Saving record ballina - 71/2 Martin St, Ballina NSW 2478 Saving record ballina - 110 Whites La, Alstonville NSW 2477 Saving record ballina - 26 Coogee St, East Ballina NSW 2478 Saving record ballina - 31 Daintree Dr, Lennox Head NSW 2478 Saving record ballina - 36 Ironbark Rd, Ballina NSW 2478 Saving record ballina - 3 Sunbird Ave, Ballina NSW 2478 Saving record ballina - 16 Cooloola Ave, Lennox Head NSW 2478 Saving record ballina - 16 Cooloola Ave, Lennox Head NSW 2478 Saving record ballina - 2 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 20 Russellton Dr, Alstonville NSW 2477 Saving record ballina - 35 Sandstone Cr, Lennox Head NSW 2478 Saving record ballina - 2 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 16 Linderman St, West Ballina NSW 2478 Saving record ballina - 19 Old Pacific Hwy, Newrybar NSW 2479 Saving record ballina - 56 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 5 John Sharpe St, East Ballina NSW 2478 Saving record ballina - 56 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 37 Millbrook Tce, Wollongbar NSW 2477 Saving record ballina - 165 Ballina Rd, Alstonville NSW 2477 Saving record ballina - 12-16 Fig Tree Hill Dr, Lennox Head NSW 2478 Saving record ballina - 43 Avalon Ave, Wollongbar NSW 2477 Saving record ballina - 6 Acreage St, Cumbalum NSW 2478 Saving record ballina - 46 Teakwood Dr, Alstonville NSW 2477 Saving record ballina - 5 Cessna Cr, Ballina NSW 2478 Saving record ballina - 33B Richmond St, Wardell NSW 2477 Saving record ballina - 24 George St, Tintenbar NSW 2478 Saving record ballina - 1 Smiths La, Wollongbar NSW 2477 Saving record ballina - 21 Adele St, Alstonville NSW 2477 Saving record ballina - 15 Darcey Ave, Cumbalum NSW 2478 Saving record ballina - 66 Teven Rd, West Ballina NSW 2478 Saving record ballina - 13 Salt Air Cct, Lennox Head NSW 2478 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 43 Avalon Ave, Wollongbar NSW 2477 Saving record ballina - 44 Kalinga St, West Ballina NSW 2478 Saving record ballina - 60 Salt Air Cct, Lennox Head NSW 2478 Saving record ballina - 9 Elsa Ave, Wollongbar NSW 2477 Saving record ballina - 1 Rifle Range Rd, Wollongbar NSW 2477 Saving record ballina - 135 River St, Ballina NSW 2478 Saving record ballina - 16 Canal Rd, Ballina NSW 2478 Saving record ballina - 2 Blue Horizon Dr, Lennox Head NSW 2478 Saving record ballina - 4 Treelands Cr, Ballina NSW 2478 Saving record ballina - 42 Fishery Creek Rd, Ballina NSW 2478 Saving record ballina - 137 Friday Hut Rd, Tintenbar NSW 2478 Saving record ballina - 14 Anchorage Ave, Lennox Head NSW 2478 Saving record ballina - 15 Valley Dr, Alstonville NSW 2477 Saving record ballina - 134 Pine St, Wardell NSW 2477 Saving record ballina - 1/18 Dalmacia Dr, Wollongbar NSW 2477 Saving record ballina - 1 Pimlico Isl, Pimlico Island NSW 2478 Saving record ballina - 1 Pimlico Isl, Pimlico Island NSW 2478 Saving record ballina - 1 Sunray Cr, Lennox Head NSW 2478 Saving record ballina - 14 Anchorage Ave, Lennox Head NSW 2478 Saving record ballina - 16 Wave Break Cct, Skennars Head NSW 2478 Saving record ballina - 195 Cumbalum Rd, Cumbalum NSW 2478 Saving record ballina - 4 Parkview Cir, Alstonville NSW 2477 Saving record ballina - 22 Cambridge Cr, East Ballina NSW 2478 Saving record ballina - 8 Millbrook Tce, Wollongbar NSW 2477 Saving record ballina - 663 Fernleigh Rd, Brooklet NSW 2479 Saving record ballina - 26 Parkland Dr, Alstonville NSW 2477 Saving record ballina - 11 Sunbird Ave, Ballina NSW 2478 Saving record ballina - 1 Russell St, Ballina NSW 2478 Saving record ballina - 5 Lakefield Ave, Lennox Head NSW 2478 Saving record ballina - 27 Leach Cr, West Ballina NSW 2478 Saving record ballina - 12 River Dr, East Wardell NSW 2477 Saving record ballina - 21 Sunray Cr, Lennox Head NSW 2478 Saving record ballina - 8 Callicoma Ct, Wollongbar NSW 2477 Saving record ballina - 155 Burnet St, Ballina NSW 2478 Saving record ballina - 1 Camden St, Ballina NSW 2478 Saving record ballina - 350 North Creek Rd, Skennars Head NSW 2478 Saving record ballina - 53 Stoneyhurst Dr, Lennox Head NSW 2478 Saving record ballina - 356 Old Byron Bay Rd, Newrybar NSW 2479 Saving record ballina - 31 Green St, Alstonville NSW 2477 Saving record ballina - 9 Burnet St, Ballina NSW 2478 Saving record ballina - 9 Burnet St, Ballina NSW 2478 Saving record ballina - 28 Bantry St, Ballina NSW 2478 Saving record ballina - 37 Avalon Ave, Wollongbar NSW 2477 Saving record ballina - 1 Rocky Point Rd, Lennox Head NSW 2478 Saving record ballina - 30 Pine Ave, East Ballina NSW 2478 Saving record ballina - 93 Weis La, Rous NSW 2477 Saving record ballina - 25 Delva Rd, Wollongbar NSW 2477 Saving record ballina - 131 Tuckombil La, Tuckombil NSW 2477 Saving record ballina - 13 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 5 Stonehenge Pl, Lennox Head NSW 2478 Saving record ballina - 2/81 Tamar St, Ballina NSW 2478 Saving record ballina - 334 Uralba Rd, Uralba NSW 2477 Saving record ballina - 1/75-77 Daintree Dr, Lennox Head NSW 2478 Saving record ballina - 167 Rous Rd, Rous NSW 2477 Saving record ballina - 37 Anderson St, East Ballina NSW 2478 Saving record ballina - 12 Lynette Cct, Wollongbar NSW 2477 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 32 Boeing Ave, Ballina NSW 2478 Saving record ballina - 4 Shelly Beach Rd, East Ballina NSW 2478 Saving record ballina - 12 Lynette Cct, Wollongbar NSW 2477 Saving record ballina - 1/19 Northcott Cr, Alstonville NSW 2477 Saving record ballina - 134 Pine St, Wardell NSW 2477 Saving record ballina - 489 Friday Hut Rd, Brooklet NSW 2479 Saving record ballina - 13 Mainsail Pl, West Ballina NSW 2478 Saving record ballina - 16 Wave Break Cct, Skennars Head NSW 2478 Saving record ballina - 751 Bagotville Rd, Bagotville NSW 2477 Saving record ballina - 7 Short St, East Ballina NSW 2478 /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 73 Riverside Dr, West Ballina NSW 2478 Saving record ballina - 13 Casuarina Rd, East Ballina NSW 2478 Saving record ballina - 4 Wattle Cr, East Ballina NSW 2478 Saving record ballina - 21 Norton St, Ballina NSW 2478 Saving record ballina - 8 Byron Bay Rd, Lennox Head NSW 2478 Saving record ballina - 1/28 Dundee Ave, Wollongbar NSW 2477 Saving record ballina - 6 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 3 Andrew Pl, Lennox Head NSW 2478 Saving record ballina - 67B Teven Rd, Alstonville NSW 2477 Saving record ballina - 25 Howard Cr, West Ballina NSW 2478 Saving record ballina - 107 Martin St, Ballina NSW 2478 Saving record ballina - 107 Martin St, Ballina NSW 2478 Saving record ballina - 11 Darcey Ave, Cumbalum NSW 2478 Saving record ballina - 15 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 41 Sandstone Cr, Lennox Head NSW 2478 Saving record ballina - 1/6 Crane St, Ballina NSW 2478 Collecting feed data for bega_valley, attempt: 1... Collecting feed data for bogan, attempt: 1... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for broken_hill, attempt: 1... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record broken_hill - 326 Iodide St, Broken Hill NSW 2880 Saving record broken_hill - 334 Morgan St, Broken Hill NSW 2880 Saving record broken_hill - 697 Williams St, Broken Hill NSW 2880 Saving record broken_hill - 191 Pell St, Broken Hill NSW 2880 Saving record broken_hill - 651 Beryl St, Broken Hill NSW 2880 Saving record broken_hill - 24 Creedon St, Broken Hill NSW 2880 Saving record broken_hill - 142 Clarke St, Broken Hill NSW 2880 Saving record broken_hill - Pro Hart Way, Broken Hill NSW 2880 Saving record broken_hill - 235 Racecourse Rd, Broken Hill NSW 2880 Saving record broken_hill - 106 Duff St, Broken Hill NSW 2880 Saving record broken_hill - 481 Lane St, Broken Hill NSW 2880 Collecting feed data for bundaberg, attempt: 1... Collecting feed data for burwood, attempt: 1... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for byron, attempt: 1... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 32 Station St, Mullumbimby 2482 NSW Saving record byron - 465 Coorabell Rd, Coorabell 2479 NSW Saving record byron - 136 Repentance Creek Rd, Goonengerry 2482 NSW Saving record byron - 4 Browning St, Byron Bay 2481 NSW Saving record byron - 46 Paterson Ln, Byron Bay 2481 NSW Saving record byron - 16 James View Crt, Coorabell 2479 NSW Saving record byron - 97 Balemo Drv, Ocean Shores 2483 NSW Saving record byron - 131 Alcorn St, Suffolk Park 2481 NSW Saving record byron - 32 Brandon St, Suffolk Park 2481 NSW Saving record byron - 4 Mahr Pl, Suffolk Park 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 16 Brushbox Drv, Mullumbimby Creek 2482 NSW Saving record byron - 15 Marvell St, Byron Bay 2481 NSW Saving record byron - 21 New City Rd, Mullumbimby 2482 NSW Saving record byron - 5/7 Lawson St, Byron Bay 2481 NSW Saving record byron - 11 Brunswick Ter, Mullumbimby 2482 NSW Saving record byron - 294 Picadilly Hill Rd, Coopers Shoot 2481 NSW Saving record byron - 3 Shirley St, Byron Bay 2481 NSW Saving record byron - 8 Kiyung Crt, Ocean Shores 2483 NSW Saving record byron - 20 Palm Valley Drv, Byron Bay 2481 NSW Saving record byron - 29 Keats St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 41 Matong Drv, Ocean Shores 2483 NSW Saving record byron - 26 Philip St, South Golden Beach 2483 NSW Saving record byron - 139 Jonson St, Byron Bay 2481 NSW Saving record byron - 887 The Pocket Rd, The Pocket 2483 NSW Saving record byron - 57 Ward Ln, Mullumbimby 2482 NSW Saving record byron - 13A Palm Ave, Mullumbimby 2482 NSW Saving record byron - 50 Kings Rd, Nashua 2479 NSW Saving record byron - 69 New Brighton Rd, New Brighton 2483 NSW Saving record byron - 3 Ann St, Mullumbimby 2482 NSW Saving record byron - 6 Byron Bay Rd, Bangalow 2479 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 22 Johnstons Ln, Main Arm 2482 NSW Saving record byron - 22 Tongarra Drv, Ocean Shores 2483 NSW Saving record byron - 118 Crystal Creek Cct, Coorabell 2479 NSW Saving record byron - 6 Goshawk Ln, Mullumbimby 2482 NSW Saving record byron - 29 Peter St, South Golden Beach 2483 NSW Saving record byron - 54 New Brighton Rd, New Brighton 2483 NSW Saving record byron - 6 Keesing Ln, Byron Bay 2481 NSW Saving record byron - 16 James View Crt, Coorabell 2479 NSW Saving record byron - 51 Mullumbimby Rd, Myocum 2482 NSW Saving record byron - 49 Paterson St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 115 Stuart St, Mullumbimby 2482 NSW Saving record byron - 17 Muli Muli Ave, Ocean Shores 2483 NSW Saving record byron - 11 Pacific Esp, South Golden Beach 2483 NSW Saving record byron - 26 Kendall St, Byron Bay 2481 NSW Saving record byron - 12/77 Frasers Rd, Mullumbimby Creek 2482 NSW Saving record byron - 4 Clifford St, South Golden Beach 2483 NSW Saving record byron - 28 Balemo Drv, Ocean Shores 2483 NSW Saving record byron - 106 Quarry Ln, Ewingsdale 2481 NSW Saving record byron - 4/27 Kalemajere Drv, Suffolk Park 2481 NSW Saving record byron - 416 Goonengerry Rd, Goonengerry 2482 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 3 Stuart St, Mullumbimby 2482 NSW Saving record byron - 12 Towers Drv, Mullumbimby 2482 NSW Saving record byron - 124 Mcgoughans Ln, Mullumbimby 2482 NSW Saving record byron - 1/8 Coomburra Crs, Ocean Shores 2483 NSW Saving record byron - 38 Booyun St, Brunswick Heads 2483 NSW Saving record byron - 5 Autumn Crt, Byron Bay 2481 NSW Saving record byron - 49 Paterson St, Byron Bay 2481 NSW Saving record byron - 25 Manns Rd, Mullumbimby 2482 NSW Saving record byron - 3 Goninan Pl, Possum Creek 2479 NSW Saving record byron - 253 Bangalow Rd, Hayters Hill 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 48 Tongarra Drv, Ocean Shores 2483 NSW Saving record byron - 2 Paldi Crt, Ocean Shores 2483 NSW Saving record byron - 8 Milton St, Byron Bay 2481 NSW Saving record byron - 41 Cowper St, Byron Bay 2481 NSW Saving record byron - 41 Orana Rd, Ocean Shores 2483 NSW Saving record byron - 28 Kingsley St, Byron Bay 2481 NSW Saving record byron - 52 New City Rd, Mullumbimby 2482 NSW Saving record byron - 21 Rajah Rd, Ocean Shores 2483 NSW Saving record byron - 887 The Pocket Rd, The Pocket 2483 NSW Saving record byron - 5 Hanlon Crt, Bangalow 2479 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 15 Beachcomber Drv, Byron Bay 2481 NSW Saving record byron - 10 Brandon St, Suffolk Park 2481 NSW Saving record byron - 21 Middleton St, Byron Bay 2481 NSW Saving record byron - 12 Marvell St, Byron Bay 2481 NSW Saving record byron - 8 Elizabeth Ave, South Golden Beach 2483 NSW Saving record byron - 121 Eureka Rd, Clunes 2480 NSW Saving record byron - 10 Hazelwood Cl, Suffolk Park 2481 NSW Saving record byron - 16 James View Crt, Coorabell 2479 NSW Saving record byron - 58 Brandon St, Suffolk Park 2481 NSW Saving record byron - 9 Marvell St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - Ewingsdale Rd, Byron Bay 2481 NSW Saving record byron - 3 Cedarvale Rd, Bangalow 2479 NSW Saving record byron - 19A Beech Drv, Suffolk Park 2481 NSW Saving record byron - 150 Tandys Ln, Brunswick Heads 2483 NSW Saving record byron - 2 Goshawk Ln, Mullumbimby 2482 NSW Saving record byron - 139 Jonson St, Byron Bay 2481 NSW Saving record byron - 257 Mcauleys Ln, Myocum 2482 NSW Saving record byron - 6 Reservoir Rd, Mullumbimby 2482 NSW Saving record byron - 388 Tyagarah Rd, Myocum 2481 NSW Saving record byron - 9 Village Edge Crt, Bangalow 2479 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 57 Station St, Mullumbimby 2482 NSW Saving record byron - 51 Brownell Drv, Byron Bay 2481 NSW Saving record byron - 465 Coorabell Rd, Coorabell 2479 NSW Saving record byron - 480 Booyong Rd, Booyong 2480 NSW Saving record byron - 33 New City Rd, Mullumbimby 2482 NSW Saving record byron - 33 Beachcomber Drv, Byron Bay 2481 NSW Saving record byron - 465 Coorabell Rd, Coorabell 2479 NSW Saving record byron - 22 Beach Ave, South Golden Beach 2483 NSW Saving record byron - 132 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 31 Riverside Drv, Mullumbimby 2482 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 465 Left Bank Rd, Mullumbimby Creek 2482 NSW Saving record byron - 99 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 30 Robin St, South Golden Beach 2483 NSW Saving record byron - 3/74 Centennial Cct, Byron Bay 2481 NSW Saving record byron - 6/21-25 Fletcher St, Byron Bay 2481 NSW Saving record byron - 409 Coorabell Rd, Coorabell 2479 NSW Saving record byron - 9 Marvell St, Byron Bay 2481 NSW Saving record byron - 1 Wilfred St, Billinudgel 2483 NSW Saving record byron - 12 Julian Pl, Byron Bay 2481 NSW Saving record byron - 28 Clover Hill Cct, Bangalow 2479 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 116 Jonson St, Byron Bay 2481 NSW Saving record byron - 2/4 Jonson St, Byron Bay 2481 NSW Saving record byron - 32 Station St, Mullumbimby 2482 NSW Saving record byron - 46 Kallaroo Cct, Ocean Shores 2483 NSW Saving record byron - 55 Fingal St, Brunswick Heads 2483 NSW Saving record byron - 83 Broken Head Reserve Rd, Broken Head 2481 NSW Saving record byron - 44 Mullumbimbi St, Brunswick Heads 2483 NSW Saving record byron - 33 Parrot Tree Pl, Bangalow 2479 NSW Saving record byron - 179 Scarrabelottis Rd, Nashua 2479 NSW Collecting feed data for cessnock, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 33 Brunker St, Kurri Kurri NSW 2327 Saving record cessnock - 19 Lismore St, Abermain NSW 2326 Saving record cessnock - 18 Averys Lane, Heddon Greta NSW 2321 Saving record cessnock - 84 Bakers Lane, Sawyers Gully NSW 2326 Saving record cessnock - 3 Rae St, Cessnock NSW 2325 Saving record cessnock - 17 Sweeney Rd, North Rothbury NSW 2335 Saving record cessnock - 5 Quarrybylong St, Cessnock NSW 2325 Saving record cessnock - 39 Crown Line Dr, Rothbury NSW 2320 Saving record cessnock - 26 Lang St, Kurri Kurri NSW 2327 Saving record cessnock - 24 Lang St, Cessnock NSW 2325 Saving record cessnock - 145 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 39 Merion Cct, Heddon Greta NSW 2321 Saving record cessnock - 6 Wickham St, Stanford Merthyr NSW 2327 Saving record cessnock - 17 Treesbank Pl, Nulkaba NSW 2325 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00002438/001 Saving record cessnock - 355 Lang St, Kurri Kurri NSW 2327 Saving record cessnock - 16 Masonry Dr, North Rothbury NSW 2335 Saving record cessnock - 5 Masonry Dr, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00000785/001 Saving record cessnock - 58 Caphilly Pwy, North Rothbury NSW 2335 Saving record cessnock - 18 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 14 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 9 Masonry Dr, North Rothbury NSW 2335 Saving record cessnock - 47 Harrow Cct, Greta NSW 2334 Saving record cessnock - 30 Moran Pwy, North Rothbury NSW 2335 Saving record cessnock - 23 Harmony Cl, Bellbird NSW 2325 Saving record cessnock - 13 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 6 Barton St, Kurri Kurri NSW 2327 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00002203/002 Saving record cessnock - 78A O'Shea Cct, Cessnock NSW 2325 Saving record cessnock - 4 Market Fair Rd, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2022/00001129/001 Saving record cessnock - 32 Dianella Cr, Paxton NSW 2325 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00000782/001 Saving record cessnock - 20 Market Fair Rd, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00002140/002 Saving record cessnock - 1/14 Brown St, Bellbird NSW 2325 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00000051/001 Saving record cessnock - 12 Quorrobolong Rd, Cessnock NSW 2325 Saving record cessnock - 215 Averys Lane, Buchanan NSW 2323 Saving record cessnock - 6 Karinyup Cct, Heddon Greta NSW 2321 Saving record cessnock - 4 Karinyup Cct, Heddon Greta NSW 2321 Saving record cessnock - 2 Karinyup Cct, Heddon Greta NSW 2321 Saving record cessnock - 5 Market Fair Rd, North Rothbury NSW 2335 Saving record cessnock - 7 Market Fair Rd, North Rothbury NSW 2335 Saving record cessnock - 9 Market Fair Rd, North Rothbury NSW 2335 Saving record cessnock - 10 Market Fair Rd, North Rothbury NSW 2335 Saving record cessnock - 8 Market Fair Rd, North Rothbury NSW 2335 Saving record cessnock - 6 Market Fair Rd, North Rothbury NSW 2335 Saving record cessnock - 9 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 19 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 23 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 7 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 29 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 30 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 28 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 26 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 24 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 76 Barclay Dr, North Rothbury NSW 2335 Saving record cessnock - 22 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 20 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 12 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 10 Floribunda Cl, Heddon Greta NSW 2321 Saving record cessnock - 22 Pankhurst Av, North Rothbury NSW 2335 Collecting feed data for dubbo, attempt: 1... cessnock: ERROR: Net::ReadTimeout /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for fairfield, attempt: 1... dubbo: ERROR: 403 => Net::HTTPForbidden for https://planning.dubbo.nsw.gov.au// -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for griffith, attempt: 1... fairfield: ERROR: Failed to open TCP connection to openaccess.fairfieldcity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:148:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for gunnedah, attempt: 1... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gunnedah - 151 Stevenson Rd, Gunnedah NSW 2380 Saving record gunnedah - 32-44 View St, Gunnedah NSW 2380 Saving record gunnedah - 22 Vera Cl, Gunnedah NSW 2380 Saving record gunnedah - 18 Henry St, Gunnedah NSW 2380 Saving record gunnedah - 54 Kurrajong Rd, Gunnedah NSW 2380 Saving record gunnedah - 3 Turner Cl, Gunnedah NSW 2380 Saving record gunnedah - 41 Barber St, Gunnedah NSW 2380 Saving record gunnedah - 110 George St, Gunnedah NSW 2380 Saving record gunnedah - 103 Links Rd, Gunnedah NSW 2380 Saving record gunnedah - 40 Wattle St, Gunnedah NSW 2380 Saving record gunnedah - 107 Kerry Elizabeth Dr, Gunnedah NSW 2380 Saving record gunnedah - 249 Stock Rd, Gunnedah NSW 2380 Saving record gunnedah - 8 Bellevue Cl, Gunnedah NSW 2380 Collecting feed data for gympie, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gympie - Carlo Rd, Rainbow Beach 4581 QLD Saving record gympie - 139 Lagoon Pocket Rd, Lagoon Pocket 4570 QLD Saving record gympie - 33A Langara Dve, Southside 4570 QLD Saving record gympie - 15 Eugene St, Southside 4570 QLD Saving record gympie - 73 Vantage Rd, Chatsworth 4570 QLD Saving record gympie - Birdie Cres, Gympie 4570 QLD Saving record gympie - 114 Tuchekoi Rd, Bollier 4570 QLD Saving record gympie - 9 Sanctuary Way, Cooloola Cove 4580 QLD Saving record gympie - 29 Caledonian Hill, Gympie 4570 QLD Saving record gympie - 14 Davey Rd, Southside 4570 QLD Saving record gympie - Hart Rd, Upper Kandanga 4570 QLD Saving record gympie - 632 Rocks Rd, Pie Creek 4570 QLD Saving record gympie - 35 Cross Cres, Curra 4570 QLD Saving record gympie - 9 Norman St, Gympie 4570 QLD Saving record gympie - 90 Clune Rd, Cedar Pocket 4570 QLD Saving record gympie - Silva Rd, Jones Hill 4570 QLD Saving record gympie - 261 Lagoon Pocket Rd, Lagoon Pocket 4570 QLD Saving record gympie - 18 Johnstone Rd, Southside 4570 QLD Saving record gympie - 19 Copp Rd, Southside 4570 QLD Saving record gympie - 1/3-5 Wyvern Rd, Rainbow Beach 4581 QLD Saving record gympie - 68-72 Exhibition Rd, Southside 4570 QLD Saving record gympie - 1 Leonard St, Southside 4570 QLD Saving record gympie - 9 Wyvern Rd, Rainbow Beach 4581 QLD Saving record gympie - 9 Wyvern Rd, Rainbow Beach 4581 QLD Saving record gympie - 10 Copp Rd, Southside 4570 QLD Saving record gympie - 7 Red Hill Rd, Gympie 4570 QLD Saving record gympie - 25 Preston La, Veteran 4570 QLD Saving record gympie - 60 Rainbow Beach Rd, Rainbow Beach 4581 QLD Saving record gympie - Banks Pocket Rd, Gympie 4570 QLD Saving record gympie - 58 Atkinson Rd, Araluen 4570 QLD Saving record gympie - 10 Copp Rd, Southside 4570 QLD Collecting feed data for lismore, attempt: 1... Collecting feed data for maranoa, attempt: 1... lismore: ERROR: 403 => Net::HTTPForbidden for https://www.lismore-nsw.altitudelg.com/e-services/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:1012:in `response_redirect' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:325:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record maranoa - 33 Abbey Rd, Euthulla 4455 QLD Saving record maranoa - 101 Mcdowall St, Roma 4455 QLD Saving record maranoa - 62 Burrowes St, Surat 4417 QLD Saving record maranoa - 35 Miscamble St, Roma 4455 QLD Saving record maranoa - 246 Euthulla Rd, Euthulla 4455 QLD Saving record maranoa - 101 Charles St, Roma 4455 QLD Saving record maranoa - 74 Ivan St, Surat 4417 QLD Saving record maranoa - 60 Wyndham St, Roma 4455 QLD Saving record maranoa - 90-92 Charles St, Roma 4455 QLD Saving record maranoa - 10 Queen St, Roma 4455 QLD Saving record maranoa - 101 Mcdowall St, Roma 4455 QLD Saving record maranoa - Seawrights Rd, Wallumbilla 4428 QLD Saving record maranoa - 14 South St, Roma 4455 QLD Saving record maranoa - Bindango Rd, Hodgson 4455 QLD Saving record maranoa - 84 Charles St, Roma 4455 QLD Saving record maranoa - 10 Queen St, Roma 4455 QLD Saving record maranoa - 224 Mcdowall St, Roma 4455 QLD Saving record maranoa - 30 Evans Lane, Dargal Road 4455 QLD Saving record maranoa - 861 Orallo Rd, Euthulla 4455 QLD Saving record maranoa - 9 Garden St, Yuleba 4427 QLD Saving record maranoa - 46925 Warrego Hwy, Mount Abundance 4455 QLD Saving record maranoa - 36 Perry St, Yuleba 4427 QLD Saving record maranoa - 12 Lockyer Cres, Roma 4455 QLD Saving record maranoa - 21 May St, Roma 4455 QLD Saving record maranoa - 126-132 Northern Rd, Roma 4455 QLD Saving record maranoa - 8L Fleming Dr, Roma 4455 QLD Saving record maranoa - 8L Fleming Dr, Roma 4455 QLD Saving record maranoa - 28 Chadford St, Wallumbilla 4428 QLD Saving record maranoa - 5771 Mitchell St George Rd, Dunkeld 4465 QLD Saving record maranoa - 434 Hartleys Lane, Euthulla 4455 QLD Saving record maranoa - 126-132 Northern Rd, Roma 4455 QLD Saving record maranoa - Bindango Rd, Hodgson 4455 QLD Saving record maranoa - 861 Orallo Rd, Euthulla 4455 QLD Saving record maranoa - 24-26 Wormwell Dr, Roma 4455 QLD Saving record maranoa - 66-68 Mcdowall St, Roma 4455 QLD Saving record maranoa - 32 Borland St, Roma 4455 QLD Saving record maranoa - 24-26 Wormwell Dr, Roma 4455 QLD Saving record maranoa - 74 Ivan St, Surat 4417 QLD Saving record maranoa - 74 Ivan St, Surat 4417 QLD Saving record maranoa - 126-132 Northern Rd, Roma 4455 QLD Collecting feed data for muswellbrook, attempt: 1... Collecting feed data for port_macquarie_hastings, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Collecting feed data for port_stephens, attempt: 1... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for shoalhaven, attempt: 1... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for singleton, attempt: 1... shoalhaven: ERROR: Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for strathfield, attempt: 1... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record strathfield - 26 Boden Ave, Strathfield 2135 NSW Saving record strathfield - 5 Melville Ave, Strathfield 2135 NSW Saving record strathfield - 82 Redmyre Rd, Strathfield 2135 NSW Saving record strathfield - 65 Abbotsford Rd, Homebush 2140 NSW Saving record strathfield - 19 Naughton St, Greenacre 2190 NSW Saving record strathfield - 30 Llandilo Ave, Strathfield 2135 NSW Saving record strathfield - 6 Hunter St, Strathfield 2135 NSW Saving record strathfield - 69 Homebush Rd, Strathfield 2135 NSW Saving record strathfield - 14 Llandilo Ave, Strathfield 2135 NSW Saving record strathfield - 47 Arthur St, Strathfield 2135 NSW Saving record strathfield - 41 Roberts Rd, Greenacre 2190 NSW Saving record strathfield - 6 Hunter St, Strathfield 2135 NSW Saving record strathfield - 11-23 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 3 Arthur St, Strathfield 2135 NSW Saving record strathfield - 22 South St, Strathfield 2135 NSW Saving record strathfield - 37-39 Abbotsford Rd, Homebush 2140 NSW Saving record strathfield - 41 Cave Rd, Strathfield 2135 NSW Saving record strathfield - 67 Roberts Rd, Greenacre 2190 NSW Saving record strathfield - 3/72-74 Albert Rd, Strathfield 2135 NSW Saving record strathfield - 54 Cave Rd, Strathfield 2135 NSW Saving record strathfield - 79 Mintaro Ave, Strathfield 2135 NSW Saving record strathfield - 56 Cave Rd, Strathfield 2135 NSW Saving record strathfield - 23 Coronation Pde, Strathfield South 2136 NSW Saving record strathfield - 11-23 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 10 Augusta St, Strathfield 2135 NSW Saving record strathfield - 39 Cotswold Rd, Strathfield 2135 NSW Saving record strathfield - 3-5 Nichol Pde, Strathfield 2135 NSW Saving record strathfield - 21 Parramatta Rd, Homebush 2140 NSW Saving record strathfield - 17 Water St, Strathfield South 2136 NSW Saving record strathfield - 5 Mount St, Strathfield 2135 NSW Saving record strathfield - 5 Victoria St, Strathfield 2135 NSW Saving record strathfield - 49 Newton Rd, Strathfield 2135 NSW Saving record strathfield - 33 Courallie Ave, Homebush West 2140 NSW Saving record strathfield - 31 Birnam Gr, Strathfield 2135 NSW Saving record strathfield - 2 Excelsior Ave, Strathfield South 2136 NSW Saving record strathfield - 67 Churchill Ave, Strathfield 2135 NSW Saving record strathfield - 6 Mintaro Ave, Strathfield 2135 NSW Saving record strathfield - 84 Redmyre Rd, Strathfield 2135 NSW Saving record strathfield - 46 Llandilo Ave, Strathfield 2135 NSW Saving record strathfield - 87-89 Albert Rd, Strathfield 2135 NSW Saving record strathfield - 179 Albert Rd, Strathfield 2135 NSW Collecting feed data for upper_hunter, attempt: 1... upper_hunter: ERROR: 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:1012:in `response_redirect' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:325:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:1324:in `post_form' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:537:in `post' /app/lib/masterview_scraper/get_applications_api.rb:45:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' *************************************************** Now retrying authorities which earlier had failures albury, bega_valley, bogan, bundaberg, burwood, cessnock, dubbo, fairfield, griffith, lismore, port_macquarie_hastings, port_stephens, shoalhaven, singleton, upper_hunter *************************************************** Collecting feed data for albury, attempt: 2... Collecting feed data for bega_valley, attempt: 2... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bogan, attempt: 2... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bundaberg, attempt: 2... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for burwood, attempt: 2... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for cessnock, attempt: 2... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Collecting feed data for dubbo, attempt: 2... cessnock: ERROR: Net::ReadTimeout /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for fairfield, attempt: 2... dubbo: ERROR: 403 => Net::HTTPForbidden for https://planning.dubbo.nsw.gov.au// -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for griffith, attempt: 2... fairfield: ERROR: Failed to open TCP connection to openaccess.fairfieldcity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:148:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for lismore, attempt: 2... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_macquarie_hastings, attempt: 2... lismore: ERROR: 403 => Net::HTTPForbidden for https://www.lismore-nsw.altitudelg.com/e-services/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:1012:in `response_redirect' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:325:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_stephens, attempt: 2... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for shoalhaven, attempt: 2... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for singleton, attempt: 2... shoalhaven: ERROR: Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for upper_hunter, attempt: 2... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' upper_hunter: ERROR: 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:1012:in `response_redirect' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:325:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:1324:in `post_form' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:537:in `post' /app/lib/masterview_scraper/get_applications_api.rb:45:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' MORPH_EXPECT_BAD=bogan Scraping Summary: Authority OK Bad Exception -------------------- ------ ------ -------------------------------------------------- albury 0 0 Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] ballina 116 0 - /app/vendor/bundle/ruby/3.2.0/gems/scraper_utils-0.8.2/lib/scraper_utils/log_utils.rb:192:in `report_on_results': ERROR: Unexpected errors in: albury,bega_valley,bundaberg,burwood,cessnock,dubbo,fairfield,griffith,lismore,port_macquarie_hastings,port_stephens,shoalhaven,singleton,upper_hunter (Add to MORPH_EXPECT_BAD?) (RuntimeError) bega_valley 0 0 SocketError - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] albury: Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) bega_valley: SocketError - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) bogan 0 0 [EXPECT BAD] SocketError - Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] broken_hill 11 0 - bundaberg: Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response burwood: SocketError - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (getaddrinfo: Name or service not known) bundaberg 0 0 Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response [lib/masterview_scraper.rb:85:in `scrape_api_period'] cessnock: Net::ReadTimeout - Net::ReadTimeout dubbo: Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://planning.dubbo.nsw.gov.au// -- unhandled response burwood 0 0 SocketError - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] byron 119 0 - fairfield: Net::OpenTimeout - Failed to open TCP connection to openaccess.fairfieldcity.nsw.gov.au:443 (execution expired) cessnock 0 0 Net::ReadTimeout - Net::ReadTimeout [lib/masterview_scraper.rb:99:in `block in scrape_api_period'] griffith: Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) lismore: Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://www.lismore-nsw.altitudelg.com/e-services/ -- unhandled response dubbo 0 0 Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://planning.dubbo.nsw.gov.au// -- unhandled response [lib/masterview_scraper.rb:85:in `scrape_api_period'] port_macquarie_hastings: Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) fairfield 0 0 Net::OpenTimeout - Failed to open TCP connection to openaccess.fairfieldcity.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:148:in `scrape_url'] port_stephens: Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) shoalhaven: RuntimeError - Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home griffith 0 0 Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] singleton: Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) gunnedah 13 0 - gympie 31 0 - upper_hunter: Mechanize::ResponseCodeError - 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response See earlier output for details from scraper.rb:67:in `run' lismore 0 0 Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://www.lismore-nsw.altitudelg.com/e-services/ -- unhandled response [lib/masterview_scraper.rb:85:in `scrape_api_period'] from scraper.rb:83:in `<main>' maranoa 40 0 - muswellbrook 0 0 - port_macquarie_hastings 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] port_stephens 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] shoalhaven 0 0 RuntimeError - Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home [lib/masterview_scraper/pages/index.rb:41:in `scrape'] singleton 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] strathfield 41 0 - upper_hunter 0 0 Mechanize::ResponseCodeError - 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response [lib/masterview_scraper/get_applications_api.rb:45:in `scrape_page']