StashProperty / multiple_masterview

Scrapes multiple authorities that have a masterview system


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What a Masterview website looks like

Sign up

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer njenkins ianheggie-oaf dcalde

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Default EXPECT_BAD: --- :bogan: https://github.com/planningalerts-scrapers/issues/issues/935 - Council website bad, does not publish Scraping authorities: albury, ballina, bega_valley, bogan, broken_hill, bundaberg, burwood, byron, cessnock, dubbo, fairfield, griffith, gunnedah, gympie, lismore, maranoa, muswellbrook, port_macquarie_hastings, port_stephens, shoalhaven, singleton, strathfield, upper_hunter Collecting feed data for albury, attempt: 1... Collecting feed data for ballina, attempt: 1... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 30 Hillcrest Dr, Tintenbar NSW 2478 Saving record ballina - 10 Mcevoy St, Cumbalum NSW 2478 Saving record ballina - 10 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 1/24 Chilcott Cct, Cumbalum NSW 2478 Saving record ballina - 15 Libby La, Lennox Head NSW 2478 Saving record ballina - 1/2 Darcey Ave, Cumbalum NSW 2478 Saving record ballina - 59 Burns Point Ferry Rd, West Ballina NSW 2478 Saving record ballina - 175 Fox St, Ballina NSW 2478 Saving record ballina - 14-16 Simmons St, Ballina NSW 2478 Saving record ballina - 14-16 Simmons St, Ballina NSW 2478 Saving record ballina - 1/25 Pacific Pde, Lennox Head NSW 2478 Saving record ballina - 433 Wardell Rd, Lynwood NSW 2477 Saving record ballina - 42 Simpson Ave, Wollongbar NSW 2477 Saving record ballina - 9 Evelyn Villa Dr, Alstonville NSW 2477 Saving record ballina - 48 Teakwood Dr, Alstonville NSW 2477 Saving record ballina - 40 Millbrook Tce, Wollongbar NSW 2477 Saving record ballina - 28 Smith Dr, West Ballina NSW 2478 Saving record ballina - 5 King La, Ballina NSW 2478 Saving record ballina - 28 Smith Dr, West Ballina NSW 2478 Saving record ballina - 61 Eden Valley Dr, Alstonville NSW 2477 Saving record ballina - 7 Angus Kennedy Cl, Lennox Head NSW 2478 Saving record ballina - 3 Mosman Ch, Lennox Head NSW 2478 Saving record ballina - 24 Acreage St, Cumbalum NSW 2478 Saving record ballina - 41 Bruxner Hwy, West Ballina NSW 2478 Saving record ballina - 13 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 15 Sand St, Skennars Head NSW 2478 Saving record ballina - 17 Jameson Ave, East Ballina NSW 2478 Saving record ballina - 29 Stoneyhurst Dr, Lennox Head NSW 2478 Saving record ballina - 48 Teakwood Dr, Alstonville NSW 2477 Saving record ballina - 225 Friday Hut Rd, Tintenbar NSW 2478 Saving record ballina - Ascot Rd, Ballina NSW 2478 Saving record ballina - 20 Tara Dwn, Lennox Head NSW 2478 Saving record ballina - 3 King La, Ballina NSW 2478 Saving record ballina - 84 Kerr St, Ballina NSW 2478 Saving record ballina - 225 Friday Hut Rd, Tintenbar NSW 2478 Saving record ballina - 21 Norton St, Ballina NSW 2478 Saving record ballina - 8 Oakwood Dr, Ballina NSW 2478 Saving record ballina - 16 Kookaburra St, Ballina NSW 2478 Saving record ballina - 315 River St, Ballina NSW 2478 Saving record ballina - 1/21 Dress Circle Dr, Lennox Head NSW 2478 Saving record ballina - 54 Killarney Cr, Skennars Head NSW 2478 Saving record ballina - 54 Killarney Cr, Skennars Head NSW 2478 Saving record ballina - 14-16 Simmons St, Ballina NSW 2478 Saving record ballina - 17 Sunrise Cr, Lennox Head NSW 2478 Saving record ballina - 7 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 11 Skinner St, Ballina NSW 2478 Saving record ballina - 8 Princess Ave, Ballina NSW 2478 Saving record ballina - 11 Skinner St, Ballina NSW 2478 Saving record ballina - 1 Salt Air Cct, Lennox Head NSW 2478 Saving record ballina - 37 Anderson St, East Ballina NSW 2478 Saving record ballina - 110 Whites La, Alstonville NSW 2477 Saving record ballina - 62 Bayview Dr, East Ballina NSW 2478 Saving record ballina - 1/25 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 13 Martin St, Ballina NSW 2478 Saving record ballina - 158 Ross La, Kinvara NSW 2478 Saving record ballina - 50 Fenwick Dr, East Ballina NSW 2478 Saving record ballina - 4 Anderson St, East Ballina NSW 2478 Saving record ballina - 58 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 10A Triton St, Lennox Head NSW 2478 Saving record ballina - 8 Granite St, Lennox Head NSW 2478 Saving record ballina - 348 North Teven Rd, Teven NSW 2478 Saving record ballina - 31 Lindsay Ave, Cumbalum NSW 2478 Saving record ballina - 138 Dillons La, Alstonville NSW 2477 Saving record ballina - 17 Delva Rd, Wollongbar NSW 2477 Saving record ballina - 38 Nelson Ch, Tuckombil NSW 2477 Saving record ballina - 86 Fox St, Ballina NSW 2478 Saving record ballina - 18 Sunhaven Ave, Skennars Head NSW 2478 Saving record ballina - 1/102 Killarney Cr, Skennars Head NSW 2478 Saving record ballina - 9 Kellie-Ann Cr, Lennox Head NSW 2478 Saving record ballina - 85 Main St, Alstonville NSW 2477 Saving record ballina - 3 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 3 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 161 Meaneys La, East Wardell NSW 2477 Saving record ballina - 2/162 Tamar St, Ballina NSW 2478 Saving record ballina - 17 Nautilus Cr, Lennox Head NSW 2478 Saving record ballina - 1/16 Sunray Cr, Lennox Head NSW 2478 Saving record ballina - 3 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 34 Norvell Gr, Alstonville NSW 2477 Saving record ballina - 17 Nautilus Cr, Lennox Head NSW 2478 Saving record ballina - 46 Cedar Cr, East Ballina NSW 2478 Saving record ballina - 9 Anderson St, East Ballina NSW 2478 Saving record ballina - 74 Mellis Cct, Alstonville NSW 2477 Saving record ballina - 25 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 9 Lynette Cct, Wollongbar NSW 2477 Saving record ballina - 14 Delva Rd, Wollongbar NSW 2477 Saving record ballina - 22 Acreage St, Cumbalum NSW 2478 Saving record ballina - 68 Bayview Dr, East Ballina NSW 2478 Saving record ballina - 15 Jameson Ave, East Ballina NSW 2478 Saving record ballina - 56 Ironbark Rd, Ballina NSW 2478 Saving record ballina - 1 Fagan Pl, Cumbalum NSW 2478 Saving record ballina - 1 Fagan Pl, Cumbalum NSW 2478 Saving record ballina - 10A Triton St, Lennox Head NSW 2478 Saving record ballina - 18 Sunhaven Ave, Skennars Head NSW 2478 Saving record ballina - 38 Dress Circle Dr, Lennox Head NSW 2478 Saving record ballina - 709 Fernleigh Rd, Brooklet NSW 2479 Saving record ballina - 14 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 32 Youngmans Rd, Marom Creek NSW 2480 Saving record ballina - 6 Lindsay Cr, Wardell NSW 2477 Saving record ballina - 19 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 10 Killen Falls Dr, Tintenbar NSW 2478 /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 9 Whipps Ave, Alstonville NSW 2477 Saving record ballina - 2 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 5 Cove Ave, Skennars Head NSW 2478 Saving record ballina - 415 Fernleigh Rd, Fernleigh NSW 2479 Saving record ballina - 55 Greenfield Rd, Lennox Head NSW 2478 Saving record ballina - 4 Ascot Rd, Ballina NSW 2478 Saving record ballina - 18 Bellevue Ave, East Ballina NSW 2478 Saving record ballina - 723 Teven Rd, Teven NSW 2478 Saving record ballina - 933 Fernleigh Rd, Brooklet NSW 2479 Saving record ballina - 13 Ascot Rd, Ballina NSW 2478 Saving record ballina - 5 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 1 Shoalhaven St, Alstonville NSW 2477 Saving record ballina - 171 Gubay Rd, Wardell NSW 2477 Saving record ballina - 101 Rous Mill Rd, Rous Mill NSW 2477 Saving record ballina - 1/10 Byron St, Lennox Head NSW 2478 Saving record ballina - 22-24 Bruxner Hwy, Wollongbar NSW 2477 Saving record ballina - 551 Wardell Rd, Dalwood NSW 2477 Saving record ballina - 9 Hyde Park Rd, Wollongbar NSW 2477 Saving record ballina - 16 Ecology Ave, Cumbalum NSW 2478 Saving record ballina - 12 Offshore Ave, Skennars Head NSW 2478 Saving record ballina - 41 Pine Ave, East Ballina NSW 2478 Saving record ballina - 25 Swell Ave, Skennars Head NSW 2478 Saving record ballina - 13 Owens Cr, Alstonville NSW 2477 Saving record ballina - 44 Hillcrest Dr, Tintenbar NSW 2478 Saving record ballina - 7 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 57 Fernleigh Rd, Tintenbar NSW 2478 Saving record ballina - 72 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 7 Rainbow Pl, East Ballina NSW 2478 Saving record ballina - 7 Rainbow Pl, East Ballina NSW 2478 Saving record ballina - 94 Temple St, Ballina NSW 2478 Saving record ballina - 25 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 1 Rocky Point Rd, Lennox Head NSW 2478 Saving record ballina - 26 Teal St, Ballina NSW 2478 Saving record ballina - 65 Carroll Ave, Skennars Head NSW 2478 Saving record ballina - 16 Ecology Ave, Cumbalum NSW 2478 Saving record ballina - 5 Diversity Ave, Cumbalum NSW 2478 Saving record ballina - 15 Cargelligo Cr, Ballina NSW 2478 Saving record ballina - 63-65 Ballina St, Lennox Head NSW 2478 Saving record ballina - 1/25 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 65 Stoneyhurst Dr, Lennox Head NSW 2478 Saving record ballina - 1/25B Sandbreak Cr, Lennox Head NSW 2478 Saving record ballina - 19 Sunhaven Ave, Skennars Head NSW 2478 Saving record ballina - 298 Rous Rd, Rous NSW 2477 Saving record ballina - 1 Mcevoy St, Cumbalum NSW 2478 Saving record ballina - 35 Richmond St, Wardell NSW 2477 Saving record ballina - 7 Burnet St, Ballina NSW 2478 Saving record ballina - 1192 Eltham Rd, Alstonvale NSW 2477 Saving record ballina - 870 Pimlico Rd, Wardell NSW 2477 Saving record ballina - 1 Mcevoy St, Cumbalum NSW 2478 Saving record ballina - 63 Hillcrest Dr, Tintenbar NSW 2478 Saving record ballina - 2 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 26 Acreage St, Cumbalum NSW 2478 Collecting feed data for bega_valley, attempt: 1... Collecting feed data for bogan, attempt: 1... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for broken_hill, attempt: 1... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record broken_hill - 39 Picton St, Broken Hill NSW 2880 Saving record broken_hill - 661 Mcgowen St, Broken Hill NSW 2880 Saving record broken_hill - 182 Lane St, Broken Hill NSW 2880 Collecting feed data for bundaberg, attempt: 1... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for burwood, attempt: 1... Collecting feed data for byron, attempt: 1... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 85 Bangalow Rd, Byron Bay 2481 NSW Saving record byron - 33 Lorikeet Ln, Mullumbimby 2482 NSW Saving record byron - 1931 Coolamon Scenic Drv, Mullumbimby 2482 NSW Saving record byron - 15 Keats St, Byron Bay 2481 NSW Saving record byron - 12 Pacific Esp, South Golden Beach 2483 NSW Saving record byron - 10 Woodswallow Way, Mullumbimby 2482 NSW Saving record byron - 27/33-35 Childe St, Byron Bay 2481 NSW Saving record byron - 92 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 16 Slatterys Ln, Bangalow 2479 NSW Saving record byron - 19A Beech Drv, Suffolk Park 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 5 Mcinnes Ln, Tyagarah 2481 NSW Saving record byron - 45 Corkwood Crs, Suffolk Park 2481 NSW Saving record byron - 38 Tweed St, Brunswick Heads 2483 NSW Saving record byron - 8 Barby Crs, Bangalow 2479 NSW Saving record byron - 75 Butler St, Byron Bay 2481 NSW Saving record byron - 13 Rangal Rd, Ocean Shores 2483 NSW Saving record byron - 582 Coopers Shoot Rd, Coopers Shoot 2479 NSW Saving record byron - 152 Burnetts Rd, Nashua 2479 NSW Saving record byron - 140 Crystal Creek Cct, Coorabell 2479 NSW Saving record byron - 44 Carlyle St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 36 Keys Rd, Coorabell 2479 NSW Saving record byron - 54 Mullumbimbi St, Brunswick Heads 2483 NSW Saving record byron - 7 Burns St, Byron Bay 2481 NSW Saving record byron - 19 Helen St, South Golden Beach 2483 NSW Saving record byron - 99 Station St, Mullumbimby 2482 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW Saving record byron - 18 Fawcett St, Brunswick Heads 2483 NSW Saving record byron - 5 Ferguson Crt, Bangalow 2479 NSW Saving record byron - 7 Hill View Pl, Ewingsdale 2481 NSW Saving record byron - 17 Autumn Crt, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 8 Coachwood Crt, Federal 2480 NSW Saving record byron - 26 Cavvanbah St, Byron Bay 2481 NSW Saving record byron - 100 Quarry Ln, Ewingsdale 2481 NSW Saving record byron - 111 Jonson St, Byron Bay 2481 NSW Saving record byron - 38 Elizabeth Ave, South Golden Beach 2483 NSW Saving record byron - 66 Helen St, South Golden Beach 2483 NSW Saving record byron - 166 Billinudgel Rd, Billinudgel 2483 NSW Saving record byron - 93 Balemo Drv, Ocean Shores 2483 NSW Saving record byron - 16 Palm Valley Drv, Byron Bay 2481 NSW Saving record byron - 134 Springvale Rd, Eureka 2480 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 79 Mill Rd, Huonbrook 2482 NSW Saving record byron - 384 Eureka Rd, Eureka 2480 NSW Saving record byron - 22 Beach Ave, South Golden Beach 2483 NSW Saving record byron - 128 Grays Ln, Tyagarah 2481 NSW Saving record byron - 16 Benloro Ln, Myocum 2481 NSW Saving record byron - 28 Beachside Drv, Suffolk Park 2481 NSW Saving record byron - 17/31 Hayters Drv, Suffolk Park 2481 NSW Saving record byron - 19 Bulgoon Crs, Ocean Shores 2483 NSW Saving record byron - 26/31 Hayters Drv, Suffolk Park 2481 NSW Saving record byron - 5 Aurana Pl, Brunswick Heads 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 22 Tongarra Drv, Ocean Shores 2483 NSW Saving record byron - 4 Driftwood Ave, Byron Bay 2481 NSW Saving record byron - 9 Parakeet Pl, Mullumbimby 2482 NSW Saving record byron - 1A Banksia Drv, Byron Bay 2481 NSW Saving record byron - 1 Harah Crt, Ocean Shores 2483 NSW Saving record byron - 63 Kingsley St, Byron Bay 2481 NSW Ignoring unknown value of determination type: "Received" on https://datracker.byron.nsw.gov.au/masterviewui-external/application/ApplicationDetails/013.2021.00000205.001 Saving record byron - 8 Aloota Crs, Ocean Shores 2483 NSW Saving record byron - 6 Grevillea Ave, Mullumbimby 2482 NSW Saving record byron - 2/14 Alcorn St, Suffolk Park 2481 NSW Saving record byron - 963 Main Arm Rd, Main Arm 2482 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 11 Ruskin St, Byron Bay 2481 NSW Saving record byron - 171 Frasers Rd, Mullumbimby Creek 2482 NSW Saving record byron - 13/64 Blackbutt Ln, Broken Head 2481 NSW Saving record byron - 48 Parrot Tree Pl, Bangalow 2479 NSW Saving record byron - 506 Bangalow Rd, Talofa 2481 NSW Saving record byron - 373 Goremans Rd, Eureka 2480 NSW Saving record byron - 37 Beachcomber Drv, Byron Bay 2481 NSW Saving record byron - 26 Burns St, Byron Bay 2481 NSW Saving record byron - 21 Border St, Byron Bay 2481 NSW Saving record byron - 56 Shirley Ln, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 24 Beachside Drv, Suffolk Park 2481 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW Saving record byron - 1472 Hinterland Way, Bangalow 2479 NSW Saving record byron - 16 Kiah Cl, Ocean Shores 2483 NSW Saving record byron - 32 Goonengerry Rd, Goonengerry 2482 NSW Saving record byron - 11 Burns St, Byron Bay 2481 NSW Saving record byron - 9 Marvell St, Byron Bay 2481 NSW Saving record byron - 18 Booyong Crt, Suffolk Park 2481 NSW Saving record byron - 3 Fantail Pl, Mullumbimby 2482 NSW Saving record byron - 17 Jonson St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 567 Lismore Rd, Nashua 2479 NSW Saving record byron - 44 Carlyle Ln, Byron Bay 2481 NSW Saving record byron - 8 Kiyung Crt, Ocean Shores 2483 NSW Saving record byron - 10 Balraith Ln, Ewingsdale 2481 NSW Saving record byron - 29 Helen St, South Golden Beach 2483 NSW Saving record byron - 4 Ocean Way, Brunswick Heads 2483 NSW Saving record byron - 18 Palmer Ave, Ocean Shores 2483 NSW Saving record byron - 3/226 Fowlers Ln, Bangalow 2479 NSW Saving record byron - 990 Friday Hut Rd, Binna Burra 2479 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 3 Clifford St, Suffolk Park 2481 NSW Saving record byron - 22 Tongarra Drv, Ocean Shores 2483 NSW Saving record byron - 294 Picadilly Hill Rd, Coopers Shoot 2481 NSW Saving record byron - 36 Shirley St, Byron Bay 2481 NSW Saving record byron - 1/51 Balemo Drv, Ocean Shores 2483 NSW Saving record byron - 88 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 501A Booyong Rd, Booyong 2480 NSW Saving record byron - 134 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 21 Border St, Byron Bay 2481 NSW Saving record byron - 54 Shirley Ln, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 17 Keats St, Byron Bay 2481 NSW Saving record byron - 150 Lismore Rd, Bangalow 2479 NSW Saving record byron - 3-5 Boronia Pl, Byron Bay 2481 NSW Saving record byron - 95 St Helena Rd, Mcleods Shoot 2479 NSW Saving record byron - 18 Palmer Ave, Ocean Shores 2483 NSW Saving record byron - 28 Pacific Vista Drv, Byron Bay 2481 NSW Saving record byron - 60 Sunrise Bvd, Byron Bay 2481 NSW Saving record byron - 84 Tuckeroo Ave, Mullumbimby 2482 NSW Collecting feed data for cessnock, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 8 Blossom Way, Bellbird NSW 2325 Saving record cessnock - 3 Breezy Cr, Bellbird NSW 2325 Saving record cessnock - 21 Abberton Pwy, North Rothbury NSW 2335 Saving record cessnock - 38 Harmony Cl, Bellbird NSW 2325 Saving record cessnock - 10 Kendall St, Bellbird NSW 2325 Saving record cessnock - 42 Crown Line Dr, Rothbury NSW 2320 Saving record cessnock - 7 Greta St, Aberdare NSW 2325 Saving record cessnock - 22 Rugby St, Ellalong NSW 2325 Saving record cessnock - 80 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 21 Morningstar Cr, North Rothbury NSW 2335 Saving record cessnock - 21 Morningstar Cr, North Rothbury NSW 2335 Saving record cessnock - 33A Occident St, Nulkaba NSW 2325 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2023/00000789/001 Saving record cessnock - 8 Maple Dr, Pokolbin NSW 2320 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2024/00000637/001 Saving record cessnock - 10 Trader St, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2024/00000638/001 Saving record cessnock - 8 Trader St, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2024/00000639/001 Saving record cessnock - 6 Trader St, North Rothbury NSW 2335 Saving record cessnock - 4 Caphilly Pwy, North Rothbury NSW 2335 Saving record cessnock - 60 Caphilly Pwy, North Rothbury NSW 2335 Saving record cessnock - Triton Blvd, North Rothbury NSW 2335 Saving record cessnock - 278 Heaton Rd, Quorrobolong NSW 2325 Saving record cessnock - 88 Abbotsford St, Bellbird NSW 2325 Saving record cessnock - 355 Lang St, Kurri Kurri NSW 2327 Saving record cessnock - 73A Catherine St, Cessnock NSW 2325 Saving record cessnock - 82 Abbotsford St, Bellbird NSW 2325 Saving record cessnock - 49 Kalingo St, Bellbird NSW 2325 Saving record cessnock - 94 Sawyers Gully Rd, Sawyers Gully NSW 2326 Saving record cessnock - 1054 Wine Country Dr, Lovedale NSW 2325 Saving record cessnock - 29 William Tester Dr, Cliftleigh NSW 2321 Saving record cessnock - 4 Urquhart Way, North Rothbury NSW 2335 Saving record cessnock - 96A Deakin St, Kurri Kurri NSW 2327 Saving record cessnock - 23 Harmony Cl, Bellbird NSW 2325 Saving record cessnock - 65 Aberdare Rd, Aberdare NSW 2325 Saving record cessnock - 61 Abbotsford St, Bellbird NSW 2325 Saving record cessnock - 18 Saxonvale Gr, Cessnock NSW 2325 Saving record cessnock - 20 Merion Cct, Heddon Greta NSW 2321 Saving record cessnock - 13 Cheetham Cr, North Rothbury NSW 2335 Saving record cessnock - Cedar Creek Rd, Cedar Creek NSW 2325 Saving record cessnock - 7 Barnbougle St, Heddon Greta NSW 2321 Saving record cessnock - 30 Flourish Way, Bellbird NSW 2325 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00002176/001 Saving record cessnock - 13 Caudalie St, Bellbird NSW 2325 Saving record cessnock - 64 Hopetoun St, Kurri Kurri NSW 2327 Saving record cessnock - 14 Flourish Way, Bellbird NSW 2325 Saving record cessnock - 7 Caudalie St, Bellbird NSW 2325 Saving record cessnock - 1 Allandale St, Kearsley NSW 2325 cessnock: ERROR: Net::ReadTimeout Collecting feed data for dubbo, attempt: 1... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record dubbo - 416 Arthurville Rd, Ponto 2818 NSW Saving record dubbo - 9 Asset Wy, Dubbo 2830 NSW Saving record dubbo - 1/22 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 10 Gasnier Pl, Dubbo 2830 NSW Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 18 Ashlundie Cr, Dubbo 2830 NSW Saving record dubbo - 12R Toorale Rd, Dubbo 2830 NSW Saving record dubbo - 12R Toorale Rd, Dubbo 2830 NSW Saving record dubbo - 241 Myall St, Dubbo 2830 NSW Saving record dubbo - 34 Leonard St, Dubbo 2830 NSW Saving record dubbo - 13L Cumboogle Rd, Dubbo 2830 NSW Saving record dubbo - 15 Blueridge Dr, Dubbo 2830 NSW Saving record dubbo - 2 Wirraway Cl, Dubbo 2830 NSW Saving record dubbo - 10 Gasnier Pl, Dubbo 2830 NSW Saving record dubbo - 10 Gasnier Pl, Dubbo 2830 NSW Saving record dubbo - 5 Combo Rd, Maryvale 2820 NSW Saving record dubbo - 5 Combo Rd, Maryvale 2820 NSW Saving record dubbo - 46 Delta Rd, Dubbo 2830 NSW Saving record dubbo - 6R Bunglegumbie Rd, Dubbo 2830 NSW Saving record dubbo - 49-65 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 15 Geurie St, Geurie 2818 NSW Saving record dubbo - 12 Hawthorn St, Dubbo 2830 NSW Saving record dubbo - 19 Sunvale Ave, Dubbo 2830 NSW Saving record dubbo - 59 Nubrigyn St, Euchareena 2866 NSW Saving record dubbo - 35 Castlereagh Ave, Dubbo 2830 NSW Saving record dubbo - 11L Numbardie Dr, Dubbo 2830 NSW Saving record dubbo - 11L Numbardie Dr, Dubbo 2830 NSW Saving record dubbo - 3 Tenandra St, Wongarbon 2831 NSW Saving record dubbo - 14R Whitewood Rd, Dubbo 2830 NSW Saving record dubbo - 107 Erskine St, Dubbo 2830 NSW Saving record dubbo - 1R Silverton Rd, Dubbo 2830 NSW Saving record dubbo - 1R Silverton Rd, Dubbo 2830 NSW Saving record dubbo - 10L Terra Dr, Terramungamine 2830 NSW Saving record dubbo - 13A Violet Crct, Dubbo 2830 NSW Saving record dubbo - 2 Jane Ct, Dubbo 2830 NSW Saving record dubbo - 14R Whitewood Rd, Dubbo 2830 NSW Saving record dubbo - 2 Jane Ct, Dubbo 2830 NSW Saving record dubbo - 17 Chrisbrook Tce, Dubbo 2830 NSW Saving record dubbo - 3L Mooculta Rd, Dubbo 2830 NSW Saving record dubbo - 3L Mooculta Rd, Dubbo 2830 NSW Saving record dubbo - 10 Bembrose La, Dubbo 2830 NSW Saving record dubbo - 12 Hawthorn St, Dubbo 2830 NSW Saving record dubbo - 3 Roper St, Dubbo 2830 NSW Saving record dubbo - 24 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 20 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 10L Terra Dr, Terramungamine 2830 NSW Saving record dubbo - 7 Reid St, Wellington 2820 NSW Saving record dubbo - 2622 Euchareena Rd, Euchareena 2866 NSW Saving record dubbo - 7 Reid St, Wellington 2820 NSW Saving record dubbo - 23L Debeaufort Dr, Dubbo 2830 NSW Saving record dubbo - 23L Debeaufort Dr, Dubbo 2830 NSW Saving record dubbo - 116 Wellington St, Geurie 2818 NSW Saving record dubbo - 295 Lowrie Dr, Apsley 2820 NSW Saving record dubbo - 27 Paterson Crct, Dubbo 2830 NSW Saving record dubbo - 5R Desert Star Dr, Dubbo 2830 NSW Saving record dubbo - 5R Desert Star Dr, Dubbo 2830 NSW Saving record dubbo - 27 Paterson Crct, Dubbo 2830 NSW Saving record dubbo - 33 Gisborne St, Wellington 2820 NSW Saving record dubbo - 9 Yuille Ct, Dubbo 2830 NSW Saving record dubbo - 9 Yuille Ct, Dubbo 2830 NSW Saving record dubbo - 9 Coral Cres, Dubbo 2830 NSW Saving record dubbo - 68R North Minore Rd, Dubbo 2830 NSW Saving record dubbo - 68R North Minore Rd, Dubbo 2830 NSW Saving record dubbo - 13 Amadeus Ave, Dubbo 2830 NSW Saving record dubbo - 13 Amadeus Ave, Dubbo 2830 NSW Saving record dubbo - 17 Pine Knoll Dr, Dubbo 2830 NSW Saving record dubbo - 15 Lesmurdie Pde, Dubbo 2830 NSW Saving record dubbo - 23 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 31 Braun Ave, Dubbo 2830 NSW Saving record dubbo - 36 Sapphire St, Dubbo 2830 NSW Saving record dubbo - 27 Augusta Ave, Dubbo 2830 NSW Saving record dubbo - 27 Augusta Ave, Dubbo 2830 NSW Saving record dubbo - 1 Church St, Dubbo 2830 NSW Saving record dubbo - 16 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 62 Percy St, Wellington 2820 NSW Saving record dubbo - 50R Rosedale Rd, Dubbo 2830 NSW Saving record dubbo - 9 Callistemon Cr, Dubbo 2830 NSW Saving record dubbo - 41 Pebble Beach Dr, Dubbo 2830 NSW Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 86 Cobra St, Dubbo 2830 NSW Saving record dubbo - 23-25 Bruce Ave, Dubbo 2830 NSW Saving record dubbo - 78 Victoria St, Dubbo 2830 NSW Saving record dubbo - 33 Maxwell St, Wellington 2820 NSW Saving record dubbo - 5 Denison St, Dubbo 2830 NSW Saving record dubbo - 15 Lesmurdie Pde, Dubbo 2830 NSW Saving record dubbo - 38 Cormorant Cres, Dubbo 2830 NSW Saving record dubbo - 38 Cormorant Cres, Dubbo 2830 NSW Saving record dubbo - 299 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 5L Beemery Rd, Dubbo 2830 NSW Saving record dubbo - 27 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 35 Freshwater Dr, Dubbo 2830 NSW Saving record dubbo - 31 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 23 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 39 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 56 Windsor Pde, Dubbo 2830 NSW Saving record dubbo - 99-103 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 188 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 24 Tide Cr, Dubbo 2830 NSW Saving record dubbo - 6 Stream Ave, Dubbo 2830 NSW Saving record dubbo - 7 Targa Ave, Dubbo 2830 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record dubbo - 2 Noccundra Pl, Dubbo 2830 NSW Saving record dubbo - 416 Arthurville Rd, Ponto 2818 NSW Saving record dubbo - 2 Noccundra Pl, Dubbo 2830 NSW Saving record dubbo - 4L Jandra Rd, Dubbo 2830 NSW Saving record dubbo - 35 Freshwater Dr, Dubbo 2830 NSW Saving record dubbo - 31 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 25 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 42 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 27 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 12 Paterson Crct, Dubbo 2830 NSW Saving record dubbo - 12 Hawthorn St, Dubbo 2830 NSW Saving record dubbo - 45 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 132-134 Erskine St, Dubbo 2830 NSW Saving record dubbo - 6 Bellinger Pl, Dubbo 2830 NSW Saving record dubbo - 18L Woodstock Rd, Dubbo 2830 NSW Saving record dubbo - 24 Delta Rd, Dubbo 2830 NSW Saving record dubbo - 662 Ponto Falls Rd, Maryvale 2820 NSW Saving record dubbo - 662 Ponto Falls Rd, Maryvale 2820 NSW Saving record dubbo - 30 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 30 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 43 Tamworth St, Dubbo 2830 NSW Saving record dubbo - 25 Holmwood Dr, Dubbo 2830 NSW Saving record dubbo - 101R Bunglegumbie Rd, Dubbo 2830 NSW Saving record dubbo - 34 William Farrer Dr, Dubbo 2830 NSW Saving record dubbo - 2R Richardson Rd, Dubbo 2830 NSW Saving record dubbo - 317 Highfield La, Geurie 2818 NSW Saving record dubbo - 89 Carrington Ave, Dubbo 2830 NSW Saving record dubbo - 46 Holmwood Dr, Dubbo 2830 NSW Saving record dubbo - 46 Holmwood Dr, Dubbo 2830 NSW Saving record dubbo - 135 Wingewarra St, Dubbo 2830 NSW Saving record dubbo - 25 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 132 Bunglegumbie Rd, Dubbo 2830 NSW Saving record dubbo - 30 Bayou Ave, Dubbo 2830 NSW Saving record dubbo - 4090 Golden Hwy, Elong Elong 2831 NSW Saving record dubbo - 39 Freshwater Dr, Dubbo 2830 NSW Saving record dubbo - 14 Oakland Wy, Dubbo 2830 NSW Saving record dubbo - 22 Cavelle Dr, Dubbo 2830 NSW Saving record dubbo - 29 Freshwater Dr, Dubbo 2830 NSW Saving record dubbo - 40 Stream Ave, Dubbo 2830 NSW Saving record dubbo - 40 Stream Ave, Dubbo 2830 NSW Saving record dubbo - 9599 Mitchell Hwy, Apsley 2820 NSW Saving record dubbo - 1-3 Rainbow Pl, Dubbo 2830 NSW Saving record dubbo - 4 Skymaster Pl, Dubbo 2830 NSW Saving record dubbo - 22 Tide Cr, Dubbo 2830 NSW Saving record dubbo - 22 Charmere Pl, Dubbo 2830 NSW Saving record dubbo - 6 Bellinger Pl, Dubbo 2830 NSW Saving record dubbo - 12 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 12 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 12 Cloonawillin Cl, Dubbo 2830 NSW Saving record dubbo - 19 Cooinda Cres, Dubbo 2830 NSW Saving record dubbo - 6 Bellinger Pl, Dubbo 2830 NSW Saving record dubbo - 49 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 49 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 5 Bellinger Pl, Dubbo 2830 NSW Saving record dubbo - 5 Bellinger Pl, Dubbo 2830 NSW Saving record dubbo - 180L Mendooran Rd, Dubbo 2830 NSW Saving record dubbo - 7 Siren St, Dubbo 2830 NSW Saving record dubbo - 6 Acquisition Cl, Dubbo 2830 NSW Saving record dubbo - 18 Riviera Ave, Dubbo 2830 NSW Saving record dubbo - 45 Lincoln Pky, Dubbo 2830 NSW Saving record dubbo - 8 Norfolk Cres, Dubbo 2830 NSW Saving record dubbo - 28 Leichhardt St, Dubbo 2830 NSW Saving record dubbo - 9 Mcguinn Cr, Dubbo 2830 NSW Saving record dubbo - 5R Terra Dr, Terramungamine 2830 NSW Saving record dubbo - 24R Sheraton Rd, Dubbo 2830 NSW Saving record dubbo - 12 Paterson Crct, Dubbo 2830 NSW Saving record dubbo - 35 Umangla St, Wongarbon 2831 NSW Saving record dubbo - 43 Palmer St, Dubbo 2830 NSW Saving record dubbo - 7009 Goolma Rd, Montefiores 2820 NSW Saving record dubbo - 61 Delta Rd, Dubbo 2830 NSW Saving record dubbo - 25A Wheelers La, Dubbo 2830 NSW Saving record dubbo - 15 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 78 Victoria St, Dubbo 2830 NSW Saving record dubbo - 45 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 13R Oakdene Rd, Dubbo 2830 NSW Saving record dubbo - 17 Hilton Pl, Dubbo 2830 NSW Saving record dubbo - 73 Delta Rd, Dubbo 2830 NSW Collecting feed data for fairfield, attempt: 1... Saving record fairfield - 26 Shackel AVE OLD GUILDFORD, NSW Saving record fairfield - 85-101 Horsley RD HORSLEY PARK, NSW Saving record fairfield - 23 Bland ST CARRAMAR, NSW Saving record fairfield - 1183 The Horsley DR WETHERILL PARK, NSW Saving record fairfield - 7 Penfold PL EDENSOR PARK, NSW Saving record fairfield - 280 Victoria ST WETHERILL PARK, NSW Saving record fairfield - 2 Cobham ST HORSLEY PARK, NSW Saving record fairfield - 719 The Horsley DR SMITHFIELD, NSW Saving record fairfield - 32 Hubert ST FAIRFIELD, NSW Saving record fairfield - 24 Bold ST CABRAMATTA WEST, NSW Saving record fairfield - 89 Bold ST CABRAMATTA WEST, NSW Saving record fairfield - 177 Hollywood DR LANSVALE, NSW Saving record fairfield - 25 Jasmine CRES CABRAMATTA, NSW Saving record fairfield - 4 Lomond ST WAKELEY, NSW Saving record fairfield - 5 Richards RD WAKELEY, NSW Saving record fairfield - 23 Maugham CRES WETHERILL PARK, NSW Saving record fairfield - 421 Hamilton RD FAIRFIELD WEST, NSW Saving record fairfield - 8 Bent ST VILLAWOOD, NSW Saving record fairfield - 6 Dunrossil AVE FAIRFIELD EAST, NSW Saving record fairfield - 26-30 Phelps ST CANLEY VALE, NSW Saving record fairfield - 8 Gurley PL BONNYRIGG, NSW Saving record fairfield - 18 Rossiter ST SMITHFIELD, NSW Saving record fairfield - 11 Usher CL ABBOTSBURY, NSW Saving record fairfield - 384 Cabramatta RD CABRAMATTA, NSW Saving record fairfield - 55 Alexander ST SMITHFIELD, NSW Saving record fairfield - 109-112 Goodrich RD CECIL PARK, NSW Saving record fairfield - 524 The Horsley DR FAIRFIELD, NSW Saving record fairfield - 363-365 Victoria ST WETHERILL PARK, NSW Saving record fairfield - 42 Bourke ST SMITHFIELD, NSW Saving record fairfield - 8 Devenish ST GREENFIELD PARK, NSW Saving record fairfield - 111 McBurney RD CABRAMATTA, NSW Saving record fairfield - 8 De Witt PL FAIRFIELD WEST, NSW Saving record fairfield - 20 Derby ST CANLEY HEIGHTS, NSW Collecting feed data for griffith, attempt: 1... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' Collecting feed data for gunnedah, attempt: 1... /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gunnedah - 7068 Oxley Hwy, Gunnedah NSW 2380 Saving record gunnedah - 67 Edward St, Gunnedah NSW 2380 Saving record gunnedah - 21 Booloocooroo Rd, Gunnedah NSW 2380 Saving record gunnedah - 702 Watermark Rd, Curlewis NSW 2381 Saving record gunnedah - 42-44 Pullaming St, Curlewis NSW 2381 Saving record gunnedah - 175 Barlow Rd, Gunnedah NSW 2380 Saving record gunnedah - 7 Ashford St, Gunnedah NSW 2380 Saving record gunnedah - 107-113 Mathias Rd, Gunnedah NSW 2380 Saving record gunnedah - 170 Bushs La, Gunnedah NSW 2380 Saving record gunnedah - 88 Orange Grove Rd, Gunnedah NSW 2380 Saving record gunnedah - 3 Kurrajong Rd, Gunnedah NSW 2380 Saving record gunnedah - 19 Denora Ave, Gunnedah NSW 2380 Collecting feed data for gympie, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gympie - Groundwater Rd, Pie Creek 4570 QLD Saving record gympie - Groundwater Rd, Pie Creek 4570 QLD Saving record gympie - 33A Langara Dve, Southside 4570 QLD Saving record gympie - 286 Amamoor Creek Rd, Amamoor 4570 QLD Saving record gympie - 58 Horseshoe Bend, Gympie 4570 QLD Saving record gympie - 37 Litschner Rd, Nahrunda 4570 QLD Saving record gympie - Groundwater Rd, Pie Creek 4570 QLD Saving record gympie - 386 Sandy Creek Rd, Veteran 4570 QLD Saving record gympie - 251 Hasthorpe Rd, Kandanga 4570 QLD Saving record gympie - 28 Edwin Campion Dve, Monkland 4570 QLD Saving record gympie - 30 Taylor Rd, Veteran 4570 QLD Saving record gympie - 25 Mcintosh Creek Rd, Jones Hill 4570 QLD Saving record gympie - 227 Sandy Creek Rd, Veteran 4570 QLD Saving record gympie - 5707 Wide Bay Hwy, Kinbombi 4601 QLD Saving record gympie - 2319 Kinbombi Rd, Manumbar 4601 QLD Saving record gympie - 22 Edwin Campion Dve, Monkland 4570 QLD Saving record gympie - 66 Barrett Rd, Widgee 4570 QLD Saving record gympie - 119 Pine St, Gympie 4570 QLD Saving record gympie - Kelly Dve, Glanmire 4570 QLD Saving record gympie - 30 Burns Rd, Ross Creek 4570 QLD Saving record gympie - 2 Salmon St, Tin Can Bay 4580 QLD Saving record gympie - 71 Osborne Ct, Wallu 4570 QLD Saving record gympie - 11 Pearce Rd, Goomeri 4601 QLD Saving record gympie - 37 Litschner Rd, Nahrunda 4570 QLD Saving record gympie - 55 Gambling Rd, Veteran 4570 QLD Saving record gympie - 42 Zerner Rd, Pie Creek 4570 QLD Collecting feed data for lismore, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record lismore - 334 James Gibson Rd, Corndale NSW 2480 Saving record lismore - 18 George Dr, Chilcotts Grass NSW 2480 Saving record lismore - 1 Cook St, South Lismore NSW 2480 Saving record lismore - 5 Birdwing Pl, Modanville NSW 2480 Saving record lismore - 59 Phyllis St, South Lismore NSW 2480 Saving record lismore - 92 Casino St, South Lismore NSW 2480 Saving record lismore - 30 Evergreen Dr, Goonellabah NSW 2480 Saving record lismore - 39A Caniaba St, South Lismore NSW 2480 Saving record lismore - 589 Ballina Rd, Goonellabah NSW 2480 Saving record lismore - 11 Wedgetail Ct, Goonellabah NSW 2480 Saving record lismore - 3 Pinecrest Dr, Goonellabah NSW 2480 Saving record lismore - 13 Gibbon St, North Lismore NSW 2480 Saving record lismore - 49 May St, Dunoon NSW 2480 Saving record lismore - 80 Ballina Rd, Lismore NSW 2480 Saving record lismore - 77 Standing St, The Channon NSW 2480 Saving record lismore - 29 Dalley St, East Lismore NSW 2480 Saving record lismore - 10 Maluta Pl, Lismore Heights NSW 2480 Saving record lismore - 10 Pinecrest Dr, Goonellabah NSW 2480 Saving record lismore - 13 Gallagher Dr, Lismore Heights NSW 2480 Saving record lismore - 11 John O'Neill Cct, Goonellabah NSW 2480 Saving record lismore - 10 Belleridge Rd, Nimbin NSW 2480 Saving record lismore - 392 Tuntable Falls Rd, Nimbin NSW 2480 Saving record lismore - 139 Invercauld Rd, Goonellabah NSW 2480 Saving record lismore - 16 Kylie Ave, Lismore Heights NSW 2480 Ignoring unknown value of determination type: nil on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/008.2025.00000050.001 Saving record lismore - 1 Holmes Cct, Chilcotts Grass NSW 2480 Saving record lismore - 28 Ballina Rd, Lismore NSW 2480 Saving record lismore - 10A Spurfield Rd, Mcleans Ridges NSW 2480 Saving record lismore - 200 Eureka Rd, Rosebank NSW 2480 Saving record lismore - 5 Southern Cross Tce, Goonellabah NSW 2480 Saving record lismore - 53 Terania St, North Lismore NSW 2480 Saving record lismore - 16 Tareeda Way, Nimbin NSW 2480 Saving record lismore - 7 Walker St, Clunes NSW 2480 Saving record lismore - 23 Cavendish Rd, Goonellabah NSW 2480 Saving record lismore - 77 Trinity Dr, Goonellabah NSW 2480 Saving record lismore - 2 Tareeda Way, Nimbin NSW 2480 Saving record lismore - 16 Eden Pl, Girards Hill NSW 2480 Saving record lismore - 425 Skyline Road South Rd, Wyrallah NSW 2480 Ignoring unknown value of determination type: nil on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/008.2025.00000044.001 Saving record lismore - 38 Ballina Rd, Lismore NSW 2480 Saving record lismore - 1 Spurfield Rd, Mcleans Ridges NSW 2480 Ignoring unknown value of determination type: nil on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/008.2025.00000033.002 Saving record lismore - 3 Schurr Dr, Goonellabah NSW 2480 Saving record lismore - 295 Skyline Road South Rd, Wyrallah NSW 2480 Saving record lismore - 11 Airforce Rd, East Lismore NSW 2480 Saving record lismore - 161 Fletcher Rd, Dunoon NSW 2480 Saving record lismore - 5 Rockview Ct, Nimbin NSW 2480 Saving record lismore - 62 Houlden Rd, Woodlawn NSW 2480 Saving record lismore - 30 Armstrong Rd, Rosebank NSW 2480 Saving record lismore - 92 Dunoon Rd, North Lismore NSW 2480 Saving record lismore - 65 Mckenzie St, Lismore NSW 2480 Saving record lismore - 56 Boggumbil Rd, Rock Valley NSW 2480 Saving record lismore - 50 River Bank Rd, Monaltrie NSW 2480 Saving record lismore - 19 Stewarts Way, Nimbin NSW 2480 Saving record lismore - 91 Mountain View Dr, Goonellabah NSW 2480 Saving record lismore - 29 Lancaster Dr, Goonellabah NSW 2480 Collecting feed data for maranoa, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record maranoa - Wormwell Dr, Roma 4455 QLD Saving record maranoa - 77 Racecourse Rd, Injune 4454 QLD Saving record maranoa - 121 Charles St, Roma 4455 QLD Saving record maranoa - 17 Lewis St, Roma 4455 QLD Saving record maranoa - 73 Beaumont Dr, Roma 4455 QLD Saving record maranoa - 79 Gregory St, Roma 4455 QLD Saving record maranoa - 100 Edwardes St, Roma 4455 QLD Saving record maranoa - 49 Gregory St, Roma 4455 QLD Saving record maranoa - 29A Bowen St, Roma 4455 QLD Saving record maranoa - 34 Cambridge St, Mitchell 4465 QLD Saving record maranoa - 117 Mcdowall St, Roma 4455 QLD Saving record maranoa - 117 Mcdowall St, Roma 4455 QLD Saving record maranoa - Hartleys Lane, Orange Hill 4455 QLD PROBLEM LOADING PAGE http://pdonline.maranoa.qld.gov.au/Application/ApplicationDetails/023.2025.00021534.001 Saving record maranoa - 31-35 Alice St, Mitchell 4465 QLD Saving record maranoa - 46 Bowen St, Roma 4455 QLD Saving record maranoa - 100/12 South St, Roma 4455 QLD Saving record maranoa - 19 Silo Lane, Hodgson 4455 QLD Saving record maranoa - George St, Amby 4462 QLD Saving record maranoa - 25 Twine St, Roma 4455 QLD Saving record maranoa - 21 Mcdowall St, Roma 4455 QLD Saving record maranoa - 44 Feather St, Roma 4455 QLD Saving record maranoa - 13 Alexander Ave, Roma 4455 QLD Saving record maranoa - 2-6 Parker St, Roma 4455 QLD Saving record maranoa - 44769-44823 Warrego Hwy, Roma 4455 QLD Saving record maranoa - 74 Quintin St, Roma 4455 QLD Saving record maranoa - 31 Ernest St, Hodgson 4455 QLD Saving record maranoa - 7 Soutter St, Roma 4455 QLD Saving record maranoa - 5-7 Phillip St, Roma 4455 QLD Saving record maranoa - 8L Fleming Dr, Roma 4455 QLD Saving record maranoa - 5-7 Phillip St, Roma 4455 QLD Saving record maranoa - 33 Hoffman St, Roma 4455 QLD Collecting feed data for muswellbrook, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record muswellbrook - 6 Common Rd, Muswellbrook 2333 NSW Saving record muswellbrook - 95-107 Maitland St, Muswellbrook 2333 NSW Saving record muswellbrook - 7 Stockyard Pde, Muswellbrook 2333 NSW Saving record muswellbrook - 7 Stockyard Pde, Muswellbrook 2333 NSW Saving record muswellbrook - 29 Stockyard Pde, Muswellbrook 2333 NSW Saving record muswellbrook - 26 Sunline St, Muswellbrook 2333 NSW Saving record muswellbrook - 10 Stable Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 17 Belmore St, Muswellbrook 2333 NSW Saving record muswellbrook - 16 Martindale St, Denman 2328 NSW Saving record muswellbrook - 24 Finnegan Cr, Muswellbrook 2333 NSW Saving record muswellbrook - 24 Martindale St, Denman 2328 NSW Saving record muswellbrook - 7 Burgundy St, Muswellbrook 2333 NSW Saving record muswellbrook - 7 Jackaroo Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 14 Adams St, Muswellbrook 2333 NSW Saving record muswellbrook - 13 Sepoy Cr, Muswellbrook 2333 NSW Saving record muswellbrook - 12 Paxton St, Denman 2328 NSW Saving record muswellbrook - 43 Sunline St, Muswellbrook 2333 NSW Saving record muswellbrook - 25 Tobruk Ave, Muswellbrook 2333 NSW Saving record muswellbrook - 46 Thompson St, Muswellbrook 2333 NSW Saving record muswellbrook - Almond St, Denman 2328 NSW Saving record muswellbrook - 7 Blakefield Rd, Muswellbrook 2333 NSW Saving record muswellbrook - 1 Herdsman Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 6 Shiraz St, Muswellbrook 2333 NSW Saving record muswellbrook - 10 Kenilworth St, Denman 2328 NSW Saving record muswellbrook - 153 Goulburn Dr, Sandy Hollow 2333 NSW Saving record muswellbrook - 85A Brook St, Muswellbrook 2333 NSW Saving record muswellbrook - 34 Northview Cct, Muswellbrook 2333 NSW Saving record muswellbrook - 32 Northview Cct, Muswellbrook 2333 NSW Saving record muswellbrook - 19 Northview Cct, Muswellbrook 2333 NSW Collecting feed data for port_macquarie_hastings, attempt: 1... Collecting feed data for port_stephens, attempt: 1... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for shoalhaven, attempt: 1... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Saving record shoalhaven - 16 Womack Cl, BERRY, NSW Saving record shoalhaven - 67 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 8 Hilder Cl, MILTON, NSW Saving record shoalhaven - 59 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 34 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 21 Sandhurst Cr, MOLLYMOOK BEACH, NSW Saving record shoalhaven - 27 Deering St, ULLADULLA, NSW Saving record shoalhaven - 40 Browns Mountain Rd, TAPITALLEE, NSW Saving record shoalhaven - 4 Westhaven Av, NOWRA, NSW Saving record shoalhaven - 92 Murray St, CALLALA BAY, NSW Saving record shoalhaven - 272 The Wool Rd, ST GEORGES BASIN, NSW Saving record shoalhaven - 27 Deering St, ULLADULLA, NSW Saving record shoalhaven - 40 Browns Mountain Rd, TAPITALLEE, NSW Saving record shoalhaven - 16 Allerton Av, CULBURRA BEACH, NSW Saving record shoalhaven - 39A Cambewarra Rd, BOMADERRY, NSW Saving record shoalhaven - 156 Marina Lane, CULBURRA BEACH, NSW Saving record shoalhaven - 156B Mackays Rd, UPPER KANGAROO RIVER, NSW Saving record shoalhaven - 8 Haven St, CULBURRA BEACH, NSW Saving record shoalhaven - 40 Birkdale Cct, SUSSEX INLET, NSW Saving record shoalhaven - 17 Boree St, ULLADULLA, NSW Saving record shoalhaven - 40 Church St, MILTON, NSW Saving record shoalhaven - 6A Coral Sea Dr, WEST NOWRA, NSW Saving record shoalhaven - Wirraway Bvd, BADAGARANG, NSW Saving record shoalhaven - 164C Princes Hwy, SOUTH NOWRA<br>5/164C Princes Hwy, SOUTH NOWRA, NSW Saving record shoalhaven - 7 Sabre St, BADAGARANG, NSW Saving record shoalhaven - B640 Princes Hwy, JASPERS BRUSH, NSW Saving record shoalhaven - 3 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 8 Moona Creek Rd, VINCENTIA, NSW Saving record shoalhaven - 45 Little Forest Rd, LITTLE FOREST, NSW Saving record shoalhaven - 2 The Court, MOLLYMOOK BEACH, NSW Saving record shoalhaven - 52 Parma Rd, FALLS CREEK, NSW Saving record shoalhaven - 10 Haven St, CULBURRA BEACH, NSW Saving record shoalhaven - Corymbia Way, BADAGARANG, NSW Saving record shoalhaven - 17 Fitch St, ULLADULLA, NSW Saving record shoalhaven - 49 Sugar Glider Drive, TAPITALLEE, NSW Saving record shoalhaven - 13 Staples St, SHOALHAVEN HEADS, NSW Saving record shoalhaven - 280 Main Rd, CAMBEWARRA, NSW Saving record shoalhaven - 5 Barbata Gr, SOUTH NOWRA, NSW Saving record shoalhaven - 18 The Concourse, CAMBEWARRA VILLAGE, NSW Saving record shoalhaven - 93 Jasmine Dr, BOMADERRY, NSW Saving record shoalhaven - 3 Springfield Dr, MOLLYMOOK, NSW Saving record shoalhaven - Eumundi Av, BADAGARANG, NSW Saving record shoalhaven - 110 Lancaster Dr, BADAGARANG, NSW Saving record shoalhaven - 1275 Illaroo Rd, TAPITALLEE, NSW Saving record shoalhaven - 22 Uranna Av, NORTH NOWRA, NSW Saving record shoalhaven - 27 Broadview Av, CULBURRA BEACH, NSW Saving record shoalhaven - 315 Princes Hwy, BOMADERRY, NSW Saving record shoalhaven - 119 Princes Hwy, ULLADULLA, NSW Saving record shoalhaven - 28 Isa Rd, WORRIGEE, NSW Saving record shoalhaven - 6 Greenwell St, CURRARONG, NSW Saving record shoalhaven - 23 Acacia St, FISHERMANS PARADISE, NSW Saving record shoalhaven - Church St, MILTON, NSW Saving record shoalhaven - 84 Jasmine Dr, BOMADERRY, NSW Saving record shoalhaven - 4 Gipsy Moth St, BADAGARANG, NSW Saving record shoalhaven - 33 Corymbia Way, BADAGARANG, NSW Saving record shoalhaven - 102 Wirraway Bvd, BADAGARANG, NSW Saving record shoalhaven - 66 Ross Av, NARRAWALLEE, NSW Saving record shoalhaven - 68 Journal St, NOWRA, NSW Saving record shoalhaven - 14 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 41 Beach St, VINCENTIA, NSW Saving record shoalhaven - 3 Wedgetail St, BADAGARANG, NSW Saving record shoalhaven - 9 Alpha Road, BADAGARANG, NSW Saving record shoalhaven - 126 Bunkers Hill Rd, BARRENGARRY, NSW Saving record shoalhaven - 57 Victoria St, BERRY, NSW Saving record shoalhaven - 385 Parma Rd, PARMA, NSW Saving record shoalhaven - 60A South St, ULLADULLA, NSW Saving record shoalhaven - 57 Wandean Rd, WANDANDIAN, NSW Saving record shoalhaven - 25 King George St, EROWAL BAY, NSW Saving record shoalhaven - 243A Princes Hwy, MILTON, NSW Saving record shoalhaven - 232 Kerry St, SANCTUARY POINT, NSW Saving record shoalhaven - 10 Princes Hwy, BURRILL LAKE, NSW Saving record shoalhaven - 10 Greenbank Gr, CULBURRA BEACH, NSW Saving record shoalhaven - 9 Taurus St, BADAGARANG, NSW Saving record shoalhaven - 39 George St, BERRY, NSW Saving record shoalhaven - 104 Wirraway Bvd, BADAGARANG, NSW Saving record shoalhaven - 8 Mona St, CULBURRA BEACH, NSW Saving record shoalhaven - 40 Browns Mountain Rd, TAPITALLEE, NSW Saving record shoalhaven - 108 Malibu Dr, BAWLEY POINT, NSW Saving record shoalhaven - 7 Curvers Dr, MANYANA, NSW Saving record shoalhaven - 56 Pebbly Beach Rd, EAST LYNNE, NSW Saving record shoalhaven - 49 Sugar Glider Drive, TAPITALLEE, NSW Saving record shoalhaven - 65B Edwards Av, BOMADERRY, NSW Saving record shoalhaven - 227 Moss Vale Rd, KANGAROO VALLEY, NSW Saving record shoalhaven - 48 Cormorant Av, SUSSEX INLET, NSW Saving record shoalhaven - Culburra Rd, WOLLUMBOOLA, NSW Saving record shoalhaven - 2/24 New St, ULLADULLA, NSW Saving record shoalhaven - 10 Taylors Lane, BADAGARANG<br>2 Taylors Lane, BADAGARANG<br>49 Taylors Lane, BADAGARANG<br>Catalina Pl, BADAGARANG, NSW Saving record shoalhaven - Maisie Williams Dr, MOLLYMOOK, NSW Saving record shoalhaven - 45A Murramarang Rd, BAWLEY POINT, NSW Saving record shoalhaven - Culburra Rd, CULBURRA BEACH, NSW Saving record shoalhaven - 40 Junction St, NOWRA, NSW Saving record shoalhaven - 45 Elizabeth Dr, VINCENTIA, NSW Saving record shoalhaven - 17 Crookhaven Pde, CURRARONG, NSW Saving record shoalhaven - 84 Cedarvale Lane (Priv), JASPERS BRUSH, NSW Saving record shoalhaven - 8 Livingstone St, DURRAS NORTH, NSW Saving record shoalhaven - 861 Sussex Inlet Rd, SUSSEX INLET, NSW Saving record shoalhaven - 179 Cedar Springs Rd, KANGAROO VALLEY, NSW Saving record shoalhaven - 29 Miller St, VINCENTIA, NSW Saving record shoalhaven - 76 Pitt St, NORTH NOWRA, NSW Saving record shoalhaven - 45 Catherine St, MYOLA, NSW Saving record shoalhaven - 82 Hillcrest Av, SOUTH NOWRA, NSW Saving record shoalhaven - 85 Naval Pde, EROWAL BAY, NSW Saving record shoalhaven - 660 Comerong Island Rd, NUMBAA, NSW Saving record shoalhaven - 47 Orama Cr, ORIENT POINT, NSW Saving record shoalhaven - 53 Woollamia Rd, FALLS CREEK, NSW Saving record shoalhaven - 8 Lurnea Av, BAWLEY POINT, NSW Saving record shoalhaven - 19 Banool Cct, BOMADERRY, NSW Saving record shoalhaven - 16 George Av, KINGS POINT, NSW Saving record shoalhaven - 14 Highview Dr, DOLPHIN POINT, NSW Saving record shoalhaven - 20 Greenbank Gr, CULBURRA BEACH, NSW Saving record shoalhaven - 6 Silkwood Walk, CALLALA BEACH, NSW Saving record shoalhaven - 43A Boorawine Tce, CALLALA BAY, NSW Saving record shoalhaven - 28 Wolseley St, MILTON, NSW Saving record shoalhaven - 197 Kinghorne St, NOWRA, NSW Saving record shoalhaven - 62 Lackersteen St, CALLALA BAY, NSW Saving record shoalhaven - Canal St East, CULBURRA BEACH<br>Culburra Rd, CULBURRA BEACH<br>Prince Edward Av, CULBURRA BEACH<br>West Cr, CULBURRA BEACH, NSW Saving record shoalhaven - 73 Watt St, CALLALA BAY, NSW Saving record shoalhaven - 15 Wendy Pl, SOUTH NOWRA, NSW Saving record shoalhaven - 8 Snapper Rd, HUSKISSON, NSW Saving record shoalhaven - 4 Morschel Av, NORTH NOWRA, NSW Saving record shoalhaven - The Park Dr, SANCTUARY POINT, NSW Saving record shoalhaven - 12 Myrtle Drive, BADAGARANG, NSW Saving record shoalhaven - 243 Lake Conjola Entrance Rd, CONJOLA PARK, NSW Saving record shoalhaven - 185 Bundewallah Rd, BUNDEWALLAH, NSW Saving record shoalhaven - 22 East Cr, CULBURRA BEACH, NSW Saving record shoalhaven - 61 Penguins Head Rd, CULBURRA BEACH, NSW Saving record shoalhaven - 381 Murramarang Rd, BAWLEY POINT, NSW Saving record shoalhaven - 7 Ada St, VINCENTIA, NSW Saving record shoalhaven - 119 Evelyn Rd, TOMERONG, NSW Saving record shoalhaven - 17 Banool Cct, BOMADERRY, NSW Saving record shoalhaven - 9 Otway St, ORIENT POINT, NSW Saving record shoalhaven - 2 Elian Cr, SOUTH NOWRA, NSW Saving record shoalhaven - 59 Bolong Rd, BOMADERRY, NSW Saving record shoalhaven - 889B Illaroo Rd, TAPITALLEE, NSW Saving record shoalhaven - 31 Holloway Rd, NOWRA<br>72 Park Rd, NOWRA, NSW Saving record shoalhaven - 9 Victa Way, BOMADERRY, NSW Saving record shoalhaven - 50 Manyana Dr, MANYANA, NSW Saving record shoalhaven - 147 Basin View Pde, BASIN VIEW, NSW Saving record shoalhaven - 34 Streamside St, WOOLLAMIA, NSW Saving record shoalhaven - 15 Ben Dooley Rd, BERRY MOUNTAIN, NSW Saving record shoalhaven - 11 Beecroft Pde, CURRARONG, NSW Saving record shoalhaven - 14 Elder Cr, NOWRA, NSW Saving record shoalhaven - 45 Illfracombe Av, VINCENTIA, NSW Saving record shoalhaven - 11 Altitude St, BADAGARANG, NSW Saving record shoalhaven - 87 Loralyn Av, ST GEORGES BASIN, NSW Saving record shoalhaven - 26 Kean Av, SANCTUARY POINT, NSW Saving record shoalhaven - 19 Banool Cct, BOMADERRY, NSW Saving record shoalhaven - 35 King George St, CALLALA BEACH, NSW Saving record shoalhaven - 149 Yerunda Rd, TOMERONG, NSW Saving record shoalhaven - 130 Kangaroo Valley Rd, BERRY, NSW Saving record shoalhaven - 52 McDonald Pde, BURRILL LAKE, NSW Saving record shoalhaven - 42 Voyager Cr, BAWLEY POINT<br>44 Voyager Cr, BAWLEY POINT, NSW Saving record shoalhaven - 9 Greens Rd, GREENWELL POINT, NSW Saving record shoalhaven - 777 Burrier Rd, BURRIER, NSW Saving record shoalhaven - 76 Emerald Dr, MEROO MEADOW, NSW Saving record shoalhaven - 193 Princes Hwy, SOUTH NOWRA, NSW Saving record shoalhaven - 33 Eyrie Bowrie Dr, MILTON, NSW Saving record shoalhaven - 110A Elliott Lane, MEROO MEADOW, NSW Saving record shoalhaven - Orsova Pde, ORIENT POINT, NSW Collecting feed data for singleton, attempt: 1... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) Collecting feed data for strathfield, attempt: 1... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record strathfield - 24 Arthur St, Strathfield 2135 NSW Saving record strathfield - 7-9 Underwood Rd, Homebush 2140 NSW Saving record strathfield - 23 Richmond Rd, Homebush West 2140 NSW Saving record strathfield - 564-570 Liverpool Rd, Strathfield South 2136 NSW Saving record strathfield - 62 Newton Rd, Strathfield 2135 NSW Saving record strathfield - 7 Marion St, Strathfield 2135 NSW Saving record strathfield - 35 Churchill Ave, Strathfield 2135 NSW Saving record strathfield - 25 Juno Pde, Greenacre 2190 NSW Saving record strathfield - 11-23 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 2 Wakeford Rd, Strathfield 2135 NSW Saving record strathfield - 9 Vernon St, Strathfield 2135 NSW Saving record strathfield - 42 Cave Rd, Strathfield 2135 NSW Saving record strathfield - 4 Cutbush Ave, Strathfield South 2136 NSW Saving record strathfield - 51 Chalmers Rd, Strathfield 2135 NSW Saving record strathfield - 13 Firth Ave, Strathfield 2135 NSW Saving record strathfield - 3-5 Nichol Pde, Strathfield 2135 NSW Saving record strathfield - 6 Heyde Ave, Strathfield 2135 NSW Saving record strathfield - 11 William St, Strathfield South 2136 NSW Saving record strathfield - 15 Glenarvon St, Strathfield 2135 NSW Saving record strathfield - 99 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 98 Abbotsford Rd, Homebush 2140 NSW Saving record strathfield - 61-65 Roberts Rd, Greenacre 2190 NSW Saving record strathfield - 17 Water St, Strathfield South 2136 NSW Saving record strathfield - 98 Redmyre Rd, Strathfield 2135 NSW Saving record strathfield - 1/2-4 Carrington Ave, Strathfield 2135 NSW Collecting feed data for upper_hunter, attempt: 1... upper_hunter: ERROR: unexpected character: '<!DOCTYPE' at line 1 column 1 /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/lib/masterview_scraper/get_applications_api.rb:68:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' *************************************************** Now retrying authorities which earlier had failures albury, bega_valley, bogan, bundaberg, burwood, cessnock, griffith, port_macquarie_hastings, port_stephens, singleton, upper_hunter *************************************************** Collecting feed data for albury, attempt: 2... Collecting feed data for bega_valley, attempt: 2... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bogan, attempt: 2... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bundaberg, attempt: 2... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for burwood, attempt: 2... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' Collecting feed data for cessnock, attempt: 2... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 8 Blossom Way, Bellbird NSW 2325 Saving record cessnock - 3 Breezy Cr, Bellbird NSW 2325 Saving record cessnock - 21 Abberton Pwy, North Rothbury NSW 2335 Saving record cessnock - 38 Harmony Cl, Bellbird NSW 2325 Saving record cessnock - 10 Kendall St, Bellbird NSW 2325 Saving record cessnock - 42 Crown Line Dr, Rothbury NSW 2320 Saving record cessnock - 7 Greta St, Aberdare NSW 2325 Saving record cessnock - 22 Rugby St, Ellalong NSW 2325 Saving record cessnock - 80 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 21 Morningstar Cr, North Rothbury NSW 2335 Saving record cessnock - 21 Morningstar Cr, North Rothbury NSW 2335 Saving record cessnock - 33A Occident St, Nulkaba NSW 2325 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2023/00000789/001 Saving record cessnock - 8 Maple Dr, Pokolbin NSW 2320 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2024/00000637/001 Saving record cessnock - 10 Trader St, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2024/00000638/001 Saving record cessnock - 8 Trader St, North Rothbury NSW 2335 Ignoring unknown value of determination type: "Partial OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2024/00000639/001 Saving record cessnock - 6 Trader St, North Rothbury NSW 2335 Saving record cessnock - 4 Caphilly Pwy, North Rothbury NSW 2335 Saving record cessnock - 60 Caphilly Pwy, North Rothbury NSW 2335 Saving record cessnock - Triton Blvd, North Rothbury NSW 2335 Saving record cessnock - 278 Heaton Rd, Quorrobolong NSW 2325 Saving record cessnock - 88 Abbotsford St, Bellbird NSW 2325 Saving record cessnock - 355 Lang St, Kurri Kurri NSW 2327 Saving record cessnock - 73A Catherine St, Cessnock NSW 2325 Saving record cessnock - 82 Abbotsford St, Bellbird NSW 2325 Saving record cessnock - 49 Kalingo St, Bellbird NSW 2325 Saving record cessnock - 94 Sawyers Gully Rd, Sawyers Gully NSW 2326 Saving record cessnock - 1054 Wine Country Dr, Lovedale NSW 2325 Saving record cessnock - 29 William Tester Dr, Cliftleigh NSW 2321 Saving record cessnock - 4 Urquhart Way, North Rothbury NSW 2335 Saving record cessnock - 96A Deakin St, Kurri Kurri NSW 2327 Saving record cessnock - 23 Harmony Cl, Bellbird NSW 2325 Saving record cessnock - 65 Aberdare Rd, Aberdare NSW 2325 Saving record cessnock - 61 Abbotsford St, Bellbird NSW 2325 Saving record cessnock - 18 Saxonvale Gr, Cessnock NSW 2325 Saving record cessnock - 20 Merion Cct, Heddon Greta NSW 2321 Saving record cessnock - 13 Cheetham Cr, North Rothbury NSW 2335 Saving record cessnock - Cedar Creek Rd, Cedar Creek NSW 2325 Saving record cessnock - 7 Barnbougle St, Heddon Greta NSW 2321 Saving record cessnock - 30 Flourish Way, Bellbird NSW 2325 Ignoring unknown value of determination type: "Whole OC Private Certifier" on https://datracker.cessnock.nsw.gov.au/Application/ApplicationDetails/012/2025/00002176/001 Saving record cessnock - 13 Caudalie St, Bellbird NSW 2325 Saving record cessnock - 64 Hopetoun St, Kurri Kurri NSW 2327 Saving record cessnock - 14 Flourish Way, Bellbird NSW 2325 Saving record cessnock - 7 Caudalie St, Bellbird NSW 2325 Saving record cessnock - 1 Allandale St, Kearsley NSW 2325 cessnock: ERROR: Net::ReadTimeout /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' Collecting feed data for griffith, attempt: 2... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_macquarie_hastings, attempt: 2... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' Collecting feed data for port_stephens, attempt: 2... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for singleton, attempt: 2... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' Collecting feed data for upper_hunter, attempt: 2... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' upper_hunter: ERROR: unexpected character: '<!DOCTYPE' at line 1 column 1 /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/lib/masterview_scraper/get_applications_api.rb:68:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' MORPH_EXPECT_BAD=bogan Scraping Summary: Authority OK Bad Exception -------------------- ------ ------ -------------------------------------------------- albury 0 0 Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] ballina 152 0 - /app/vendor/bundle/ruby/3.2.0/gems/scraper_utils-0.8.2/lib/scraper_utils/log_utils.rb:192:in `report_on_results': ERROR: Unexpected errors in: albury,bega_valley,bundaberg,burwood,cessnock,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter (Add to MORPH_EXPECT_BAD?) (RuntimeError) albury: Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) bega_valley 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] bega_valley: Net::OpenTimeout - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (execution expired) bundaberg: Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response bogan 0 0 [EXPECT BAD] SocketError - Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] broken_hill 3 0 - burwood: Net::OpenTimeout - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) cessnock: Net::ReadTimeout - Net::ReadTimeout bundaberg 0 0 Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response [lib/masterview_scraper.rb:85:in `scrape_api_period'] griffith: Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) port_macquarie_hastings: Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) burwood 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] byron 108 0 - port_stephens: Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) cessnock 44 0 Net::ReadTimeout - Net::ReadTimeout [lib/masterview_scraper.rb:99:in `block in scrape_api_period'] singleton: Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) dubbo 177 0 - fairfield 33 0 - upper_hunter: JSON::ParserError - unexpected character: '<!DOCTYPE' at line 1 column 1 See earlier output for details from scraper.rb:67:in `run' from scraper.rb:83:in `<main>' griffith 0 0 Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] gunnedah 12 0 - gympie 26 0 - lismore 53 0 - maranoa 31 0 - muswellbrook 29 0 - port_macquarie_hastings 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] port_stephens 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] shoalhaven 159 0 - singleton 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] strathfield 25 0 - upper_hunter 0 0 JSON::ParserError - unexpected character: '<!DOCTYPE' at line 1 column 1 [lib/masterview_scraper/get_applications_api.rb:68:in `scrape_page']

Data

Downloaded 90 times by dcalde AndreM101 muzzie86 jamasalbertastash studiology repose-lecture

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (22.5 MB) Use the API

rows 10 / 56389

council_reference address description info_url date_scraped date_received authority_label
10-2021-16-1
2 Angus St, Forbes 2871 NSW
New Garages/Sheds - Industrial
2021-03-16
2021-02-22
forbes
10-2021-15-1
613 Wongajong Rd, Forbes 2871 NSW
New Single Dwelling
2021-03-16
2021-02-18
forbes
10-2021-13-1
1829 Lachlan Valley Wy, Jemalong 2871 NSW
New Single Dwelling
2021-03-16
2021-02-15
forbes
10-2021-14-1
131A Wambat St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-02-16
forbes
10-2017-80-3
33-37 Sam St, Forbes 2871 NSW
New Commercial Building
2021-03-16
2021-03-03
forbes
10-2021-19-1
36A William St, Forbes 2871 NSW
Patio Cover
2021-03-16
2021-03-05
forbes
10-2021-20-1
2 Rae St, Forbes 2871 NSW
New Ancillary Residential Development-Shed/Carport
2021-03-16
2021-03-05
forbes
10-2021-18-1
12 Acacia Ave, Forbes 2871 NSW
New Ancillary Residential Development-Shed
2021-03-16
2021-03-02
forbes
10-2021-17-1
10 Thelma St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-03-02
forbes
10-2021-1-1
Ooma St, Forbes 2871 NSW
Ancillary Residential Development - Awning
2021-03-16
2021-02-25
forbes

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (22.5 MB) Use the API

rows 10 / 1426

run_at attempt authority_label records_saved unprocessable_records status error_message error_class error_backtrace
2025-10-16T13:29:10+00:00
1
albury
0
0
failed
Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-10-16T13:29:10+00:00
1
ballina
146
0
successful
2025-10-16T13:29:10+00:00
1
bega_valley
0
0
failed
Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-10-16T13:29:10+00:00
1
bogan
0
0
failed
Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known)
SocketError
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-10-16T13:29:10+00:00
1
broken_hill
15
0
successful
2025-10-16T13:29:10+00:00
1
bundaberg
0
0
failed
403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-10-16T13:29:10+00:00
1
burwood
0
0
failed
Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-10-16T13:29:10+00:00
1
byron
121
0
successful
2025-10-16T13:29:10+00:00
1
cessnock
325
0
successful
2025-10-16T13:29:10+00:00
1
dubbo
169
0
successful

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (22.5 MB) Use the API

rows 10 / 62

run_at attempt duration successful failed interrupted successful_count interrupted_count failed_count public_ip
2025-10-16T13:29:10+00:00
1
2157.7
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-10-16T14:05:08+00:00
2
424.6
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-10-17T18:38:19+00:00
1
2151.5
ballina,broken_hill,byron,cessnock,dubbo,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,fairfield,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
11
0
12
2025-10-17T19:14:10+00:00
2
477.2
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-10-18T01:51:19+00:00
1
2237.8
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-10-18T02:28:36+00:00
2
424.3
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-10-19T11:24:11+00:00
1
2118.0
ballina,broken_hill,byron,cessnock,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,dubbo,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
11
0
12
2025-10-19T11:59:29+00:00
2
433.1
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,gympie,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-10-20T02:15:10+00:00
1
2008.6
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-10-20T02:48:39+00:00
2
423.0
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10

Statistics

Average successful run time: about 7 hours

Total run time: 2 months

Total cpu time used: about 5 hours

Total disk space used: 145 MB

History

  • Auto ran revision 2b320e6e and failed .
    891 records added, 878 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    1161 records added, 1113 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    929 records added, 836 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    1127 records added, 1087 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    1082 records added, 1028 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_masterview / scraper.rb