StashProperty / multiple_masterview

Scrapes multiple authorities that have a masterview system


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What a Masterview website looks like

Sign up

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer njenkins ianheggie-oaf dcalde

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Default EXPECT_BAD: --- :bogan: https://github.com/planningalerts-scrapers/issues/issues/935 - Council website bad, does not publish Scraping authorities: albury, ballina, bega_valley, bogan, broken_hill, bundaberg, burwood, byron, cessnock, dubbo, fairfield, griffith, gunnedah, gympie, lismore, maranoa, muswellbrook, port_macquarie_hastings, port_stephens, shoalhaven, singleton, strathfield, upper_hunter Collecting feed data for albury, attempt: 1... Collecting feed data for ballina, attempt: 1... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 1/28 Kell Mather Dr, Lennox Head NSW 2478 Saving record ballina - 47 Clavan St, Ballina NSW 2478 Saving record ballina - 104 Cherry St, Ballina NSW 2478 Saving record ballina - 15 Libby La, Lennox Head NSW 2478 Saving record ballina - 13 Angus Kennedy Cl, Lennox Head NSW 2478 Saving record ballina - 8 Ross La, Kinvara NSW 2478 Saving record ballina - 10 Hayman St, West Ballina NSW 2478 Saving record ballina - 47 Beryl Pl, Lennox Head NSW 2478 Saving record ballina - 485 Pearces Creek Rd, Alstonvale NSW 2477 Saving record ballina - 68 Norton St, Ballina NSW 2478 Saving record ballina - 20 River Dr, East Wardell NSW 2477 Saving record ballina - 1/417 Fernleigh Rd, Fernleigh NSW 2479 Saving record ballina - 54 Killarney Cr, Skennars Head NSW 2478 Saving record ballina - 1/27 Greenfield Rd, Lennox Head NSW 2478 Saving record ballina - 59 Burns Point Ferry Rd, West Ballina NSW 2478 Saving record ballina - 316 Old Byron Bay Rd, Newrybar NSW 2479 Saving record ballina - 16 Mcevoy St, Cumbalum NSW 2478 Saving record ballina - 7 Calypso Ct, Alstonville NSW 2477 Saving record ballina - 10 Lakeview Cct, East Ballina NSW 2478 Saving record ballina - 6 Hyde Park Rd, Wollongbar NSW 2477 Saving record ballina - 61 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 35 Carroll Ave, Skennars Head NSW 2478 Saving record ballina - 35 Carroll Ave, Skennars Head NSW 2478 Saving record ballina - 26 Dalmacia Dr, Wollongbar NSW 2477 Saving record ballina - 12 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 8 Angus Kennedy Cl, Lennox Head NSW 2478 Saving record ballina - 149 Byrnes La, Tuckombil NSW 2477 Saving record ballina - 29A Survey St, Lennox Head NSW 2478 Saving record ballina - 2/15 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 26 Dress Circle Dr, Lennox Head NSW 2478 Saving record ballina - 58 Catherine Cr, Ballina NSW 2478 Saving record ballina - 186-190 Lismore Rd, Wollongbar NSW 2477 Saving record ballina - 6 Eider Qd, Ballina NSW 2478 Saving record ballina - 40 Millbrook Tce, Wollongbar NSW 2477 Saving record ballina - 23 Cove Ave, Skennars Head NSW 2478 Saving record ballina - 10 Triton St, Lennox Head NSW 2478 Saving record ballina - 16 Canal Rd, Ballina NSW 2478 Saving record ballina - 10 Killen Falls Dr, Tintenbar NSW 2478 Saving record ballina - 2 Madden Pl, Cumbalum NSW 2478 Saving record ballina - 2/11 Rayner La, Lennox Head NSW 2478 Saving record ballina - 6 Nelson Ch, Tuckombil NSW 2477 Saving record ballina - 20 Bletchingly St, Wollongbar NSW 2477 Saving record ballina - 12 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 13 Diversity Ave, Cumbalum NSW 2478 Saving record ballina - 8 Bangalow Rd, Ballina NSW 2478 Saving record ballina - 45 Piper Dr, Ballina NSW 2478 Saving record ballina - 316 Old Byron Bay Rd, Newrybar NSW 2479 Saving record ballina - 26 Daybreak Wy, Lennox Head NSW 2478 Saving record ballina - 1/13 Coral St, Alstonville NSW 2477 Saving record ballina - 26 Dress Circle Dr, Lennox Head NSW 2478 Saving record ballina - 61 Snapper Dr, Lennox Head NSW 2478 Saving record ballina - 2/10 Patricia Pde, Lennox Head NSW 2478 Saving record ballina - 8 Hyde Park Rd, Wollongbar NSW 2477 Saving record ballina - 434 Ellis Rd, Rous NSW 2477 Saving record ballina - 352 South Ballina Beach Rd, South Ballina NSW 2478 Saving record ballina - 1/13 Rayner La, Lennox Head NSW 2478 Saving record ballina - 19 Diversity Ave, Cumbalum NSW 2478 Saving record ballina - 1/22 Mcevoy St, Cumbalum NSW 2478 Saving record ballina - 119-125 River St, Ballina NSW 2478 Saving record ballina - 14 Acreage St, Cumbalum NSW 2478 Saving record ballina - 119-125 River St, Ballina NSW 2478 Saving record ballina - 15 Bantry St, Ballina NSW 2478 Saving record ballina - 23 Cove Ave, Skennars Head NSW 2478 Saving record ballina - 51B Greenfield Rd, Lennox Head NSW 2478 Saving record ballina - 10 Martins La, Knockrow NSW 2479 Saving record ballina - 1/8 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 1/8 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 91-93 River St, Ballina NSW 2478 Saving record ballina - 44 Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 63 Platypus Dr, Uralba NSW 2477 Saving record ballina - 1/29 Cessna Cr, Ballina NSW 2478 Saving record ballina - 8 River Dr, East Wardell NSW 2477 Saving record ballina - 8 River Dr, East Wardell NSW 2477 Saving record ballina - 19 Spinnaker Cr, West Ballina NSW 2478 Saving record ballina - 751 Bagotville Rd, Bagotville NSW 2477 Saving record ballina - 751 Bagotville Rd, Bagotville NSW 2477 Saving record ballina - 60 Salt Air Cct, Lennox Head NSW 2478 Saving record ballina - 85 Skennars Head Rd, Skennars Head NSW 2478 Saving record ballina - 28 Northumberland Dr, East Ballina NSW 2478 Saving record ballina - 24 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 16 Acreage St, Cumbalum NSW 2478 Saving record ballina - 1/13 Rayner La, Lennox Head NSW 2478 Saving record ballina - 45 Carlisle St, Wardell NSW 2477 Saving record ballina - 5 Lakefield Ave, Lennox Head NSW 2478 Saving record ballina - 24 Sunhaven Ave, Skennars Head NSW 2478 Saving record ballina - 41 Bruxner Hwy, West Ballina NSW 2478 Saving record ballina - 1/76 Stewart St, Lennox Head NSW 2478 Saving record ballina - 1/12 Pipi Pl, Ballina NSW 2478 Saving record ballina - 10 Martins La, Knockrow NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 186 Broken Head Rd, Newrybar NSW 2479 Saving record ballina - 86 Fox St, Ballina NSW 2478 Saving record ballina - 18-20 Old Pacific Hwy, Newrybar NSW 2479 /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 7 Hercules Cr, Ballina NSW 2478 Saving record ballina - 19 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 207 Martins La, Knockrow NSW 2479 Saving record ballina - 9 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 117 Riverside Dr, West Ballina NSW 2478 Saving record ballina - 484 Uralba Rd, Uralba NSW 2477 Saving record ballina - 21 Montwood Dr, Lennox Head NSW 2478 Saving record ballina - 25A Sandbreak Cr, Lennox Head NSW 2478 Saving record ballina - 20 Richmond St, Wardell NSW 2477 Saving record ballina - 1/57 Stewart St, Lennox Head NSW 2478 Saving record ballina - 1/57 Stewart St, Lennox Head NSW 2478 Saving record ballina - 114 Eyles Dr, East Ballina NSW 2478 Saving record ballina - 1/6 Kell Mather Dr, Lennox Head NSW 2478 Saving record ballina - 8 Offshore Ave, Skennars Head NSW 2478 Saving record ballina - 8 Sea-Swallow Pl, East Ballina NSW 2478 Saving record ballina - 7 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 114 Eyles Dr, East Ballina NSW 2478 Saving record ballina - 8 Oakwood Dr, Ballina NSW 2478 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Collecting feed data for bega_valley, attempt: 1... Collecting feed data for bogan, attempt: 1... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for broken_hill, attempt: 1... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record broken_hill - 480 Morgan St, Broken Hill NSW 2880 Saving record broken_hill - 24 Creedon St, Broken Hill NSW 2880 Saving record broken_hill - 521 Mcgowen St, Broken Hill NSW 2880 Saving record broken_hill - 153 Jamieson St, Broken Hill NSW 2880 Saving record broken_hill - 251 Buck St, Broken Hill NSW 2880 Collecting feed data for bundaberg, attempt: 1... Collecting feed data for burwood, attempt: 1... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for byron, attempt: 1... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 4 Browning St, Byron Bay 2481 NSW Saving record byron - 28 Beachside Drv, Suffolk Park 2481 NSW Saving record byron - 2 Thomson Crt, Ocean Shores 2483 NSW Saving record byron - 42 Corkwood Crs, Suffolk Park 2481 NSW Saving record byron - 10 Rifle Range Rd, Bangalow 2479 NSW Saving record byron - 16 Nandroya Ave, Ocean Shores 2483 NSW Saving record byron - 3 Wallaby Cl, Ewingsdale 2481 NSW Saving record byron - 10 Coachwood Crt, Federal 2480 NSW Saving record byron - 30 Currawong Way, Ewingsdale 2481 NSW Saving record byron - 119 Yankee Creek Rd, Wilsons Creek 2482 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 5/6 Bugam Pl, Bangalow 2479 NSW Saving record byron - 10 Giaour St, Byron Bay 2481 NSW Saving record byron - 150 Koonyum Range Rd, Wilsons Creek 2482 NSW Saving record byron - 257 Mcauleys Ln, Myocum 2482 NSW Saving record byron - 52 New City Rd, Mullumbimby 2482 NSW Saving record byron - 36A Booyun St, Brunswick Heads 2483 NSW Saving record byron - 104 Alcorn St, Suffolk Park 2481 NSW Saving record byron - 26/73 Centennial Cct, Byron Bay 2481 NSW Saving record byron - 1/6 Nandroya Ave, Ocean Shores 2483 NSW Saving record byron - 175 Moffatts Rd, Billinudgel 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 11 Balun Ln, Brunswick Heads 2483 NSW Saving record byron - 20 Tincogan St, Mullumbimby 2482 NSW Saving record byron - 43 Gordon St, Mullumbimby 2482 NSW Saving record byron - 804 Main Arm Rd, Main Arm 2482 NSW Saving record byron - 1A Byron St, Byron Bay 2481 NSW Saving record byron - 660A Bangalow Rd, Talofa 2481 NSW Saving record byron - 399 Ewingsdale Rd, Byron Bay 2481 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW Saving record byron - 8 Coachwood Crt, Federal 2480 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 5-7 New Brighton Rd, New Brighton 2483 NSW Saving record byron - 4 Woodswallow Way, Mullumbimby 2482 NSW Saving record byron - 6 Giaour St, Byron Bay 2481 NSW Saving record byron - 25 Bulgoon Crs, Ocean Shores 2483 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW Saving record byron - 5 Namoi Gl, Ocean Shores 2483 NSW Saving record byron - 143 The Tunnell Rd, Billinudgel 2483 NSW Saving record byron - 45 Brandon St, Suffolk Park 2481 NSW Saving record byron - 17 Jonson St, Byron Bay 2481 NSW Saving record byron - 4/336 Tweed Valley Way, Wooyung 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 84 Dudgeons Ln, Bangalow 2479 NSW Saving record byron - 10 Brandon St, Suffolk Park 2481 NSW Saving record byron - 27 Tennyson St, Byron Bay 2481 NSW Saving record byron - 37 Scenic Vsta, Ewingsdale 2481 NSW Saving record byron - 5 Ferguson Crt, Bangalow 2479 NSW Saving record byron - 14 Warrambool Rd, Ocean Shores 2483 NSW Saving record byron - 4 Pacific Vista Drv, Byron Bay 2481 NSW Saving record byron - 11 Evans St, Byron Bay 2481 NSW Saving record byron - 67 Bougainvillea Drv, Federal 2480 NSW Saving record byron - 23 Keats St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 4 Wilpy Pl, Ocean Shores 2483 NSW Saving record byron - 30 Fingal St, Brunswick Heads 2483 NSW Saving record byron - 305 Coopers Shoot Rd, Coopers Shoot 2479 NSW Saving record byron - 26 Teak Cct, Suffolk Park 2481 NSW Saving record byron - 290 Middle Pocket Rd, Middle Pocket 2483 NSW Saving record byron - 7 Gaggin St, New Brighton 2483 NSW Saving record byron - 82 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 990 Friday Hut Rd, Binna Burra 2479 NSW Saving record byron - 544 Coolamon Scenic Drv, Coorabell 2479 NSW Saving record byron - 17 Jonson St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 804 Main Arm Rd, Main Arm 2482 NSW Saving record byron - 257 Whian Rd, Eureka 2480 NSW Saving record byron - 9 Marvell St, Byron Bay 2481 NSW Saving record byron - 56 Stuart St, Mullumbimby 2482 NSW Saving record byron - 13 Terrace St, New Brighton 2483 NSW Saving record byron - 12 Jackwood Crt, Suffolk Park 2481 NSW Saving record byron - 42 Orana Rd, Ocean Shores 2483 NSW Saving record byron - 9 Davidson Pl, Mullumbimby 2482 NSW Saving record byron - 11 Woodswallow Way, Mullumbimby 2482 NSW Saving record byron - 1/134 Tuckeroo Ave, Mullumbimby 2482 NSW Collecting feed data for cessnock, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 11 Tollbar Av, North Rothbury NSW 2335 Saving record cessnock - 8 Dempsey Way, North Rothbury NSW 2335 Saving record cessnock - 17 Treesbank Pl, Nulkaba NSW 2325 Saving record cessnock - 11 Barnbougle St, Heddon Greta NSW 2321 Saving record cessnock - 18 Craftsman Rd, North Rothbury NSW 2335 Saving record cessnock - 41 Dalwood Rd, East Branxton NSW 2335 Saving record cessnock - 18 Aria Ent, Rothbury NSW 2320 Saving record cessnock - 6 Kempe St, Cessnock NSW 2325 cessnock: ERROR: Net::ReadTimeout Collecting feed data for dubbo, attempt: 1... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record dubbo - 43 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 43 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 199A Wingewarra St, Dubbo 2830 NSW Saving record dubbo - 36R Barbigal Rd, Wongarbon 2831 NSW Saving record dubbo - 6 Bellinger Pl, Dubbo 2830 NSW Saving record dubbo - 115 Glenowen Rd, Bakers Swamp 2820 NSW Saving record dubbo - 18 Magpie Cl, Dubbo 2830 NSW Saving record dubbo - 18 Waterway Cres, Dubbo 2830 NSW Saving record dubbo - Champagne Dr, Dubbo 2830 NSW Saving record dubbo - 55 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 55 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 42 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 42 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 6L Glen Isla Rd, Rawsonville 2830 NSW Saving record dubbo - 54 Grangewood Dr, Dubbo 2830 NSW Saving record dubbo - 17L Hillside Dr, Dubbo 2830 NSW Saving record dubbo - 46 Tamworth St, Dubbo 2830 NSW Saving record dubbo - 96 Lakeside Crct, Dubbo 2830 NSW Saving record dubbo - 7R Burraway Rd, Brocklehurst 2830 NSW Saving record dubbo - 80L Burraway Rd, Terramungamine 2830 NSW Saving record dubbo - 80L Burraway Rd, Terramungamine 2830 NSW Saving record dubbo - 5R Desert Star Dr, Dubbo 2830 NSW Saving record dubbo - 12 Ocean Ct, Dubbo 2830 NSW Saving record dubbo - 12 Paterson Crct, Dubbo 2830 NSW Saving record dubbo - 13 Fuzzy Box Rd, Geurie 2818 NSW Saving record dubbo - 13 Fuzzy Box Rd, Geurie 2818 NSW Saving record dubbo - 22 Peel Pl, Dubbo 2830 NSW Saving record dubbo - 22 Peel Pl, Dubbo 2830 NSW Saving record dubbo - 12 Nagle Dr, Dubbo 2830 NSW Saving record dubbo - 4L Flannel Flower Dr, Dubbo 2830 NSW Saving record dubbo - 4L Flannel Flower Dr, Dubbo 2830 NSW Saving record dubbo - 12 Nagle Dr, Dubbo 2830 NSW Saving record dubbo - Cavelle Dr, Dubbo 2830 NSW Saving record dubbo - 39 Azure Ave, Dubbo 2830 NSW Saving record dubbo - 4 Rainbow Pl, Dubbo 2830 NSW Saving record dubbo - 145 Arthur St, Wellington 2820 NSW Saving record dubbo - 17L Debeaufort Dr, Dubbo 2830 NSW Saving record dubbo - 526 Wheelers La, Dubbo 2830 NSW Saving record dubbo - 320 Macquarie St, Dubbo 2830 NSW Saving record dubbo - Von Nida Cl, Dubbo 2830 NSW Saving record dubbo - 300 Nanima Village Rd, Wellington 2820 NSW Saving record dubbo - 5 Equity Ave, Dubbo 2830 NSW Saving record dubbo - 22 Peel Pl, Dubbo 2830 NSW Saving record dubbo - 7R Burraway Rd, Brocklehurst 2830 NSW Saving record dubbo - 19A South Buninyong Rd, Dubbo 2830 NSW Saving record dubbo - 19 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 19 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 294 Fitzroy St, Dubbo 2830 NSW Saving record dubbo - 4 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 5R Desert Star Dr, Dubbo 2830 NSW Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 1 Church St, Dubbo 2830 NSW Saving record dubbo - 17 Bragg St, Wongarbon 2831 NSW Saving record dubbo - 17 Bragg St, Wongarbon 2831 NSW Saving record dubbo - 2 Goulburn St, Dubbo 2830 NSW Saving record dubbo - 53 Myall St, Dubbo 2830 NSW Saving record dubbo - 31 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 32 St Andrews Dr, Dubbo 2830 NSW Saving record dubbo - 23 Charmere Pl, Dubbo 2830 NSW Saving record dubbo - 20 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 12 Chrisbrook Tce, Dubbo 2830 NSW Saving record dubbo - 38 Corbett Ave, Dubbo 2830 NSW Saving record dubbo - 38 Corbett Ave, Dubbo 2830 NSW Saving record dubbo - 428A Macquarie St, Dubbo 2830 NSW Saving record dubbo - 72L Burraway Rd, Terramungamine 2830 NSW Saving record dubbo - 18 Stream Ave, Dubbo 2830 NSW Saving record dubbo - 53 Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 23 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 18 Stream Ave, Dubbo 2830 NSW Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 2805 Mitchell Hwy, Geurie 2818 NSW Saving record dubbo - 2805 Mitchell Hwy, Geurie 2818 NSW Saving record dubbo - 11 Fuzzy Box Rd, Geurie 2818 NSW Saving record dubbo - 11 Fuzzy Box Rd, Geurie 2818 NSW Saving record dubbo - 9 Hellyer Ct, Dubbo 2830 NSW Saving record dubbo - 9 Hellyer Ct, Dubbo 2830 NSW Saving record dubbo - 14 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 16 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 45 Gilbert St, Dubbo 2830 NSW Saving record dubbo - 2 Oak St, Dubbo 2830 NSW Saving record dubbo - 3R Richardson Rd, Dubbo 2830 NSW Saving record dubbo - 8 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 6 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 251 Brisbane St, Dubbo 2830 NSW Saving record dubbo - 46 Hindmarsh Esp, Dubbo 2830 NSW Saving record dubbo - 46 Hindmarsh Esp, Dubbo 2830 NSW Saving record dubbo - 30 St Georges Tce, Dubbo 2830 NSW Saving record dubbo - 1R Riverbend Dr, Terramungamine 2830 NSW Saving record dubbo - 4 Gregory Ct, Dubbo 2830 NSW Saving record dubbo - 12R Torwood Rd, Dubbo 2830 NSW Saving record dubbo - 17R Wilfred Smith Dr, Dubbo 2830 NSW Saving record dubbo - 14 Burroway St, Wongarbon 2831 NSW Saving record dubbo - 14 Burroway St, Wongarbon 2831 NSW Saving record dubbo - 100 Gobolion St, Wellington 2820 NSW Saving record dubbo - 100 Gobolion St, Wellington 2820 NSW Saving record dubbo - 6 Stream Ave, Dubbo 2830 NSW Saving record dubbo - 3R Peachville Rd, Dubbo 2830 NSW Saving record dubbo - 28 Blueridge Dr, Dubbo 2830 NSW Saving record dubbo - 120 Maxwell St, Wellington 2820 NSW Saving record dubbo - 37 Nicholii St, Montefiores 2820 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record dubbo - 87 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 11 Canal Ave, Dubbo 2830 NSW Saving record dubbo - 185 Bunglegumbie Rd, Dubbo 2830 NSW Saving record dubbo - 32 Pinehurst Ave, Dubbo 2830 NSW Saving record dubbo - 14 Burroway St, Wongarbon 2831 NSW Saving record dubbo - 29 Tamworth St, Dubbo 2830 NSW Saving record dubbo - 13 George St, Dubbo 2830 NSW Saving record dubbo - 120 Maxwell St, Wellington 2820 NSW Saving record dubbo - 15 Dalton St, Dubbo 2830 NSW Saving record dubbo - 43 Freshwater Dr, Dubbo 2830 NSW Saving record dubbo - 46 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 48 Sunningdale Cl, Dubbo 2830 NSW Collecting feed data for fairfield, attempt: 1... Collecting feed data for griffith, attempt: 1... fairfield: ERROR: Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=15/12/2025&2=14/01/2026&4a=10&6=F /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for gunnedah, attempt: 1... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gunnedah - 341-347 Conadilly St, Gunnedah NSW 2380 Saving record gunnedah - 2-4 Galway Ave, Gunnedah NSW 2380 Saving record gunnedah - 81-109 Wandobah Rd, Gunnedah NSW 2380 Saving record gunnedah - 47 Conadilly St, Gunnedah NSW 2380 Saving record gunnedah - 243 Conadilly St, Gunnedah NSW 2380 Saving record gunnedah - 438 Black Jack Rd, Gunnedah NSW 2380 Saving record gunnedah - 438 Black Jack Rd, Gunnedah NSW 2380 Saving record gunnedah - 295 Conadilly St, Gunnedah NSW 2380 Saving record gunnedah - 35 Wentworth St, Gunnedah NSW 2380 Saving record gunnedah - 23 Evans Rd, Gunnedah NSW 2380 Saving record gunnedah - 83 Reading Rd, Gunnedah NSW 2380 Saving record gunnedah - 83 Reading Rd, Gunnedah NSW 2380 Saving record gunnedah - 5 Wilga St, Gunnedah NSW 2380 Saving record gunnedah - 55 Beulah St, Gunnedah NSW 2380 Saving record gunnedah - 51 Hunts Rd, Gunnedah NSW 2380 Collecting feed data for gympie, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gympie - Groundwater Rd, Pie Creek 4570 QLD Saving record gympie - 64 Deans Rd, The Palms 4570 QLD Saving record gympie - 65 Tompkins Rd, Veteran 4570 QLD Saving record gympie - 30 Kandanga Imbil Rd, Kandanga 4570 QLD Saving record gympie - 269 Kirsten Dr, Curra 4570 QLD Saving record gympie - 26 Edwin Campion Dve, Monkland 4570 QLD Saving record gympie - 28 Gum Tree Rd, Araluen 4570 QLD Saving record gympie - Gympie Woolooga Rd, Lower Wonga 4570 QLD Saving record gympie - 28 Gum Tree Rd, Araluen 4570 QLD Saving record gympie - 28 Edwin Campion Dve, Monkland 4570 QLD Saving record gympie - 22 Edwin Campion Dve, Monkland 4570 QLD Saving record gympie - 21 Mcmurtrie Rd, Chatsworth 4570 QLD Saving record gympie - 19 Country View Dve, Chatsworth 4570 QLD Saving record gympie - 108 Spencer Rd, Kilkivan 4600 QLD Saving record gympie - 149 Irvine Rd, Chatsworth 4570 QLD Collecting feed data for lismore, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record lismore - 1 Ingram Rd, Wyrallah NSW 2480 Ignoring unknown value of determination type: nil on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/008.2026.00000001.001 Saving record lismore - 6 Oliver Pl, East Lismore NSW 2480 Saving record lismore - 45 Wilson St, South Lismore NSW 2480 Saving record lismore - 440 Dorroughby Rd, Dorroughby NSW 2480 Saving record lismore - 42 Sawyers Ave, Goonellabah NSW 2480 Saving record lismore - 31 Hunter St, Lismore NSW 2480 Saving record lismore - 1132 Oakland Rd, East Coraki NSW 2471 Saving record lismore - 275 James Gibson Rd, Clunes NSW 2480 Saving record lismore - 3 Bottlebrush Pl, Caniaba NSW 2480 Saving record lismore - 2 Sapphire Ct, Lismore Heights NSW 2480 Saving record lismore - 8 Garden St, Girards Hill NSW 2480 Saving record lismore - 27 Evelyn Way, Nimbin NSW 2480 Saving record lismore - 56 James St, Dunoon NSW 2480 Saving record lismore - 71 Cosy Camp Rd, Bexhill NSW 2480 Saving record lismore - 133 Molesworth St, Lismore NSW 2480 Saving record lismore - 577 Kyogle Rd, Leycester NSW 2480 Saving record lismore - 40 George Dr, Chilcotts Grass NSW 2480 Saving record lismore - 38 May St, Dunoon NSW 2480 Saving record lismore - 574 Keerrong Rd, Keerrong NSW 2480 Saving record lismore - 219 Lake St, North Lismore NSW 2480 Saving record lismore - 222A Spring Grove Rd, Caniaba NSW 2480 Saving record lismore - 200 Eureka Rd, Rosebank NSW 2480 Saving record lismore - 128 Donnans Rd, Lismore Heights NSW 2480 Collecting feed data for maranoa, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record maranoa - River Rd, Mitchell 4465 QLD Saving record maranoa - 90-92 Chrystal St, Roma 4455 QLD Saving record maranoa - 158 Mcdowall St, Roma 4455 QLD Saving record maranoa - 1-11 Wormwell Dr, Roma 4455 QLD Saving record maranoa - 2194 Springfield Rd, Eurella 4462 QLD Saving record maranoa - 34 Cambridge St, Mitchell 4465 QLD Saving record maranoa - 2155 Yuleba Taroom Rd, Yuleba North 4427 QLD Saving record maranoa - 31 Ernest St, Hodgson 4455 QLD Saving record maranoa - 60 Wyndham St, Roma 4455 QLD Saving record maranoa - 37 Robusta Dr, Roma 4455 QLD Saving record maranoa - 3948 Yuleba Taroom Rd, Yuleba North 4427 QLD Saving record maranoa - 61 Raglan St, Roma 4455 QLD Saving record maranoa - 5-7 Bowen St, Roma 4455 QLD Saving record maranoa - 31 Duke St, Roma 4455 QLD Saving record maranoa - 269 Short St, Roma 4455 QLD Saving record maranoa - 100 Edwardes St, Roma 4455 QLD Saving record maranoa - 90-92 Charles St, Roma 4455 QLD Collecting feed data for muswellbrook, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record muswellbrook - 15 Cassidy Ave, Muswellbrook 2333 NSW Saving record muswellbrook - 146 Hill St, Muswellbrook 2333 NSW Saving record muswellbrook - 12A Grey Gum Rd, Denman 2328 NSW Saving record muswellbrook - 16-18 Ogilvie St, Denman 2328 NSW Saving record muswellbrook - 6 Shiraz St, Muswellbrook 2333 NSW Saving record muswellbrook - 95-107 Maitland St, Muswellbrook 2333 NSW Saving record muswellbrook - 1 Shearer's Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 9 Stockyard Pde, Muswellbrook 2333 NSW Saving record muswellbrook - 116 Victoria St, Muswellbrook 2333 NSW Saving record muswellbrook - 37 Sunline St, Muswellbrook 2333 NSW Saving record muswellbrook - 14 Adams St, Muswellbrook 2333 NSW Saving record muswellbrook - 7 Burgundy St, Muswellbrook 2333 NSW Saving record muswellbrook - 143 Queen St, Muswellbrook 2333 NSW Saving record muswellbrook - 33 Stockyard Pde, Muswellbrook 2333 NSW Saving record muswellbrook - 9 Isobella St, Muswellbrook 2333 NSW Saving record muswellbrook - 4 Stable Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 33-35 Palace St, Denman 2328 NSW Saving record muswellbrook - 64 Aberdeen St, Muswellbrook 2333 NSW Collecting feed data for port_macquarie_hastings, attempt: 1... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) Collecting feed data for port_stephens, attempt: 1... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for shoalhaven, attempt: 1... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Saving record shoalhaven - 28 Callala Beach Rd, CALLALA BEACH, NSW Saving record shoalhaven - 13 Sheeran St, OLD EROWAL BAY, NSW Saving record shoalhaven - 16A Gardner Rd, FALLS CREEK, NSW Saving record shoalhaven - 5 Kean Av, SANCTUARY POINT, NSW Saving record shoalhaven - 54 Lancaster Dr, BADAGARANG, NSW Saving record shoalhaven - 4 The Bastion, MANYANA, NSW Saving record shoalhaven - 49 Villagewood Dr, SUSSEX INLET, NSW Saving record shoalhaven - 889C Illaroo Rd, TAPITALLEE, NSW Saving record shoalhaven - 20 Bexhill Av, SUSSEX INLET, NSW Saving record shoalhaven - 5 Mernie St, OLD EROWAL BAY, NSW Saving record shoalhaven - 34 Glenair Av, WEST NOWRA, NSW Saving record shoalhaven - 6 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 29 Gerringong St, CURRARONG, NSW Saving record shoalhaven - 30 Downwind St, BADAGARANG, NSW Saving record shoalhaven - 10 Lacebark Gr, WORRIGEE, NSW Saving record shoalhaven - 50B Watt Rd, FALLS CREEK, NSW Saving record shoalhaven - 47 Moss St, NOWRA, NSW Saving record shoalhaven - 36 Caladenia Cr, SOUTH NOWRA, NSW Saving record shoalhaven - 11 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 5 Altitude St, BADAGARANG, NSW Saving record shoalhaven - 118 Loralyn Av, ST GEORGES BASIN, NSW Saving record shoalhaven - 28 Macquarie Dr, BURRILL LAKE, NSW Saving record shoalhaven - 109 Frederick St, VINCENTIA, NSW Saving record shoalhaven - 336 Huskisson Rd, HUSKISSON, NSW Saving record shoalhaven - 12 Tee Cl, WORRIGEE, NSW Saving record shoalhaven - 3 Callala St, CALLALA BAY, NSW Saving record shoalhaven - 1 Daisy Pl, WORRIGEE, NSW Saving record shoalhaven - 16 Eastwood Av, CULBURRA BEACH, NSW Saving record shoalhaven - 182 River Rd, SUSSEX INLET, NSW Saving record shoalhaven - 23 Spitfire St, BADAGARANG, NSW Saving record shoalhaven - 107 Scenic Dr, NOWRA, NSW Saving record shoalhaven - 27 Cumberland Av, SOUTH NOWRA, NSW Saving record shoalhaven - 119 Princes Hwy, ULLADULLA, NSW Saving record shoalhaven - 37 Manyana Dr, MANYANA, NSW Saving record shoalhaven - 16 Little Forest Rd, LITTLE FOREST, NSW Saving record shoalhaven - 33 Patrina Cct, ST GEORGES BASIN, NSW Saving record shoalhaven - 23 Worrigee St, NOWRA, NSW Saving record shoalhaven - 25 King George St, EROWAL BAY, NSW Saving record shoalhaven - 1 Bangalee Rd, TAPITALLEE, NSW Saving record shoalhaven - 2 Ophir St, ORIENT POINT, NSW Saving record shoalhaven - 15 Taurus St, BADAGARANG, NSW Saving record shoalhaven - 45 Clyde St, MOLLYMOOK BEACH, NSW Saving record shoalhaven - 2 Gull Av, SANCTUARY POINT, NSW Saving record shoalhaven - 14 Niblick Av, MOLLYMOOK BEACH, NSW Saving record shoalhaven - 392 Croobyar Rd, CROOBYAR, NSW Saving record shoalhaven - 43 Linden Way, MOLLYMOOK BEACH, NSW Saving record shoalhaven - 180 Marina Lane, CULBURRA BEACH, NSW Saving record shoalhaven - 2/3 Ingold Av, MOLLYMOOK<br>3 Ingold Av, MOLLYMOOK, NSW Saving record shoalhaven - 96 Homestead Lane, BERRY, NSW Saving record shoalhaven - 41 River Rd, LAKE TABOURIE, NSW Saving record shoalhaven - Wirraway Bvd, BADAGARANG, NSW Saving record shoalhaven - 35 James Cr, KINGS POINT, NSW Saving record shoalhaven - 73 Quay Rd, CALLALA BEACH, NSW Saving record shoalhaven - 5 Woorree Pl, ULLADULLA, NSW Saving record shoalhaven - 119 Berry St, NOWRA, NSW Saving record shoalhaven - 574 Sussex Inlet Rd, SUSSEX INLET, NSW Saving record shoalhaven - 391 Elizabeth Dr, VINCENTIA, NSW Saving record shoalhaven - 126 Bannister Head Rd, MOLLYMOOK BEACH, NSW Saving record shoalhaven - 16 Quay Rd, CALLALA BEACH, NSW Saving record shoalhaven - Culburra Rd, CULBURRA BEACH<br>Culburra Rd, CULBURRA BEACH, NSW Saving record shoalhaven - 19 Matron Porter Dr, NARRAWALLEE, NSW Saving record shoalhaven - 135 Wogamia Rd, LONGREACH, NSW Saving record shoalhaven - Church St, ULLADULLA, NSW Saving record shoalhaven - 26 Berry St, HUSKISSON, NSW Saving record shoalhaven - 10A Jaspers Brush Rd, JASPERS BRUSH, NSW Saving record shoalhaven - 50 Addison Rd, CULBURRA BEACH, NSW Saving record shoalhaven - 71 Nugents Creek Rd, KANGAROO VALLEY, NSW Saving record shoalhaven - 20 Depot Rd, WEST NOWRA, NSW Saving record shoalhaven - 9 The Glen, SANCTUARY POINT, NSW Saving record shoalhaven - 31 Berrara Rd, BERRARA<br>Berrara Rd, BERRARA, NSW Saving record shoalhaven - 52 Iverison Rd, SUSSEX INLET<br>8 St Georges Av, SUSSEX INLET, NSW Saving record shoalhaven - 59 Basil St, SOUTH NOWRA, NSW Saving record shoalhaven - 21 Noakes St, SHOALHAVEN HEADS, NSW Saving record shoalhaven - 43B Battunga Dr, TOMERONG, NSW Saving record shoalhaven - 11 Altitude St, BADAGARANG, NSW Saving record shoalhaven - Flannery Lane, TAPITALLEE, NSW Saving record shoalhaven - 65A Glenmurray Rd, KANGAROO VALLEY, NSW Saving record shoalhaven - Woodhill Mountain Rd, BERRY, NSW Saving record shoalhaven - 31 Clarence St, BERRY, NSW Saving record shoalhaven - 9 Birkdale Cct, SUSSEX INLET, NSW Saving record shoalhaven - 19 Sophia Rd, WORRIGEE, NSW Saving record shoalhaven - 2 Barnett St, VINCENTIA, NSW Saving record shoalhaven - 640 Parma Rd, PARMA<br>810 Parma Rd, PARMA<br>Parma Rd, PARMA, NSW Saving record shoalhaven - 8 Parkes Cr, CALLALA BEACH, NSW Saving record shoalhaven - 75 Parker Cr, BERRY, NSW Saving record shoalhaven - 17 Terara Rd, TERARA, NSW Saving record shoalhaven - Hitchcocks Lane, BERRY<br>Hitchcocks Lane, BERRY, NSW Collecting feed data for singleton, attempt: 1... Collecting feed data for strathfield, attempt: 1... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record strathfield - 12 Karuah St, Strathfield 2135 NSW Saving record strathfield - 1/507-511 Liverpool Rd, Strathfield 2135 NSW Saving record strathfield - 4-6 Broughton Rd, Strathfield 2135 NSW Saving record strathfield - 28-30 Albyn Rd, Strathfield 2135 NSW Saving record strathfield - 9 Edgar St, Strathfield 2135 NSW Saving record strathfield - 48 Churchill Ave, Strathfield 2135 NSW Saving record strathfield - 71 High St, Strathfield 2135 NSW Saving record strathfield - 90 Albyn Rd, Strathfield 2135 NSW Saving record strathfield - 6 Bridge Rd, Homebush 2140 NSW Saving record strathfield - 78-80 Cosgrove Rd, Strathfield South 2136 NSW Saving record strathfield - 92 Abbotsford Rd, Homebush 2140 NSW Saving record strathfield - 6 Marion St, Strathfield 2135 NSW Saving record strathfield - 33 Courallie Ave, Homebush West 2140 NSW Saving record strathfield - 17 Water St, Strathfield South 2136 NSW Saving record strathfield - 10 Agnes St, Strathfield 2135 NSW Saving record strathfield - 1 Pomona St, Greenacre 2190 NSW Saving record strathfield - 55 Kingsland Rd, Strathfield 2135 NSW Saving record strathfield - 250-318 Parramatta Rd, Homebush 2140 NSW Saving record strathfield - 2-34 Davidson St, Greenacre 2190 NSW Saving record strathfield - 76 Dean St, Strathfield South 2136 NSW Saving record strathfield - 31 Elliott St, Strathfield South 2136 NSW Saving record strathfield - 65-67 Homebush Rd, Strathfield 2135 NSW Saving record strathfield - 8 Chiswick St, Strathfield South 2136 NSW Saving record strathfield - 82 Homebush Rd, Strathfield 2135 NSW Saving record strathfield - 11 Dean St, Strathfield South 2136 NSW Saving record strathfield - 146 Homebush Rd, Strathfield 2135 NSW Saving record strathfield - 59 Long St, Strathfield 2135 NSW Saving record strathfield - 155 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 102 Barker Rd, Strathfield 2135 NSW Saving record strathfield - 39 Newton Rd, Strathfield 2135 NSW Saving record strathfield - 15 Glenarvon St, Strathfield 2135 NSW Saving record strathfield - 2 Noble Ave, Strathfield 2135 NSW Collecting feed data for upper_hunter, attempt: 1... upper_hunter: ERROR: unexpected character: '<!DOCTYPE' at line 1 column 1 /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/lib/masterview_scraper/get_applications_api.rb:68:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' *************************************************** Now retrying authorities which earlier had failures albury, bega_valley, bogan, bundaberg, burwood, cessnock, fairfield, griffith, port_macquarie_hastings, port_stephens, singleton, upper_hunter *************************************************** Collecting feed data for albury, attempt: 2... Collecting feed data for bega_valley, attempt: 2... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bogan, attempt: 2... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bundaberg, attempt: 2... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response Collecting feed data for burwood, attempt: 2... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for cessnock, attempt: 2... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 11 Tollbar Av, North Rothbury NSW 2335 Saving record cessnock - 8 Dempsey Way, North Rothbury NSW 2335 Saving record cessnock - 17 Treesbank Pl, Nulkaba NSW 2325 Saving record cessnock - 11 Barnbougle St, Heddon Greta NSW 2321 Saving record cessnock - 18 Craftsman Rd, North Rothbury NSW 2335 Saving record cessnock - 41 Dalwood Rd, East Branxton NSW 2335 Saving record cessnock - 18 Aria Ent, Rothbury NSW 2320 Saving record cessnock - 6 Kempe St, Cessnock NSW 2325 cessnock: ERROR: Net::ReadTimeout Collecting feed data for fairfield, attempt: 2... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for griffith, attempt: 2... fairfield: ERROR: Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=15/12/2025&2=14/01/2026&4a=10&6=F /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_macquarie_hastings, attempt: 2... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_stephens, attempt: 2... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for singleton, attempt: 2... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for upper_hunter, attempt: 2... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' upper_hunter: ERROR: unexpected character: '<!DOCTYPE' at line 1 column 1 /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/vendor/bundle/ruby/3.2.0/gems/json-2.12.2/lib/json/common.rb:338:in `parse' /app/lib/masterview_scraper/get_applications_api.rb:68:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' MORPH_EXPECT_BAD=bogan Scraping Summary: Authority OK Bad Exception -------------------- ------ ------ -------------------------------------------------- albury 0 0 Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] ballina 119 0 - bega_valley 0 0 SocketError - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] bogan 0 0 [EXPECT BAD] SocketError - Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] broken_hill 5 0 - bundaberg 0 0 Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response [lib/masterview_scraper.rb:85:in `scrape_api_period'] /app/vendor/bundle/ruby/3.2.0/gems/scraper_utils-0.8.2/lib/scraper_utils/log_utils.rb:192:in `report_on_results': ERROR: Unexpected errors in: albury,bega_valley,bundaberg,burwood,cessnock,fairfield,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter (Add to MORPH_EXPECT_BAD?) (RuntimeError) burwood 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] byron 70 0 - albury: Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) cessnock 8 0 Net::ReadTimeout - Net::ReadTimeout [lib/masterview_scraper.rb:99:in `block in scrape_api_period'] dubbo 112 0 - bega_valley: SocketError - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) bundaberg: Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response burwood: Net::OpenTimeout - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) fairfield 0 0 RuntimeError - Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=15/12/2025&2=14/01/2026&4a=10&6=F [lib/masterview_scraper/pages/index.rb:41:in `scrape'] cessnock: Net::ReadTimeout - Net::ReadTimeout griffith 0 0 Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] gunnedah 15 0 - fairfield: RuntimeError - Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=15/12/2025&2=14/01/2026&4a=10&6=F gympie 15 0 - lismore 23 0 - maranoa 17 0 - griffith: Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) muswellbrook 18 0 - port_macquarie_hastings: Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) port_macquarie_hastings 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] port_stephens: Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) singleton: Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) port_stephens 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] upper_hunter: JSON::ParserError - unexpected character: '<!DOCTYPE' at line 1 column 1 shoalhaven 87 0 - See earlier output for details from scraper.rb:67:in `run' from scraper.rb:83:in `<main>' singleton 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] strathfield 32 0 - upper_hunter 0 0 JSON::ParserError - unexpected character: '<!DOCTYPE' at line 1 column 1 [lib/masterview_scraper/get_applications_api.rb:68:in `scrape_page']

Data

Downloaded 112 times by dcalde tkrikke AndreM101 muzzie86 jamasalbertastash studiology repose-lecture

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (23.3 MB) Use the API

rows 10 / 58198

council_reference address description info_url date_scraped date_received authority_label
10-2021-16-1
2 Angus St, Forbes 2871 NSW
New Garages/Sheds - Industrial
2021-03-16
2021-02-22
forbes
10-2021-15-1
613 Wongajong Rd, Forbes 2871 NSW
New Single Dwelling
2021-03-16
2021-02-18
forbes
10-2021-13-1
1829 Lachlan Valley Wy, Jemalong 2871 NSW
New Single Dwelling
2021-03-16
2021-02-15
forbes
10-2021-14-1
131A Wambat St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-02-16
forbes
10-2017-80-3
33-37 Sam St, Forbes 2871 NSW
New Commercial Building
2021-03-16
2021-03-03
forbes
10-2021-19-1
36A William St, Forbes 2871 NSW
Patio Cover
2021-03-16
2021-03-05
forbes
10-2021-20-1
2 Rae St, Forbes 2871 NSW
New Ancillary Residential Development-Shed/Carport
2021-03-16
2021-03-05
forbes
10-2021-18-1
12 Acacia Ave, Forbes 2871 NSW
New Ancillary Residential Development-Shed
2021-03-16
2021-03-02
forbes
10-2021-17-1
10 Thelma St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-03-02
forbes
10-2021-1-1
Ooma St, Forbes 2871 NSW
Ancillary Residential Development - Awning
2021-03-16
2021-02-25
forbes

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (23.3 MB) Use the API

rows 10 / 1426

run_at attempt authority_label records_saved unprocessable_records status error_message error_class error_backtrace
2025-12-15T21:36:15+00:00
1
albury
0
0
failed
Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-12-15T21:36:15+00:00
1
ballina
93
0
successful
2025-12-15T21:36:15+00:00
1
bega_valley
0
0
failed
Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known)
SocketError
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-12-15T21:36:15+00:00
1
bogan
0
0
failed
Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known)
SocketError
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-12-15T21:36:15+00:00
1
broken_hill
10
0
successful
2025-12-15T21:36:15+00:00
1
bundaberg
0
0
failed
403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-12-15T21:36:15+00:00
1
burwood
0
0
failed
Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2025-12-15T21:36:15+00:00
1
byron
105
0
successful
2025-12-15T21:36:15+00:00
1
cessnock
254
0
successful
2025-12-15T21:36:15+00:00
1
dubbo
170
0
successful

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (23.3 MB) Use the API

rows 10 / 62

run_at attempt duration successful failed interrupted successful_count interrupted_count failed_count public_ip
2025-12-15T21:36:15+00:00
1
2642.6
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-12-15T22:20:17+00:00
2
363.3
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-12-16T19:21:15+00:00
1
2526.4
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-12-16T20:03:22+00:00
2
363.4
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-12-17T19:25:15+00:00
1
2703.9
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-12-17T20:10:19+00:00
2
363.4
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2025-12-18T17:10:15+00:00
1
2820.6
ballina,broken_hill,byron,cessnock,dubbo,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,fairfield,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-12-18T17:57:15+00:00
2
386.0
ballina,broken_hill,byron,cessnock,dubbo,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,fairfield,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-12-19T18:19:11+00:00
1
2645.9
ballina,broken_hill,byron,cessnock,dubbo,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,fairfield,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
12
0
11
2025-12-19T19:03:17+00:00
2
423.6
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10

Statistics

Average successful run time: about 7 hours

Total run time: 2 months

Total cpu time used: about 5 hours

Total disk space used: 146 MB

History

  • Auto ran revision 2b320e6e and failed .
    563 records added, 523 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    663 records added, 610 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    612 records added, 604 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    679 records added, 679 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    735 records added, 730 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_masterview / scraper.rb