StashProperty / multiple_masterview

Scrapes multiple authorities that have a masterview system


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What a Masterview website looks like

Sign up

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer njenkins ianheggie-oaf dcalde

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Default EXPECT_BAD: --- :bogan: https://github.com/planningalerts-scrapers/issues/issues/935 - Council website bad, does not publish Scraping authorities: albury, ballina, bega_valley, bogan, broken_hill, bundaberg, burwood, byron, cessnock, dubbo, fairfield, griffith, gunnedah, gympie, lismore, maranoa, muswellbrook, port_macquarie_hastings, port_stephens, shoalhaven, singleton, strathfield, upper_hunter Collecting feed data for albury, attempt: 1... Collecting feed data for ballina, attempt: 1... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 11 Sunbird Ave, Ballina NSW 2478 Saving record ballina - 144 Moylans La, Empire Vale NSW 2478 Saving record ballina - 2 Tuckeroo Dr, East Ballina NSW 2478 Saving record ballina - 3 Andrew Pl, Lennox Head NSW 2478 Saving record ballina - 14 Seaside Ave, Skennars Head NSW 2478 Saving record ballina - 39 Montwood Dr, Lennox Head NSW 2478 Saving record ballina - 39 Montwood Dr, Lennox Head NSW 2478 Saving record ballina - 95 Canal Rd, Ballina NSW 2478 Saving record ballina - 5 John Sharpe St, East Ballina NSW 2478 Saving record ballina - 17 Windrow Ave, Cumbalum NSW 2478 Saving record ballina - 206 Ballina Heights Dr, Cumbalum NSW 2478 Saving record ballina - 1 Siesta Ct, Alstonville NSW 2477 Saving record ballina - 61 Survey St, Lennox Head NSW 2478 Saving record ballina - 57 Northumberland Dr, East Ballina NSW 2478 Saving record ballina - 8 Oakwood Dr, Ballina NSW 2478 Saving record ballina - 2/6 Commercial Rd, Alstonville NSW 2477 Saving record ballina - 421 Coolgardie Rd, Coolgardie NSW 2478 Saving record ballina - 25 Howard Cr, West Ballina NSW 2478 Saving record ballina - 19 Leeson Ave, Ballina NSW 2478 Saving record ballina - Dou-Jea La, Lynwood NSW 2477 Saving record ballina - 56 Stewart St, Lennox Head NSW 2478 Saving record ballina - 2/1 Yuraygir Pl, Lennox Head NSW 2478 Saving record ballina - 5 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 30 Rifle Range Rd, Wollongbar NSW 2477 Saving record ballina - 7 Short St, East Ballina NSW 2478 Saving record ballina - 10 Endeavour Cl, Ballina NSW 2478 Saving record ballina - 45 Old Byron Bay Rd, Newrybar NSW 2479 Saving record ballina - 27 Leach Cr, West Ballina NSW 2478 Saving record ballina - 42 Salt Air Cct, Lennox Head NSW 2478 Saving record ballina - 52 Delva Rd, Wollongbar NSW 2477 Saving record ballina - 56 Sandstone Cr, Lennox Head NSW 2478 Saving record ballina - 12 Greenview Pl, Skennars Head NSW 2478 Saving record ballina - 50-52 River Dr, East Wardell NSW 2477 Saving record ballina - 66 Cooke Ave, Alstonville NSW 2477 Saving record ballina - 5 Admiral Vsta, Lennox Head NSW 2478 Saving record ballina - 914 Fernleigh Rd, Brooklet NSW 2479 Saving record ballina - 8 Oakwood Dr, Ballina NSW 2478 Saving record ballina - 709 Fernleigh Rd, Brooklet NSW 2479 Saving record ballina - 48 Surf Ave, Skennars Head NSW 2478 Saving record ballina - Dou-Jea La, Lynwood NSW 2477 Saving record ballina - 41 Avalon Ave, Wollongbar NSW 2477 Saving record ballina - 19 Cargelligo Cr, Ballina NSW 2478 Saving record ballina - 1/12 Florence Price Pl, Ballina NSW 2478 Saving record ballina - 29 Stoneyhurst Dr, Lennox Head NSW 2478 Saving record ballina - 24A Tara Dwn, Lennox Head NSW 2478 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 12B Stonehenge Pl, Lennox Head NSW 2478 Saving record ballina - 1 Foster St, Lennox Head NSW 2478 Saving record ballina - 15 Swift St, Ballina NSW 2478 Saving record ballina - 7 Tipperary Pl, Ballina NSW 2478 Saving record ballina - 21 Cargelligo Cr, Ballina NSW 2478 Saving record ballina - 178 Kirklands La, Fernleigh NSW 2479 Saving record ballina - 70 Scanlan La, Kinvara NSW 2478 Saving record ballina - 25 Lynette Cct, Wollongbar NSW 2477 Saving record ballina - 348 North Teven Rd, Teven NSW 2478 Saving record ballina - 21 Cargelligo Cr, Ballina NSW 2478 Saving record ballina - 26 Dress Circle Dr, Lennox Head NSW 2478 Saving record ballina - 59 Seaswell Cr, Lennox Head NSW 2478 Saving record ballina - 18 Acreage St, Cumbalum NSW 2478 Saving record ballina - 18 Acreage St, Cumbalum NSW 2478 Saving record ballina - 1 Alston Ave, Alstonville NSW 2477 Saving record ballina - 1 Alston Ave, Alstonville NSW 2477 Saving record ballina - 62 Bayview Dr, East Ballina NSW 2478 Saving record ballina - 30 Links Ave, East Ballina NSW 2478 Saving record ballina - 16 Riberry Gr, Wollongbar NSW 2477 Saving record ballina - 45 Northcott Cr, Alstonville NSW 2477 Saving record ballina - 39 River St, East Wardell NSW 2477 Saving record ballina - 19 Hewetsons La, Rous Mill NSW 2477 Saving record ballina - 19 Hewetsons La, Rous Mill NSW 2477 Saving record ballina - 15 Swift St, Ballina NSW 2478 Saving record ballina - 19 Castle Dr, Lennox Head NSW 2478 Saving record ballina - 77B Habitat Wy, Lennox Head NSW 2478 Saving record ballina - 1/77 Main St, Alstonville NSW 2477 Saving record ballina - 29 Stoneyhurst Dr, Lennox Head NSW 2478 Saving record ballina - 60 Dolphin Dr, West Ballina NSW 2478 Saving record ballina - 462-470 River St, West Ballina NSW 2478 Saving record ballina - 150 Sneaths Rd, Wollongbar NSW 2477 Saving record ballina - 1 Crawfords La, Rous Mill NSW 2477 Saving record ballina - 138 Dillons La, Alstonville NSW 2477 Saving record ballina - 12 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 112 Riverside Dr, West Ballina NSW 2478 Saving record ballina - 31 Mellis Cct, Alstonville NSW 2477 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 10 Manulla St, Ballina NSW 2478 Saving record ballina - 44 Delva Rd, Wollongbar NSW 2477 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 91-93 River St, Ballina NSW 2478 Saving record ballina - 22 Fallow Dr, Cumbalum NSW 2478 Saving record ballina - 53 Stoneyhurst Dr, Lennox Head NSW 2478 Saving record ballina - 1 Opal Cr, Alstonville NSW 2477 Saving record ballina - 10 Dent Cr, Cumbalum NSW 2478 Saving record ballina - 48 Surf Ave, Skennars Head NSW 2478 Saving record ballina - 8 Cowrie St, Lennox Head NSW 2478 Saving record ballina - 262 Kirklands La, Fernleigh NSW 2479 Saving record ballina - 263 Rous Rd, Rous NSW 2477 Saving record ballina - 84 Kerr St, Ballina NSW 2478 Saving record ballina - 129 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 78 Hutley Dr, Lennox Head NSW 2478 Saving record ballina - 6 Eider Qd, Ballina NSW 2478 Saving record ballina - 19 Fox St, Ballina NSW 2478 /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record ballina - 31 Green St, Alstonville NSW 2477 Saving record ballina - 30 Pine Ave, East Ballina NSW 2478 Saving record ballina - 1/1 Derribong Pl, Alstonville NSW 2477 Saving record ballina - 19 Hewetsons La, Rous Mill NSW 2477 Saving record ballina - 117 Cherry St, Ballina NSW 2478 Saving record ballina - 8 Oakwood Dr, Ballina NSW 2478 Saving record ballina - 462-470 River St, West Ballina NSW 2478 Saving record ballina - 60 Salt Air Cct, Lennox Head NSW 2478 Saving record ballina - 263 Rous Rd, Rous NSW 2477 Saving record ballina - 9 Cove Ave, Skennars Head NSW 2478 Saving record ballina - 48 Delva Rd, Wollongbar NSW 2477 Saving record ballina - 50 Aureus Bvd, Skennars Head NSW 2478 Saving record ballina - 10 Hyde Park Rd, Wollongbar NSW 2477 Saving record ballina - 27 Phoenix Dr, Tintenbar NSW 2478 Saving record ballina - 265 Hutley Dr, Skennars Head NSW 2478 Saving record ballina - 8 Leach Cr, West Ballina NSW 2478 Saving record ballina - 7 Dune Ave, Skennars Head NSW 2478 Saving record ballina - 1/13 Ascot Rd, Ballina NSW 2478 Saving record ballina - 18 Amber Dr, Lennox Head NSW 2478 Saving record ballina - 5 Allens Pde, Lennox Head NSW 2478 Saving record ballina - 16 Swift St, Ballina NSW 2478 Saving record ballina - 117 Cherry St, Ballina NSW 2478 Saving record ballina - 10 Henry Philp Ave, Ballina NSW 2478 Saving record ballina - 42-46 Commercial Rd, Alstonville NSW 2477 Saving record ballina - 11 Darcey Ave, Cumbalum NSW 2478 Collecting feed data for bega_valley, attempt: 1... Collecting feed data for bogan, attempt: 1... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for broken_hill, attempt: 1... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record broken_hill - 11 Kanandah Rd, Broken Hill NSW 2880 Saving record broken_hill - 26 Allendale St, Broken Hill NSW 2880 Saving record broken_hill - 29 Bonanza St, Broken Hill NSW 2880 Saving record broken_hill - 214 Mercury St, Broken Hill NSW 2880 Saving record broken_hill - 474 Williams Lane, Broken Hill NSW 2880 Saving record broken_hill - 149 Eyre St, Broken Hill NSW 2880 Saving record broken_hill - 14 Lawton St, Broken Hill NSW 2880 Saving record broken_hill - 150 Morish St, Broken Hill NSW 2880 Saving record broken_hill - 121 Murton St, Broken Hill NSW 2880 Saving record broken_hill - 115 Morgan St, Broken Hill NSW 2880 Saving record broken_hill - 182 Williams St, Broken Hill NSW 2880 Saving record broken_hill - 240 Blende St, Broken Hill NSW 2880 Saving record broken_hill - 210 Pell Lane, Broken Hill NSW 2880 Collecting feed data for bundaberg, attempt: 1... Collecting feed data for burwood, attempt: 1... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for byron, attempt: 1... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 1/51 Balemo Drv, Ocean Shores 2483 NSW Saving record byron - 7 Cypress Crt, Byron Bay 2481 NSW Saving record byron - 6/213 Coorabell Rd, Coorabell 2479 NSW Saving record byron - 326 Booyong Rd, Nashua 2479 NSW Saving record byron - 24 Rangal Rd, Ocean Shores 2483 NSW Saving record byron - 14 Oakland Crt, Byron Bay 2481 NSW Saving record byron - 25 Massinger St, Byron Bay 2481 NSW Saving record byron - 276 Picadilly Hill Rd, Coopers Shoot 2481 NSW Saving record byron - 4 Bulgoon Crs, Ocean Shores 2483 NSW Saving record byron - 33 Peter St, South Golden Beach 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 18 Gilba Ave, Ocean Shores 2483 NSW Saving record byron - 5 Raftons Rd, Bangalow 2479 NSW Saving record byron - 416 Goonengerry Rd, Goonengerry 2482 NSW Saving record byron - 16 Short St, Brunswick Heads 2483 NSW Saving record byron - 11 Ruskin St, Byron Bay 2481 NSW Saving record byron - 1/112 Fowlers Ln, Bangalow 2479 NSW Saving record byron - 74 Beech Drv, Suffolk Park 2481 NSW Saving record byron - 12 North Head Rd, New Brighton 2483 NSW Saving record byron - 53 Brownell Drv, Byron Bay 2481 NSW Saving record byron - 41 Matong Drv, Ocean Shores 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 36-38 Byron St, Bangalow 2479 NSW Saving record byron - 25 Staceys Way, Tyagarah 2481 NSW Saving record byron - 79 Lofts Rd, Coorabell 2479 NSW Saving record byron - 21 Alcorn St, Suffolk Park 2481 NSW Saving record byron - 13 Balemo Drv, Ocean Shores 2483 NSW Saving record byron - 13/31 Hayters Drv, Suffolk Park 2481 NSW Saving record byron - 12 Jarrah Crs, Ocean Shores 2483 NSW Saving record byron - 657B Broken Head Rd, Broken Head 2481 NSW Saving record byron - 9 Tin Bin Way, Ocean Shores 2483 NSW Saving record byron - 541 Federal Drv, Federal 2480 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 43 Citriadora Drv, Ewingsdale 2481 NSW Saving record byron - 7 Banksia Drv, Byron Bay 2481 NSW Saving record byron - 116 Jonson St, Byron Bay 2481 NSW Saving record byron - 1/32 New City Rd, Mullumbimby 2482 NSW Saving record byron - 4 Strand Ave, New Brighton 2483 NSW Saving record byron - 22 River St, New Brighton 2483 NSW Saving record byron - 25 Hardy Ave, Ocean Shores 2483 NSW Saving record byron - 71 Bangalow Rd, Byron Bay 2481 NSW Saving record byron - 9 Blue Water Pl, Byron Bay 2481 NSW Saving record byron - 28 Balemo Drv, Ocean Shores 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 9 Kolora Way, Ocean Shores 2483 NSW Saving record byron - 42 Tuckeroo Ave, Mullumbimby 2482 NSW Saving record byron - 5 Whian St, Mullumbimby 2482 NSW Saving record byron - Da Unknown Parcels St, Byron Bay 2481 NSW Saving record byron - 68 Pine Mountain Rd, Possum Creek 2479 NSW Saving record byron - 7 Bannister Crt, Bangalow 2479 NSW Saving record byron - 186 Coopers Shoot Rd, Coopers Shoot 2479 NSW Saving record byron - 33 Goremans Rd, Eureka 2480 NSW Saving record byron - 31 Federal Drv, Eureka 2480 NSW Saving record byron - 24 Kendall St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 44 Carlyle Ln, Byron Bay 2481 NSW Saving record byron - 412 Upper Wilsons Creek Rd, Upper Wilsons Creek 2482 NSW Saving record byron - 2 Jonson St, Byron Bay 2481 NSW Saving record byron - 416 Goonengerry Rd, Goonengerry 2482 NSW Saving record byron - 27 Lucky Ln, Billinudgel 2483 NSW Saving record byron - 4 Jarrah Crs, Ocean Shores 2483 NSW Saving record byron - 5 Shelley Drv, Byron Bay 2481 NSW Saving record byron - 85 Lacebark Ln, Eureka 2480 NSW Saving record byron - 10 Kookaburra Crs, Brunswick Heads 2483 NSW Saving record byron - 18 Palmer Ave, Ocean Shores 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 21 Blackwood Crs, Bangalow 2479 NSW Saving record byron - 144 Bayshore Drv, Byron Bay 2481 NSW Saving record byron - 17 Bay St, Byron Bay 2481 NSW Saving record byron - 36 Wooyung Rd, Wooyung 2483 NSW Saving record byron - 116 Jonson St, Byron Bay 2481 NSW Saving record byron - 2 Coachwood Cl, Byron Bay 2481 NSW Saving record byron - 24 Palm Valley Drv, Byron Bay 2481 NSW Saving record byron - 6 Berrimbillah Crt, Ocean Shores 2483 NSW Saving record byron - 16 Lorikeet Ln, Mullumbimby 2482 NSW Saving record byron - 12 North Head Rd, New Brighton 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 22 Shelley Drv, Byron Bay 2481 NSW Saving record byron - 4 Brownell Drv, Byron Bay 2481 NSW Saving record byron - 20 Kendall St, Byron Bay 2481 NSW Saving record byron - 99 Newes Rd, Coorabell 2479 NSW Saving record byron - 305 Coopers Shoot Rd, Coopers Shoot 2479 NSW Saving record byron - 2B Booyun St, Brunswick Heads 2483 NSW Saving record byron - 530 Lismore Rd, Binna Burra 2479 NSW Saving record byron - 530 Lismore Rd, Binna Burra 2479 NSW Saving record byron - 461 Goonengerry Rd, Montecollum 2482 NSW Saving record byron - 29 Tweed St, Brunswick Heads 2483 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 8 O'Donnells Ln, Billinudgel 2483 NSW Saving record byron - 22 Corkwood Crs, Suffolk Park 2481 NSW Saving record byron - 352 Left Bank Rd, Mullumbimby Creek 2482 NSW Saving record byron - 53 Mcauleys Ln, Myocum 2482 NSW Saving record byron - 421 Kings Rd, Eureka 2480 NSW Saving record byron - 8 Blueberry Crt, Byron Bay 2481 NSW Saving record byron - 713 The Pocket Rd, The Pocket 2483 NSW Saving record byron - 27 Brownell Drv, Byron Bay 2481 NSW Saving record byron - 12/77 Frasers Rd, Mullumbimby Creek 2482 NSW Saving record byron - 29 Shirley St, Byron Bay 2481 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record byron - 36 Keys Rd, Coorabell 2479 NSW Saving record byron - 2/16-18 Marattia Pl, Suffolk Park 2481 NSW Saving record byron - 2 Fletcher Ln, Byron Bay 2481 NSW Saving record byron - 1143 Friday Hut Rd, Binna Burra 2479 NSW Saving record byron - 31 Alidenes Rd, Wilsons Creek 2482 NSW Saving record byron - 6 Woodswallow Way, Mullumbimby 2482 NSW Saving record byron - 409 Coorabell Rd, Coorabell 2479 NSW Saving record byron - 199 Middle Pocket Rd, Middle Pocket 2483 NSW Saving record byron - 41 Kingsley St, Byron Bay 2481 NSW Saving record byron - 464 Friday Hut Rd, Possum Creek 2479 NSW Collecting feed data for cessnock, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 145 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 105 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 1 Triton Blvd, North Rothbury NSW 2335 Saving record cessnock - 242A Averys Lane, Buchanan NSW 2323 Collecting feed data for dubbo, attempt: 1... cessnock: ERROR: Net::ReadTimeout /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record dubbo - 78 River St, Dubbo 2830 NSW Saving record dubbo - 1 Nagle Dr, Dubbo 2830 NSW Saving record dubbo - 10 Tweed Pl, Dubbo 2830 NSW Saving record dubbo - 10 Tweed Pl, Dubbo 2830 NSW Saving record dubbo - 6 Dalton St, Dubbo 2830 NSW Saving record dubbo - 31 Banksia Cres, Dubbo 2830 NSW Saving record dubbo - 2 Boree Dr, Dubbo 2830 NSW Saving record dubbo - Capital Dr, Dubbo 2830 NSW Saving record dubbo - 46 Holmwood Dr, Dubbo 2830 NSW Saving record dubbo - 273R Obley Rd, Wambangalang 2830 NSW Saving record dubbo - 23R Wilfred Smith Dr, Dubbo 2830 NSW Saving record dubbo - 18 Victoria St, Dubbo 2830 NSW Saving record dubbo - 32 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 32 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 7R Burraway Rd, Brocklehurst 2830 NSW Saving record dubbo - 12R Kurrajong Dr, Dubbo 2830 NSW Saving record dubbo - 12R Kurrajong Dr, Dubbo 2830 NSW Saving record dubbo - 15 Purlingbrook Tce, Dubbo 2830 NSW Saving record dubbo - 1 Cavelle Dr, Dubbo 2830 NSW Saving record dubbo - 1 Cavelle Dr, Dubbo 2830 NSW Saving record dubbo - 4 Goulburn St, Dubbo 2830 NSW Saving record dubbo - 7 Sea Cres, Dubbo 2830 NSW Saving record dubbo - 11R Tinks Rd, Dubbo 2830 NSW Saving record dubbo - 16 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 3 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 1 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 11R Tinks Rd, Dubbo 2830 NSW Saving record dubbo - 12 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 27 Yarra Pl, Dubbo 2830 NSW Saving record dubbo - 16 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 154R Obley Rd, Dubbo 2830 NSW Saving record dubbo - 24 Regand Park Bvd, Dubbo 2830 NSW Saving record dubbo - 1 Mortlock Ave, Dubbo 2830 NSW Saving record dubbo - 6 Hindmarsh Esp, Dubbo 2830 NSW Saving record dubbo - 2 Alluvial Ct, Dubbo 2830 NSW Saving record dubbo - 10 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 16 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 57-57A St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 4 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 19 Manchurian Crct, Dubbo 2830 NSW Saving record dubbo - 7 Pebble Beach Dr, Dubbo 2830 NSW Saving record dubbo - 15 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 8 Loch Lomond Wy, Dubbo 2830 NSW Saving record dubbo - 20 John Glenn Pl, Dubbo 2830 NSW Saving record dubbo - 3L Flannel Flower Dr, Dubbo 2830 NSW Saving record dubbo - 6 Loch Lomond Wy, Dubbo 2830 NSW Saving record dubbo - 6 Loch Lomond Wy, Dubbo 2830 NSW Saving record dubbo - 1 Purlingbrook Tce, Dubbo 2830 NSW Saving record dubbo - 44 Cove Crct, Dubbo 2830 NSW Saving record dubbo - 1 Canal Ave, Dubbo 2830 NSW Saving record dubbo - 1 Canal Ave, Dubbo 2830 NSW Saving record dubbo - 6 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 39 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 143 Fitzroy St, Dubbo 2830 NSW Saving record dubbo - 79-91 Talbragar St, Dubbo 2830 NSW Saving record dubbo - 61 Waterway Cres, Dubbo 2830 NSW Saving record dubbo - Keswick Pkwy, Dubbo 2830 NSW Saving record dubbo - 92 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 23 Purvis La, Dubbo 2830 NSW Saving record dubbo - 5 George St, Dubbo 2830 NSW Saving record dubbo - 371 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 71A Tamworth St, Dubbo 2830 NSW Saving record dubbo - 26 Blueridge Dr, Dubbo 2830 NSW Saving record dubbo - 127 Yaruga St, Dubbo 2830 NSW Saving record dubbo - 8L Beni Dr, Dubbo 2830 NSW Saving record dubbo - 4 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 337 Fitzroy St, Dubbo 2830 NSW Saving record dubbo - 23 Meadowbank Dr, Dubbo 2830 NSW Saving record dubbo - 23 Meadowbank Dr, Dubbo 2830 NSW Saving record dubbo - 15 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 101 Lincoln Pky, Dubbo 2830 NSW Saving record dubbo - 5 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 74 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 74 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 39 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 24 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 13 Webber Dr, Dubbo 2830 NSW Saving record dubbo - 13 Webber Dr, Dubbo 2830 NSW Saving record dubbo - 61-63 Wheelers La, Dubbo 2830 NSW Saving record dubbo - 15R Old Gilgandra Rd, Dubbo 2830 NSW Saving record dubbo - 188R Peak Hill Rd, Dubbo 2830 NSW Saving record dubbo - 283 Fitzroy St, Dubbo 2830 NSW Saving record dubbo - 18 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 283 Fitzroy St, Dubbo 2830 NSW Saving record dubbo - 7 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 50R Rosedale Rd, Dubbo 2830 NSW Saving record dubbo - 50R Rosedale Rd, Dubbo 2830 NSW Saving record dubbo - 1 High St, Dubbo 2830 NSW Saving record dubbo - 1 High St, Dubbo 2830 NSW Saving record dubbo - 3/47-59 Wingewarra St, Dubbo 2830 NSW Saving record dubbo - 162 Sheraton Rd, Dubbo 2830 NSW Saving record dubbo - 2 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 7 Malanda Ave, Dubbo 2830 NSW Saving record dubbo - 15 Manchurian Crct, Dubbo 2830 NSW Saving record dubbo - 6L Maiala Rd, Eumungerie 2822 NSW Saving record dubbo - 26R Godwins La, Mogriguy 2830 NSW Saving record dubbo - 33-40 Nanima Cr, Wellington 2820 NSW Saving record dubbo - 16 Murrayfield Dr, Dubbo 2830 NSW Saving record dubbo - 1 Church St, Dubbo 2830 NSW Saving record dubbo - 5L Dunlop Rd, Dubbo 2830 NSW /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 237 East Minalty Rd, Curra Creek 2820 NSW Saving record dubbo - 16 Wollondilly Crct, Dubbo 2830 NSW Saving record dubbo - 54 Sunningdale Cl, Dubbo 2830 NSW Saving record dubbo - 1/2-10 Mountbatten Dr, Dubbo 2830 NSW Saving record dubbo - Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 12R Joira Rd, Dubbo 2830 NSW Saving record dubbo - 5R Desert Star Dr, Dubbo 2830 NSW Saving record dubbo - 3R Numbardie Dr, Dubbo 2830 NSW Saving record dubbo - 16 Malanda Ave, Dubbo 2830 NSW Saving record dubbo - 113-113A Champagne Dr, Dubbo 2830 NSW Saving record dubbo - 10 Lilydale Tce, Dubbo 2830 NSW Saving record dubbo - 24 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 283 Fitzroy St, Dubbo 2830 NSW Saving record dubbo - 125 Torryburn Wy, Dubbo 2830 NSW Saving record dubbo - 125 Torryburn Wy, Dubbo 2830 NSW Saving record dubbo - 18 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 29L Debeaufort Dr, Dubbo 2830 NSW Saving record dubbo - 15 Carnoustie Dr, Dubbo 2830 NSW Saving record dubbo - 4L Thurloo Rd, Dubbo 2830 NSW Saving record dubbo - 29 Tweed Pl, Dubbo 2830 NSW Saving record dubbo - 29 Tweed Pl, Dubbo 2830 NSW Saving record dubbo - 84 Taylor St, Dubbo 2830 NSW Saving record dubbo - 84 Taylor St, Dubbo 2830 NSW Saving record dubbo - 16 Murrayfield Dr, Dubbo 2830 NSW Saving record dubbo - 17 Smith St, Dubbo 2830 NSW Saving record dubbo - 17 Smith St, Dubbo 2830 NSW Saving record dubbo - 3L Mooculta Rd, Dubbo 2830 NSW Saving record dubbo - 104A Gipps St, Dubbo 2830 NSW Saving record dubbo - 7 Acquisition Cl, Dubbo 2830 NSW Saving record dubbo - 5R Desert Star Dr, Dubbo 2830 NSW Saving record dubbo - 21-26 Eucalyptus Dr, Montefiores 2820 NSW Saving record dubbo - 46 Hindmarsh Esp, Dubbo 2830 NSW Saving record dubbo - 101L Bunglegumbie Rd, Dubbo 2830 NSW Saving record dubbo - 534 Wheelers La, Dubbo 2830 NSW Saving record dubbo - 81 Lincoln Pky, Dubbo 2830 NSW Saving record dubbo - 59 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 23L Debeaufort Dr, Dubbo 2830 NSW Saving record dubbo - 2 Violet Crct, Dubbo 2830 NSW Saving record dubbo - 380 Macquarie St, Dubbo 2830 NSW Saving record dubbo - 9 Namoi Cres, Dubbo 2830 NSW Saving record dubbo - 95 Lincoln Pky, Dubbo 2830 NSW Saving record dubbo - 16 Wollondilly Crct, Dubbo 2830 NSW Saving record dubbo - 16 Wollondilly Crct, Dubbo 2830 NSW Saving record dubbo - 59 Nubrigyn St, Euchareena 2866 NSW Saving record dubbo - 141L Obley Rd, Dubbo 2830 NSW Saving record dubbo - 113-113A Champagne Dr, Dubbo 2830 NSW Saving record dubbo - 16 Malanda Ave, Dubbo 2830 NSW Saving record dubbo - 18L Woodstock Rd, Dubbo 2830 NSW Saving record dubbo - 14R Whitewood Rd, Dubbo 2830 NSW Saving record dubbo - 14 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 9 Malanda Ave, Dubbo 2830 NSW Saving record dubbo - 12 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 1 Mortlock Ave, Dubbo 2830 NSW Saving record dubbo - 8 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 8 St Brigids Crct, Dubbo 2830 NSW Saving record dubbo - 3R Richardson Rd, Dubbo 2830 NSW Saving record dubbo - 95R Obley Rd, Dubbo 2830 NSW Saving record dubbo - 4 Strait Ave, Dubbo 2830 NSW Saving record dubbo - 8 Zillie Cl, Dubbo 2830 NSW Saving record dubbo - 1 Cavelle Dr, Dubbo 2830 NSW Saving record dubbo - 126R Minore Rd, Minore 2830 NSW Saving record dubbo - 126R Minore Rd, Minore 2830 NSW Saving record dubbo - 84 Boundary Rd, Dubbo 2830 NSW Saving record dubbo - 1 Howe Pl, Dubbo 2830 NSW Saving record dubbo - 17L Mayfield Rd, Dubbo 2830 NSW Saving record dubbo - 17L Mayfield Rd, Dubbo 2830 NSW Saving record dubbo - 10L Angle Park Rd, Dubbo 2830 NSW Saving record dubbo - 224 Brisbane St, Dubbo 2830 NSW Saving record dubbo - 5545 Burrendong Wy, Stuart Town 2820 NSW Saving record dubbo - 2 Shoreview La, Dubbo 2830 NSW Saving record dubbo - 20 Targa Ave, Dubbo 2830 NSW Saving record dubbo - 22 Commander Ave, Dubbo 2830 NSW Saving record dubbo - 4 Strait Ave, Dubbo 2830 NSW Saving record dubbo - 22 Peel Pl, Dubbo 2830 NSW Saving record dubbo - 20 Targa Ave, Dubbo 2830 NSW Collecting feed data for fairfield, attempt: 1... Collecting feed data for griffith, attempt: 1... fairfield: ERROR: Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=06/03/2026&2=05/04/2026&4a=10&6=F /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for gunnedah, attempt: 1... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gunnedah - 15 Quia Rd, Gunnedah NSW 2380 Saving record gunnedah - 21 Silversmith Pl, Gunnedah NSW 2380 Saving record gunnedah - 2 Pine Hill Rd, Gunnedah NSW 2380 Saving record gunnedah - 27 Forrest Wy, Gunnedah NSW 2380 Saving record gunnedah - 168 George St, Gunnedah NSW 2380 Saving record gunnedah - 88 Stock Rd, Gunnedah NSW 2380 Saving record gunnedah - 175 Barlow Rd, Gunnedah NSW 2380 Saving record gunnedah - 57 Barber St, Gunnedah NSW 2380 Saving record gunnedah - 3 Robert Gordon Rd, Gunnedah NSW 2380 Saving record gunnedah - 79 View St, Gunnedah NSW 2380 Saving record gunnedah - 18-22 Kamilaroi Rd, Gunnedah NSW 2380 Saving record gunnedah - 237 Stock Rd, Gunnedah NSW 2380 Saving record gunnedah - 171 George St, Gunnedah NSW 2380 Collecting feed data for gympie, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record gympie - 10 Henry St, Gympie 4570 QLD Saving record gympie - 10 Henry St, Gympie 4570 QLD Saving record gympie - 46 Johns Rd, Southside 4570 QLD Saving record gympie - 117 Red Gully Rd, Amamoor 4570 QLD Saving record gympie - 34 Birdwood Dr, Gunalda 4570 QLD Saving record gympie - 32 Stringybark Pl, Jones Hill 4570 QLD Saving record gympie - 24 Yeri Dve, Rainbow Beach 4581 QLD Saving record gympie - 4 Dennis Little Dve, Glanmire 4570 QLD Saving record gympie - Kelly Dve, Glanmire 4570 QLD Saving record gympie - 478 Mcintosh Creek Rd, Mcintosh Creek 4570 QLD Saving record gympie - 120 Rawlins Rd, Chatsworth 4570 QLD Saving record gympie - 14 Benian Rd, The Palms 4570 QLD Saving record gympie - 65 Jimbour Rd, The Palms 4570 QLD Saving record gympie - 3 Argus Ct, Cooloola Cove 4580 QLD Saving record gympie - 578 Old Maryborough Rd, Tamaree 4570 QLD Saving record gympie - 1260 Kilkivan Tansey Rd, Tansey 4601 QLD Saving record gympie - 69 Larkin Rd, Pie Creek 4570 QLD Saving record gympie - 228 Fishermans Pocket Rd, Fishermans Pocket 4570 QLD Saving record gympie - 1944 Old Bruce Hwy, Traveston 4570 QLD Saving record gympie - 77 Outlook Rd, Veteran 4570 QLD Saving record gympie - 75 Kajarabie Rd, Lagoon Pocket 4570 QLD Collecting feed data for lismore, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record lismore - 264 Magellan St, Lismore NSW 2480 Saving record lismore - 13 Livotto Dr, Richmond Hill NSW 2480 Saving record lismore - 13 Simeoni Dr, Goonellabah NSW 2480 Saving record lismore - 846 Eltham Rd, Eltham NSW 2480 Saving record lismore - 165 Ballina Rd, East Lismore NSW 2480 Saving record lismore - 10 Parade St, Girards Hill NSW 2480 Saving record lismore - 186 Cameron Rd, Mcleans Ridges NSW 2480 Saving record lismore - 15 Stewarts Way, Nimbin NSW 2480 Saving record lismore - 6 Dunromin Dr, Modanville NSW 2480 Saving record lismore - 15 Somerset Sq, Goonellabah NSW 2480 Saving record lismore - 55 Hillcrest Ave, Goonellabah NSW 2480 Saving record lismore - 487 Boyle Rd, Koonorigan NSW 2480 Saving record lismore - 15 Misty Valley View, Goonellabah NSW 2480 Ignoring unknown value of determination type: nil on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/008.2026.00000012.001 Saving record lismore - 58 Just St, Goonellabah NSW 2480 Saving record lismore - 6 Stewarts Way, Nimbin NSW 2480 Saving record lismore - 87 Dalley St, East Lismore NSW 2480 Saving record lismore - 16 Pinecrest Dr, Goonellabah NSW 2480 Saving record lismore - 384 Caniaba Rd, Caniaba NSW 2480 Saving record lismore - 128 Hunter St, Lismore NSW 2480 Saving record lismore - 63 Just St, Goonellabah NSW 2480 Saving record lismore - 13 Simeoni Dr, Goonellabah NSW 2480 Saving record lismore - 51 Deegan Dr, Goonellabah NSW 2480 Saving record lismore - 747 Ballina Rd, Goonellabah NSW 2480 Saving record lismore - 60A Cullen St, Nimbin NSW 2480 Saving record lismore - 1 Ida Pl, Goonellabah NSW 2480 Saving record lismore - 24 Clarice St, East Lismore NSW 2480 Saving record lismore - 5 Wedgetail Ct, Goonellabah NSW 2480 Saving record lismore - 2 Toohey Rd, Caniaba NSW 2480 Saving record lismore - 5 Roy Pl, Richmond Hill NSW 2480 Saving record lismore - 459 Skyline Rd, Goonellabah NSW 2480 Saving record lismore - 15 Wedgetail Ct, Goonellabah NSW 2480 Saving record lismore - 136 Gundurimba Rd, Monaltrie NSW 2480 Ignoring unknown value of determination type: "Reject-Illegible or Unclear Application" on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/005.2026.00000020.001 Saving record lismore - 2 Toohey Rd, Caniaba NSW 2480 Saving record lismore - 39 Rous Rd, Goonellabah NSW 2480 Ignoring unknown value of determination type: nil on https://tracker.lismore.nsw.gov.au/Application/ApplicationDetails/008.2026.00000010.001 Saving record lismore - 9 Sillar Ave, Goonellabah NSW 2480 Saving record lismore - 4 Weaver St, Lismore NSW 2480 Saving record lismore - 38 Sawyers Ave, Goonellabah NSW 2480 Saving record lismore - 5 Snow St, South Lismore NSW 2480 Collecting feed data for maranoa, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record maranoa - 334 Bassett Lane, Roma 4455 QLD Saving record maranoa - 334 Bassett Lane, Roma 4455 QLD Saving record maranoa - 3 Bottletree Ct, Roma 4455 QLD Saving record maranoa - 33 Bromeliad Cct, Roma 4455 QLD Saving record maranoa - 28 Chadford St, Wallumbilla 4428 QLD Saving record maranoa - 1 Nuss St, Roma 4455 QLD Saving record maranoa - 3 Bottletree Ct, Roma 4455 QLD Saving record maranoa - 305 Mt Saltbush Rd, Roma 4455 QLD Saving record maranoa - Carnarvon Hwy, Injune 4454 QLD Saving record maranoa - 22 Mcdowall St, Roma 4455 QLD Saving record maranoa - Fleming Dr, Roma 4455 QLD Saving record maranoa - Carnarvon Hwy, Injune 4454 QLD Saving record maranoa - Fleming Dr, Roma 4455 QLD Saving record maranoa - 90 Raglan St, Roma 4455 QLD Saving record maranoa - 2 Crawford St, Roma 4455 QLD Saving record maranoa - 33-41 Elmer St, Roma 4455 QLD Saving record maranoa - 21 Highview Cl, Roma 4455 QLD Saving record maranoa - 51 Bertha St, Surat 4417 QLD Saving record maranoa - 1 Appleby Cl, Roma 4455 QLD Saving record maranoa - 27-29 Lovell St, Roma 4455 QLD Saving record maranoa - 1155 Yuleba Taroom Rd, Yuleba North 4427 QLD Saving record maranoa - Industrial Ave, Wellesley 4417 QLD Saving record maranoa - 3L Fleming Dr, Roma 4455 QLD Saving record maranoa - 34 Twine St, Roma 4455 QLD Saving record maranoa - 483C Corfe Rd, Roma 4455 QLD Saving record maranoa - 30 Howard St, Roma 4455 QLD Saving record maranoa - 160 Bourne Dr, Roma 4455 QLD Saving record maranoa - 27-29 Lovell St, Roma 4455 QLD Saving record maranoa - Houston Rd, Wallumbilla 4428 QLD Saving record maranoa - 1-11 Wormwell Dr, Roma 4455 QLD Saving record maranoa - Industrial Ave, Wellesley 4417 QLD Saving record maranoa - 44 Arthur St, Roma 4455 QLD Saving record maranoa - 44 Arthur St, Roma 4455 QLD Saving record maranoa - 121 Arthur St, Roma 4455 QLD Saving record maranoa - Carnarvon Hwy, Injune 4454 QLD Saving record maranoa - 109 Currey St, Roma 4455 QLD Saving record maranoa - 844 Carnarvon Hwy, Orange Hill 4455 QLD Saving record maranoa - 18-24 Hawthorne St, Roma 4455 QLD Saving record maranoa - 291 Donnybrook Rd, Mount Bindango 4455 QLD Saving record maranoa - 24 Tyrconnel St, Mungallala 4467 QLD Collecting feed data for muswellbrook, attempt: 1... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record muswellbrook - 13 Bligh St, Muswellbrook 2333 NSW Saving record muswellbrook - 9-13 Pendula Way, Denman 2328 NSW Saving record muswellbrook - 144 Woodland Ridge Rd, Muscle Creek 2333 NSW Saving record muswellbrook - 16B Grey Gum Rd, Denman 2328 NSW Saving record muswellbrook - 1 Belmore St, Muswellbrook 2333 NSW Saving record muswellbrook - 96 Wollombi Rd, Muswellbrook 2333 NSW Saving record muswellbrook - 3 Foley St, Muswellbrook 2333 NSW Saving record muswellbrook - 18 Kamilaroi St, Muswellbrook 2333 NSW Saving record muswellbrook - 47A Maitland St, Muswellbrook 2333 NSW Saving record muswellbrook - 37 Lou Fisher Pl, Muswellbrook 2333 NSW Saving record muswellbrook - 39 Sunline St, Muswellbrook 2333 NSW Saving record muswellbrook - 6 Shiraz St, Muswellbrook 2333 NSW Saving record muswellbrook - 9 Jackaroo Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 391 Hungerford Rd, Denman 2328 NSW Saving record muswellbrook - 31 Northview Cct, Muswellbrook 2333 NSW Saving record muswellbrook - 172 Grasstree Ridge Row, Muswellbrook 2333 NSW Saving record muswellbrook - 172 Grasstree Ridge Row, Muswellbrook 2333 NSW Saving record muswellbrook - 4 Stable Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 2237 Martindale Rd, Martindale 2328 NSW Saving record muswellbrook - 5 Holdsworth Cr, Muswellbrook 2333 NSW Saving record muswellbrook - 6 Cook St, Muswellbrook 2333 NSW Saving record muswellbrook - 1040 Bureen Rd, Bureen 2328 NSW Saving record muswellbrook - 1559 Golden Hwy, Sandy Hollow 2333 NSW Saving record muswellbrook - 6 Stockyard Pde, Muswellbrook 2333 NSW Saving record muswellbrook - 4 Billabong Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 32 Pretoria Row, Muswellbrook 2333 NSW Saving record muswellbrook - 16 Sheppard Ave, Muswellbrook 2333 NSW Saving record muswellbrook - 63 Babbler Cr, Muscle Creek 2333 NSW Saving record muswellbrook - 1 Shearer's Cl, Muswellbrook 2333 NSW Saving record muswellbrook - 151 Goulburn Dr, Sandy Hollow 2333 NSW Saving record muswellbrook - 33 Stockyard Pde, Muswellbrook 2333 NSW Collecting feed data for port_macquarie_hastings, attempt: 1... Collecting feed data for port_stephens, attempt: 1... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for shoalhaven, attempt: 1... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for singleton, attempt: 1... shoalhaven: ERROR: Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' Collecting feed data for strathfield, attempt: 1... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record strathfield - 5 Drew St, Greenacre 2190 NSW Saving record strathfield - 65-67 Parramatta Rd, Homebush 2140 NSW Saving record strathfield - 11-23 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 43 Pemberton St, Strathfield 2135 NSW Saving record strathfield - 49 Redmyre Rd, Strathfield 2135 NSW Saving record strathfield - 23 Richmond Rd, Homebush West 2140 NSW Saving record strathfield - 5 Boden Ave, Strathfield 2135 NSW Saving record strathfield - 27 Albert Rd, Strathfield 2135 NSW Saving record strathfield - 9 Myrna Rd, Strathfield 2135 NSW Saving record strathfield - 116 Madeline St, Strathfield South 2136 NSW Saving record strathfield - 18 Wallis Ave, Strathfield 2135 NSW Saving record strathfield - 30 Hydebrae St, Strathfield 2135 NSW Saving record strathfield - 10 Sylvanus St, Greenacre 2190 NSW Saving record strathfield - 27 Davidson St, Greenacre 2190 NSW Saving record strathfield - 30 Courallie Ave, Homebush West 2140 NSW Saving record strathfield - 143 The Boulevarde, Strathfield 2135 NSW Saving record strathfield - 8 Chiswick St, Strathfield South 2136 NSW Saving record strathfield - 350-374 Parramatta Rd, Homebush West 2140 NSW Saving record strathfield - 17 Water St, Strathfield South 2136 NSW Saving record strathfield - 76 Burlington Rd, Homebush 2140 NSW Saving record strathfield - 2-8 Henley Rd, Homebush West 2140 NSW Saving record strathfield - 5 Drew St, Greenacre 2190 NSW Saving record strathfield - 17 Patricia St, Strathfield South 2136 NSW Saving record strathfield - 257 Homebush Rd, Strathfield South 2136 NSW Saving record strathfield - 250-318 Parramatta Rd, Homebush 2140 NSW Saving record strathfield - 20 Wentworth St, Greenacre 2190 NSW Saving record strathfield - 8 Chiswick St, Strathfield South 2136 NSW Saving record strathfield - 26 Bridge Rd, Homebush 2140 NSW Saving record strathfield - 76 Burlington Rd, Homebush 2140 NSW Saving record strathfield - 8 Telopea Ave, Strathfield 2135 NSW Saving record strathfield - 1/31 Pomona St, Greenacre 2190 NSW Saving record strathfield - 21 Cave Rd, Strathfield 2135 NSW Saving record strathfield - 350-374 Parramatta Rd, Homebush West 2140 NSW Saving record strathfield - 5 Wakeford Rd, Strathfield 2135 NSW Collecting feed data for upper_hunter, attempt: 1... upper_hunter: ERROR: 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:1012:in `response_redirect' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:325:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:1324:in `post_form' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:537:in `post' /app/lib/masterview_scraper/get_applications_api.rb:45:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:43:in `run' scraper.rb:83:in `<main>' *************************************************** Now retrying authorities which earlier had failures albury, bega_valley, bogan, bundaberg, burwood, cessnock, fairfield, griffith, port_macquarie_hastings, port_stephens, shoalhaven, singleton, upper_hunter *************************************************** Collecting feed data for albury, attempt: 2... Collecting feed data for bega_valley, attempt: 2... albury: ERROR: Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bogan, attempt: 2... bega_valley: ERROR: Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for bundaberg, attempt: 2... bogan: ERROR: Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for burwood, attempt: 2... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for cessnock, attempt: 2... burwood: ERROR: Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Saving record cessnock - 145 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 105 Creekside Pl, Rothbury NSW 2320 Saving record cessnock - 1 Triton Blvd, North Rothbury NSW 2335 Saving record cessnock - 242A Averys Lane, Buchanan NSW 2323 cessnock: ERROR: Net::ReadTimeout Collecting feed data for fairfield, attempt: 2... /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/protocol.rb:209:in `readline' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `catch' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1826:in `request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:948:in `block in request' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:652:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:99:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:78:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:72:in `each' /app/lib/masterview_scraper/get_applications_api.rb:72:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for griffith, attempt: 2... fairfield: ERROR: Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=06/03/2026&2=05/04/2026&4a=10&6=F /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_macquarie_hastings, attempt: 2... griffith: ERROR: Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for port_stephens, attempt: 2... port_macquarie_hastings: ERROR: Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for shoalhaven, attempt: 2... port_stephens: ERROR: Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' shoalhaven: ERROR: Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:160:in `scrape_url' Collecting feed data for singleton, attempt: 2... /app/lib/masterview_scraper.rb:55:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' Collecting feed data for upper_hunter, attempt: 2... singleton: ERROR: Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' upper_hunter: ERROR: 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:1012:in `response_redirect' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:325:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:1324:in `post_form' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:537:in `post' /app/lib/masterview_scraper/get_applications_api.rb:45:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape' scraper.rb:17:in `each' scraper.rb:17:in `scrape' scraper.rb:57:in `run' scraper.rb:83:in `<main>' MORPH_EXPECT_BAD=bogan Scraping Summary: Authority OK Bad Exception -------------------- ------ ------ -------------------------------------------------- albury 0 0 Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] ballina 125 0 - /app/vendor/bundle/ruby/3.2.0/gems/scraper_utils-0.8.2/lib/scraper_utils/log_utils.rb:192:in `report_on_results': ERROR: Unexpected errors in: albury,bega_valley,bundaberg,burwood,cessnock,fairfield,griffith,port_macquarie_hastings,port_stephens,shoalhaven,singleton,upper_hunter (Add to MORPH_EXPECT_BAD?) (RuntimeError) albury: Net::OpenTimeout - Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired) bega_valley 0 0 SocketError - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] bega_valley: SocketError - Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known) bogan 0 0 [EXPECT BAD] SocketError - Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known) [lib/masterview_scraper.rb:85:in `scrape_api_period'] bundaberg: Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response broken_hill 13 0 - burwood: Net::OpenTimeout - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) cessnock: Net::ReadTimeout - Net::ReadTimeout bundaberg 0 0 Mechanize::ResponseCodeError - 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response [lib/masterview_scraper.rb:85:in `scrape_api_period'] fairfield: RuntimeError - Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=06/03/2026&2=05/04/2026&4a=10&6=F burwood 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] byron 100 0 - griffith: Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) cessnock 4 0 Net::ReadTimeout - Net::ReadTimeout [lib/masterview_scraper.rb:99:in `block in scrape_api_period'] port_macquarie_hastings: Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) dubbo 177 0 - port_stephens: Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) shoalhaven: RuntimeError - Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home fairfield 0 0 RuntimeError - Couldn't find table element on https://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=found&1=06/03/2026&2=05/04/2026&4a=10&6=F [lib/masterview_scraper/pages/index.rb:41:in `scrape'] singleton: Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) griffith 0 0 Net::OpenTimeout - Failed to open TCP connection to datracking.griffith.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] gunnedah 13 0 - upper_hunter: Mechanize::ResponseCodeError - 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response gympie 21 0 - See earlier output for details from scraper.rb:67:in `run' lismore 38 0 - from scraper.rb:83:in `<main>' maranoa 40 0 - muswellbrook 31 0 - port_macquarie_hastings 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.pmhc.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] port_stephens 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.portstephens.nsw.gov.au:443 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] shoalhaven 0 0 RuntimeError - Couldn't find table element on https://www.shoalhaven.nsw.gov.au/Home [lib/masterview_scraper/pages/index.rb:41:in `scrape'] singleton 0 0 Net::OpenTimeout - Failed to open TCP connection to datracker.singleton.nsw.gov.au:444 (execution expired) [lib/masterview_scraper.rb:85:in `scrape_api_period'] strathfield 34 0 - upper_hunter 0 0 Mechanize::ResponseCodeError - 404 => Net::HTTPNotFound for https://onlineservices.upperhunter.nsw.gov.au/Application/GetApplications -- unhandled response [lib/masterview_scraper/get_applications_api.rb:45:in `scrape_page']

Data

Downloaded 143 times by dcalde tkrikke chan0415 AndreM101 muzzie86 jamasalbertastash studiology repose-lecture

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (24.4 MB) Use the API

rows 10 / 60835

council_reference address description info_url date_scraped date_received authority_label
10-2021-16-1
2 Angus St, Forbes 2871 NSW
New Garages/Sheds - Industrial
2021-03-16
2021-02-22
forbes
10-2021-15-1
613 Wongajong Rd, Forbes 2871 NSW
New Single Dwelling
2021-03-16
2021-02-18
forbes
10-2021-13-1
1829 Lachlan Valley Wy, Jemalong 2871 NSW
New Single Dwelling
2021-03-16
2021-02-15
forbes
10-2021-14-1
131A Wambat St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-02-16
forbes
10-2017-80-3
33-37 Sam St, Forbes 2871 NSW
New Commercial Building
2021-03-16
2021-03-03
forbes
10-2021-19-1
36A William St, Forbes 2871 NSW
Patio Cover
2021-03-16
2021-03-05
forbes
10-2021-20-1
2 Rae St, Forbes 2871 NSW
New Ancillary Residential Development-Shed/Carport
2021-03-16
2021-03-05
forbes
10-2021-18-1
12 Acacia Ave, Forbes 2871 NSW
New Ancillary Residential Development-Shed
2021-03-16
2021-03-02
forbes
10-2021-17-1
10 Thelma St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-03-02
forbes
10-2021-1-1
Ooma St, Forbes 2871 NSW
Ancillary Residential Development - Awning
2021-03-16
2021-02-25
forbes

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (24.4 MB) Use the API

rows 10 / 1426

run_at attempt authority_label records_saved unprocessable_records status error_message error_class error_backtrace
2026-03-06T08:24:52+00:00
1
albury
0
0
failed
Failed to open TCP connection to eservice.alburycity.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2026-03-06T08:24:52+00:00
1
ballina
132
0
successful
2026-03-06T08:24:52+00:00
1
bega_valley
0
0
failed
Failed to open TCP connection to datracker.begavalley.nsw.gov.au:443 (getaddrinfo: Name or service not known)
SocketError
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2026-03-06T08:24:52+00:00
1
bogan
0
0
failed
Failed to open TCP connection to datracker.bogan.nsw.gov.au:81 (getaddrinfo: Name or service not known)
SocketError
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2026-03-06T08:24:52+00:00
1
broken_hill
17
0
successful
2026-03-06T08:24:52+00:00
1
bundaberg
0
0
failed
403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2026-03-06T08:24:52+00:00
1
burwood
0
0
failed
Failed to open TCP connection to datracker.burwood.nsw.gov.au:443 (execution expired)
Net::OpenTimeout
/app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/lib/masterview_scraper.rb:85:in `scrape_api_period' /app/lib/masterview_scraper.rb:45:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:21:in `block in scrape'
2026-03-06T08:24:52+00:00
1
byron
99
0
successful
2026-03-06T08:24:52+00:00
1
cessnock
283
0
successful
2026-03-06T08:24:52+00:00
1
dubbo
190
0
successful

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (24.4 MB) Use the API

rows 10 / 62

run_at attempt duration successful failed interrupted successful_count interrupted_count failed_count public_ip
2026-03-06T08:24:52+00:00
1
2235.8
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-06T09:02:08+00:00
2
362.8
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-07T00:42:51+00:00
1
2218.3
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-07T01:19:49+00:00
2
362.6
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-08T09:48:17+00:00
1
2002.2
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-08T10:21:40+00:00
2
362.5
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-09T03:19:24+00:00
1
1645.0
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
shoalhaven
12
1
10
2026-03-09T03:46:49+00:00
2
925.9
ballina,broken_hill,byron,cessnock,dubbo,fairfield,gunnedah,gympie,lismore,maranoa,muswellbrook,shoalhaven,strathfield
albury,bega_valley,bogan,bundaberg,burwood,griffith,port_macquarie_hastings,port_stephens,singleton,upper_hunter
13
0
10
2026-03-10T09:20:01+00:00
1
2621.0
ballina,broken_hill,byron,cessnock,gunnedah,gympie,lismore,maranoa,muswellbrook,strathfield
albury,bega_valley,bogan,bundaberg,burwood,dubbo,fairfield,griffith,port_macquarie_hastings,port_stephens,shoalhaven,singleton,upper_hunter
10
0
13
2026-03-10T10:03:42+00:00
2
368.5
ballina,broken_hill,byron,cessnock,gunnedah,gympie,lismore,maranoa,muswellbrook,strathfield
albury,bega_valley,bogan,bundaberg,burwood,dubbo,fairfield,griffith,port_macquarie_hastings,port_stephens,shoalhaven,singleton,upper_hunter
10
0
13

Statistics

Average successful run time: about 7 hours

Total run time: 2 months

Total cpu time used: about 5 hours

Total disk space used: 147 MB

History

  • Auto ran revision 2b320e6e and failed .
    634 records added, 633 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    951 records added, 951 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    997 records added, 956 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    1035 records added, 1025 records removed in the database
  • Auto ran revision 2b320e6e and failed .
    1025 records added, 985 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_masterview / scraper.rb