ianheggie-oaf / multiple_civica-prs
Test All civica pull requests
This is a scraper that runs on Morph. To get started see the documentation
To run the scraper
bundle exec ruby scraper.rb
To run the tests
bundle exec rake
To run style and coding checks
bundle exec rubocop
Last run failed
with status code 1.
Console output of last run
Injecting configuration and compiling...
Injecting scraper and running...
Scraping authorities: bunbury, burwood, camden, cairns, dorset, lane_cove, nambucca, orange, vincent, wanneroo, whittlesea, woollahra
Collecting feed data for bunbury, attempt: 1...
Saving record bunbury - 3 Ann Way SOUTH BUNBURY WA 6230
Saving record bunbury - 11 Austral Parade EAST BUNBURY WA 6230
Saving record bunbury - 49 Austral Parade EAST BUNBURY WA 6230
Saving record bunbury - Unit 2 14A Birch Street SOUTH BUNBURY WA 6230
Saving record bunbury - 60 Blair Street BUNBURY WA 6230
Saving record bunbury - Boyanup-Picton Road PICTON WA 6229
Saving record bunbury - 6 Burt Street EAST BUNBURY WA 6230
Saving record bunbury - 10 Burt Street EAST BUNBURY WA 6230
Saving record bunbury - 270 Bussell Highway SOUTH BUNBURY WA 6230
Saving record bunbury - 14 Clare Row COLLEGE GROVE WA 6230
Saving record bunbury - 8 Darwin Way COLLEGE GROVE WA 6230
Saving record bunbury - 33 Denning Road EAST BUNBURY WA 6230
Saving record bunbury - 13 Ednie Street BUNBURY WA 6230
Saving record bunbury - 24 Farnell Street SOUTH BUNBURY WA 6230
Saving record bunbury - Forrest Highway GLEN IRIS WA 6230
Saving record bunbury - 25 Gibbons Road DAVENPORT WA 6230
Saving record bunbury - Harris Road PICTON WA 6229
Saving record bunbury - 15 Holywell Street SOUTH BUNBURY WA 6230
Saving record bunbury - 70 Hudson Road WITHERS WA 6230
Saving record bunbury - 43 Kurrajong Circle GLEN IRIS WA 6230
Saving record bunbury - 27 Lantana Lane GLEN IRIS WA 6230
Saving record bunbury - 10 Liam Street USHER WA 6230
Saving record bunbury - 48 Lingard Loop USHER WA 6230
Saving record bunbury - 53 Lingard Loop USHER WA 6230
Saving record bunbury - 19 Lockwood Crescent WITHERS WA 6230
Saving record bunbury - 11 Lockyer Place USHER WA 6230
Saving record bunbury - 7 Lumper Street BUNBURY WA 6230
Saving record bunbury - 8 Magdalen Place COLLEGE GROVE WA 6230
Saving record bunbury - 45 Mangles Street SOUTH BUNBURY WA 6230
Saving record bunbury - Unit 3 31 Marlston Drive BUNBURY WA 6230
Saving record bunbury - 59 Mary Street SOUTH BUNBURY WA 6230
Saving record bunbury - 4 Merton Avenue COLLEGE GROVE WA 6230
Saving record bunbury - 13 Mindalong Close SOUTH BUNBURY WA 6230
Saving record bunbury - 26 Mindalong Close SOUTH BUNBURY WA 6230
Saving record bunbury - 30 Mindalong Close SOUTH BUNBURY WA 6230
Saving record bunbury - Unit 3 70 Minninup Road SOUTH BUNBURY WA 6230
Saving record bunbury - 81 Minninup Road SOUTH BUNBURY WA 6230
Saving record bunbury - 1 Monoghan Place SOUTH BUNBURY WA 6230
Saving record bunbury - 25 Montgomery Road SOUTH BUNBURY WA 6230
Saving record bunbury - 14 Norrie Street SOUTH BUNBURY WA 6230
Saving record bunbury - 306 Ocean Drive WITHERS WA 6230
Saving record bunbury - 1 Parry Street SOUTH BUNBURY WA 6230
Saving record bunbury - 25 Prinsep Street BUNBURY WA 6230
Saving record bunbury - 25 Queensbury Street SOUTH BUNBURY WA 6230
Saving record bunbury - 60 Sandridge Road EAST BUNBURY WA 6230
Saving record bunbury - South Western Highway DAVENPORT WA 6230
Saving record bunbury - Unit 4 126 South Western Highway GLEN IRIS WA 6230
Saving record bunbury - Unit 4 126 South Western Highway GLEN IRIS WA 6230
Saving record bunbury - 132 South Western Highway GLEN IRIS WA 6230
Saving record bunbury - Unit 1 138 Spencer Street SOUTH BUNBURY WA 6230
Saving record bunbury - 228 Spencer Street SOUTH BUNBURY WA 6230
Saving record bunbury - 15 Stallard Place WITHERS WA 6230
Saving record bunbury - 6 Stockley Road BUNBURY WA 6230
Saving record bunbury - 42 Strickland Street BUNBURY WA 6230
Saving record bunbury - Unit 110 146 Strickland Street EAST BUNBURY WA 6230
Saving record bunbury - 63 Sweeny Street CAREY PARK WA 6230
Saving record bunbury - 10 Tilley Crescent EAST BUNBURY WA 6230
Saving record bunbury - 79 Victoria Street BUNBURY WA 6230
Saving record bunbury - 39 Westwood Street WITHERS WA 6230
Saving record bunbury - 20 Willis Cove PELICAN POINT WA 6230
Saving record bunbury - Wimbledon Way WITHERS WA 6230
Saving record bunbury - 19 Wisbey Street CAREY PARK WA 6230
Collecting feed data for burwood, attempt: 1...
Collecting feed data for camden, attempt: 1...
burwood: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:41:in `run'
scraper.rb:78:in `<main>'
Saving record camden - 21 Abercrombie Place HARRINGTON PARK NSW 2567
Saving record camden - 6 Albert Street ORAN PARK NSW 2570
Saving record camden - 21 Allambie Circuit ORAN PARK NSW 2570
Saving record camden - 3 Angus Close SMEATON GRANGE NSW 2567
Saving record camden - 81 Ballandean Boulevard GLEDSWOOD HILLS NSW 2557
Saving record camden - 84 Ballandean Boulevard GLEDSWOOD HILLS NSW 2557
Saving record camden - 104 Ballandean Boulevard GLEDSWOOD HILLS NSW 2557
Saving record camden - 27 Barrow Road SPRING FARM NSW 2570
Saving record camden - 78 Brabham Drive ORAN PARK NSW 2570
Saving record camden - 97 Brabham Drive ORAN PARK NSW 2570
Saving record camden - 2 Bruchhauser Crescent ELDERSLIE NSW 2570
Saving record camden - 2 Brunsdon Road COBBITTY NSW 2570
Saving record camden - 2 Brunsdon Road COBBITTY NSW 2570
Saving record camden - 6 Burke Street ORAN PARK NSW 2570
Saving record camden - 890 Camden Valley Way GLEDSWOOD HILLS NSW 2557
Saving record camden - 21 Centennial Lane ELLIS LANE NSW 2570
Saving record camden - 62 Central Avenue ORAN PARK NSW 2570
Saving record camden - 92 Cobbitty Road COBBITTY NSW 2570
Saving record camden - 531B Cobbitty Road COBBITTY NSW 2570
Saving record camden - 665 Cobbitty Road COBBITTY NSW 2570
Saving record camden - 12 Courtney Loop ORAN PARK NSW 2570
Saving record camden - 12 Digitaria Drive GLEDSWOOD HILLS NSW 2557
Saving record camden - 93 Eastwood Road LEPPINGTON NSW 2179
Saving record camden - 62 Emerald Hills Boulevard LEPPINGTON NSW 2179
Saving record camden - 45 Ewing Loop ORAN PARK NSW 2570
Saving record camden - 7 Ferruccio Street ORAN PARK NSW 2570
Saving record camden - 33 Ferruccio Street ORAN PARK NSW 2570
Saving record camden - 2-6 Freshwater Drive COBBITTY NSW 2570
Saving record camden - 82 Fuzzweed Road LEPPINGTON NSW 2179
Saving record camden - 24 Giovanni Street ORAN PARK NSW 2570
Saving record camden - 15 Grebe Circuit ORAN PARK NSW 2570
Saving record camden - 21 Grebe Circuit ORAN PARK NSW 2570
Saving record camden - 39 Grebe Circuit ORAN PARK NSW 2570
Saving record camden - 48 Grebe Circuit ORAN PARK NSW 2570
Saving record camden - 23 Hawthorne Circuit HARRINGTON PARK NSW 2567
Saving record camden - 15 Heartfruit Avenue COBBITTY NSW 2570
Saving record camden - 137 Heath Road LEPPINGTON NSW 2179
Saving record camden - 99 Hirsch Street LEPPINGTON NSW 2179
Saving record camden - 35 Ingleburn Road LEPPINGTON NSW 2179
Saving record camden - 167 Ingleburn Road LEPPINGTON NSW 2179
Saving record camden - 175 Ingleburn Road LEPPINGTON NSW 2179
Saving record camden - 175 Ingleburn Road LEPPINGTON NSW 2179
Saving record camden - 56 Longview Road GLEDSWOOD HILLS NSW 2557
Saving record camden - 156 Macarthur Road SPRING FARM NSW 2570
Saving record camden - GALVIN COTTAGE
Saving record camden - 37A Neilson Street ORAN PARK NSW 2570
Saving record camden - 95 Old Hume Highway CAMDEN NSW 2570
Saving record camden - 40-46 Oxley Street CAMDEN NSW 2570
Saving record camden - 11 Pandora Street GREGORY HILLS NSW 2557
Saving record camden - 41 Robinson Road BRINGELLY NSW 2556
Saving record camden - 49 Rodeo Road GREGORY HILLS NSW 2557
Saving record camden - 6 Sharp Street ORAN PARK NSW 2570
Saving record camden - 3 Solar Street LEPPINGTON NSW 2179
Saving record camden - 47 Standish Avenue GREGORY HILLS NSW 2557
Saving record camden - 5A-5B Sultana Avenue LEPPINGTON NSW 2179
Saving record camden - 975 The Northern Road BRINGELLY NSW 2556
Saving record camden - 13 Ulmarra Avenue CAMDEN SOUTH NSW 2570
Saving record camden - 12 Universe Street LEPPINGTON NSW 2565
Saving record camden - 16 Universe Street LEPPINGTON NSW 2565
Saving record camden - 118 Wainwright Drive COBBITTY NSW 2570
Saving record camden - 90 Westbrook Road BICKLEY VALE NSW 2570
Saving record camden - 2 White Cliffs Avenue GREGORY HILLS NSW 2557
Saving record camden - 21 Yewens Circuit GRASMERE NSW 2570
Collecting feed data for cairns, attempt: 1...
Saving record cairns - 200L Allamanda Rise BRINSMEAD QLD 4870
Saving record cairns - 6B Bramp Close PORTSMITH QLD 4870
Saving record cairns - Bruce Highway GORDONVALE QLD 4865
Saving record cairns - 50-54 Canopy's Edge Boulevard SMITHFIELD QLD 4878
Saving record cairns - Captain Cook Highway KEWARRA BEACH QLD 4879
Saving record cairns - 57-59 Cascades Drive REDLYNCH QLD 4870
Saving record cairns - 12 Corcoran Street GORDONVALE QLD 4865
Saving record cairns - 710-714 Des Chalmers Drive WOREE QLD 4868
Saving record cairns - 46L Draper Road GORDONVALE QLD 4865
Saving record cairns - 46L Draper Road GORDONVALE QLD 4865
Saving record cairns - Fairweather Access GOLDSBOROUGH QLD 4865
Saving record cairns - 109-111 Fig Tree Drive CARAVONICA QLD 4878
Saving record cairns - 1 Fleming Street EDGE HILL QLD 4870
Saving record cairns - 16-18 Fretwell Road WHITE ROCK QLD 4868
Saving record cairns - 23 George Street EARLVILLE QLD 4870
Saving record cairns - 50 Gloucester Street WHITFIELD QLD 4870
Saving record cairns - 197R Gray Road GREEN HILL QLD 4865
Saving record cairns - 63 Harbour Drive TRINITY PARK QLD 4879
Saving record cairns - 111-113 Harvey Road REDLYNCH QLD 4870
Saving record cairns - 110 Irene Street MOOROOBOOL QLD 4870
Saving record cairns - 11 Knott Court WHITFIELD QLD 4870
Saving record cairns - 230A-238 Lake Street CAIRNS NORTH QLD 4870
Saving record cairns - Maher Road GORDONVALE QLD 4865
Saving record cairns - 209R-211R Maitland Road GORDONVALE QLD 4865
Saving record cairns - 29 Martin Street FRESHWATER QLD 4870
Saving record cairns - 30 Martyn Street PARRAMATTA PARK QLD 4870
Saving record cairns - 5 Michaelangelo Drive REDLYNCH QLD 4870
Saving record cairns - 267 Mulgrave Road BUNGALOW QLD 4870
Saving record cairns - 226 Mulgrave Road WESTCOURT QLD 4870
Saving record cairns - 312-316 Mulgrave Road WESTCOURT QLD 4870
Saving record cairns - 173 Munro Street BABINDA QLD 4861
Saving record cairns - 61R Nebbia Access GREEN HILL QLD 4865
Saving record cairns - O'Hara Street EARLVILLE QLD 4870
Saving record cairns - 119A Old Smithfield Road FRESHWATER QLD 4870
Saving record cairns - 38 Parry Street BABINDA QLD 4861
Saving record cairns - Poolwood Road KEWARRA BEACH QLD 4879
Saving record cairns - 13 Redlynch Intake Road REDLYNCH QLD 4870
Saving record cairns - 15 Rennel Close MOUNT SHERIDAN QLD 4868
Saving record cairns - 34-36 Runnymede Avenue REDLYNCH QLD 4870
Saving record cairns - 34 Rutherford Street CAIRNS NORTH QLD 4870
Saving record cairns - 5-7 Short Street REDLYNCH QLD 4870
Saving record cairns - 7 Sicilian Avenue GORDONVALE QLD 4865
Saving record cairns - 34 Sunbird Drive WOREE QLD 4868
Saving record cairns - Unit 26 7 Tari Place TRINITY BEACH QLD 4879
Saving record cairns - 23 Timberlea Drive BENTLEY PARK QLD 4869
Saving record cairns - 7 Woodlands Avenue EDGE HILL QLD 4870
Collecting feed data for dorset, attempt: 1...
Collecting feed data for lane_cove, attempt: 1...
dorset: ERROR: Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238
/app/lib/civica_scraper/page/search.rb:10:in `period'
/app/lib/civica_scraper.rb:63:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:41:in `run'
scraper.rb:78:in `<main>'
Saving record lane_cove - 26 Barwon Road LANE COVE WEST NSW 2066 (Lot: A DP: 354355)
Saving record lane_cove - 13 Delta Road LANE COVE NSW 2066 (Lot: 5 DP: 224455)
Saving record lane_cove - 31 Finlayson Street LANE COVE NSW 2066 (Lot: 1182 DP: 620451)
Saving record lane_cove - 82 Greenwich Road GREENWICH NSW 2065 (Lot: B DP: 336699)
Saving record lane_cove - 2 Karingal Road RIVERVIEW NSW 2066 (Lot: 2 DP: 214585)
Saving record lane_cove - 14 Marshall Avenue ST LEONARDS NSW 2065 (Lot: 2 Sec: 2 DP: 7259)
Saving record lane_cove - 5 Nundah Street LANE COVE NORTH NSW 2066 (Lot: 30 DP: 10302)
Saving record lane_cove - 536 Pacific Highway ST LEONARDS NSW 2065 (Lot: D DP: 377423)
Saving record lane_cove - 3 Panorama Road LANE COVE NSW 2066 (Lot: 12 DP: 19003)
Saving record lane_cove - 44 Parklands Avenue LANE COVE NORTH NSW 2066 (Lot: 4 Sec: 7 DP: 7817)
Saving record lane_cove - 47A Penrose Street LANE COVE WEST NSW 2066 (Lot: 10 DP: 574013)
Saving record lane_cove - 13 Sirius Road LANE COVE WEST NSW 2066 (Lot: 12 DP: 567279)
Saving record lane_cove - 85 Tambourine Bay Road RIVERVIEW NSW 2066 (Lot: 12A DP: 416213)
Collecting feed data for nambucca, attempt: 1...
Collecting feed data for orange, attempt: 1...
nambucca: ERROR: 500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:41:in `run'
scraper.rb:78:in `<main>'
Collecting feed data for vincent, attempt: 1...
orange: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:41:in `run'
scraper.rb:78:in `<main>'
Saving record vincent - 91B Anzac Road MOUNT HAWTHORN WA 6016 (LOT: 1 STR: 20860)
Saving record vincent - Unit 15 3 Brentham Street LEEDERVILLE WA 6007 (LOT: 15 STR: 19237)
Saving record vincent - 202 Bulwer Street PERTH WA 6000 (LOT: 3 D/P: 580)
Saving record vincent - 385A Charles Street NORTH PERTH WA 6006 (LOT: 2 STR: 30344)
Saving record vincent - 19 Commonwealth Avenue NORTH PERTH WA 6006 (LOT: 33 D/P: 2440)
Saving record vincent - 19 Commonwealth Avenue NORTH PERTH WA 6006 (LOT: 33 D/P: 2440)
Saving record vincent - 4 Faraday Street MOUNT HAWTHORN WA 6016 (LOT: 38 D/P: 2878)
Saving record vincent - 36 Farmer Street NORTH PERTH WA 6006 (LOT: 8 D/P: 1306)
Saving record vincent - 459 Fitzgerald Street NORTH PERTH WA 6006 (LOT: 8 D/P: 1647)
Saving record vincent - 500 Fitzgerald Street NORTH PERTH WA 6006 (LOT: 41 D/P: 418433)
Saving record vincent - 96 Forrest Street NORTH PERTH WA 6006 (LOT: 126 D/P: 2355)
Saving record vincent - 114 Forrest Street NORTH PERTH WA 6006 (LOT: 120 D/P: 2355)
Saving record vincent - 149 Grosvenor Road NORTH PERTH WA 6006 (LOT: 732 D/P: 89747)
Saving record vincent - 36 Hobart Street NORTH PERTH WA 6006 (LOT: 3 D/P: 7583)
Saving record vincent - 5-11 Howlett Street NORTH PERTH WA 6006 (LOT: 50 D/P: 58337)
Saving record vincent - 32 Kalgoorlie Street MOUNT HAWTHORN WA 6016 (LOT: 13 D/P: 1659)
Saving record vincent - 9 Lindsay Street PERTH WA 6000 (LOT: 2 STR: 60186)
Saving record vincent - 301-307 Lord Street HIGHGATE WA 6003 (LOT: 1 D/P: 414)
Saving record vincent - 30 Money Street PERTH WA 6000 (LOT: 2 STR: 29001)
Saving record vincent - 18 Norfolk Street MOUNT LAWLEY WA 6050 (LOT: 172 D/P: 1237)
Saving record vincent - 364-366 Oxford Street LEEDERVILLE WA 6007 (LOT: 95 D/P: 44364)
Saving record vincent - 16 Rae Street LEEDERVILLE WA 6007 (LOT: 35 D/P: 1230)
Saving record vincent - 9 Roy Street MOUNT LAWLEY WA 6050 (LOT: 2 STR: 87297)
Saving record vincent - 24 Ruby Street NORTH PERTH WA 6006 (LOT: 88 D/P: 3002)
Saving record vincent - 69 Smith Street HIGHGATE WA 6003 (LOT: 2 D/P: 2273)
Saving record vincent - 11 St Albans Avenue HIGHGATE WA 6003 (LOT: 1 STR: 48405)
Saving record vincent - Unit 27 290 Stirling Street PERTH WA 6000 (LOT: 27 STR: 12821)
Saving record vincent - 188 Vincent Street NORTH PERTH WA 6006 (LOT: 1 D/P: 33790)
Saving record vincent - 427 Walcott Street COOLBINIA WA 6050 (LOT: 1 STR: 85530)
Saving record vincent - 141 West Parade MOUNT LAWLEY WA 6050 (LOT: 139 D/P: 1197)
Saving record vincent - 7 Windich Place LEEDERVILLE WA 6007 (LOT: 4 STR: 12446)
Saving record vincent - 23 Woodville Street NORTH PERTH WA 6006 (LOT: 15 D/P: 1823)
Collecting feed data for wanneroo, attempt: 1...
Collecting feed data for whittlesea, attempt: 1...
wanneroo: ERROR: 500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:41:in `run'
scraper.rb:78:in `<main>'
whittlesea: ERROR: execution expired
Collecting feed data for woollahra, attempt: 1...
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start'
/app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start'
/app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for'
/app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:41:in `run'
scraper.rb:78:in `<main>'
Saving record woollahra - 5 Belah Gardens VAUCLUSE NSW 2030 (LOT: 2 DP: 1098241)
Saving record woollahra - Unit 1 1-3 Buller Street BELLEVUE HILL NSW 2023 (LOT: 1 SP: 3283)
Saving record woollahra - 25 Cambridge Street PADDINGTON NSW 2021 (LOT: 11 DP: 789842)
Saving record woollahra - 41 Carlotta Road DOUBLE BAY NSW 2028 (LOT: 28 DP: 9421)
Saving record woollahra - 9 Chamberlain Avenue ROSE BAY NSW 2029 (LOT: 20 SEC: E DP: 6298)
Saving record woollahra - 52 Cranbrook Road BELLEVUE HILL NSW 2023 (LOT: 2 DP: 317841)
Saving record woollahra - 23 Dudley Street PADDINGTON NSW 2021 (LOT: 1 DP: 440175)
Saving record woollahra - 30 Edgecliff Road WOOLLAHRA NSW 2025 (LOT: 9 DP: 34035)
Saving record woollahra - 5 Fairfax Road BELLEVUE HILL NSW 2023 (LOT: A DP: 315606)
Saving record woollahra - 32 Gosbell Street PADDINGTON NSW 2021 (LOT: B DP: 436714)
Saving record woollahra - 28 Hamilton Street ROSE BAY NSW 2029 (LOT: A DP: 321385)
Saving record woollahra - 21 Kambala Road BELLEVUE HILL NSW 2023 (LOT: 11 DP: 70355)
Saving record woollahra - 32 Manning Road DOUBLE BAY NSW 2028 (LOT: A DP: 102399)
Saving record woollahra - 377-383 New South Head Road DOUBLE BAY NSW 2028 (LOT: 1 DP: 555654)
Saving record woollahra - 627 New South Head Road ROSE BAY NSW 2029 (LOT: 2 DP: 317323)
Saving record woollahra - 89-93 O'Sullivan Road BELLEVUE HILL NSW 2023 (LOT: 1 DP: 319539)
Saving record woollahra - 48 Oxford Street WOOLLAHRA NSW 2025 (LOT: 10 SEC: 1 DP: 979268)
Saving record woollahra - 2 Petrarch Avenue VAUCLUSE NSW 2030 (LOT: G DP: 368774)
Saving record woollahra - 22 Saber Street WOOLLAHRA NSW 2025 (LOT: 1 DP: 977376)
Saving record woollahra - 10 Serpentine Parade VAUCLUSE NSW 2030 (LOT: 61 DP: 837150)
Saving record woollahra - 36 Suffolk Street PADDINGTON NSW 2021 (LOT: A DP: 107118)
Saving record woollahra - 35 Suttie Road BELLEVUE HILL NSW 2023 (LOT: 5 SEC: 3 DP: 13285)
Saving record woollahra - Unit 15B 23 Thornton Street DARLING POINT NSW 2027 (LOT: 34 SP: 3686)
Saving record woollahra - 43 Towns Road VAUCLUSE NSW 2030 (LOT: 2 DP: 540266)
Saving record woollahra - 18 Weeroona Avenue WOOLLAHRA NSW 2025 (LOT: 8 DP: 237603)
Saving record woollahra - 1 Wellington Street WOOLLAHRA NSW 2025 (LOT: 1 DP: 83328)
Saving record woollahra - 12 Wentworth Street POINT PIPER NSW 2027 (LOT: 1 DP: 545877)
***************************************************
Now retrying authorities which earlier had failures
burwood, dorset, nambucca, orange, wanneroo, whittlesea
***************************************************
Collecting feed data for burwood, attempt: 2...
Collecting feed data for dorset, attempt: 2...
burwood: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:57:in `run'
scraper.rb:78:in `<main>'
Collecting feed data for nambucca, attempt: 2...
dorset: ERROR: Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238
/app/lib/civica_scraper/page/search.rb:10:in `period'
/app/lib/civica_scraper.rb:63:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:57:in `run'
scraper.rb:78:in `<main>'
Collecting feed data for orange, attempt: 2...
nambucca: ERROR: 500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:57:in `run'
scraper.rb:78:in `<main>'
Collecting feed data for wanneroo, attempt: 2...
orange: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:57:in `run'
scraper.rb:78:in `<main>'
Collecting feed data for whittlesea, attempt: 2...
wanneroo: ERROR: 500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:57:in `run'
scraper.rb:78:in `<main>'
whittlesea: ERROR: execution expired
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start'
/app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start'
/app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start'
/app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for'
/app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
scraper.rb:57:in `run'
scraper.rb:78:in `<main>'
MORPH_EXPECT_BAD=dorset,nambucca,orange,wanneroo,whittlesea
Scraping Summary:
Authority OK Bad Exception
-------------------- ------ ------ --------------------------------------------------
/app/vendor/bundle/ruby/2.5.0/gems/scraper_utils-0.7.2/lib/scraper_utils/log_utils.rb:159:in `report_on_results': ERROR: Unexpected errors in: burwood (Add to MORPH_EXPECT_BAD?) (RuntimeError)
bunbury 62 0 -
burwood 0 0 Mechanize::ResponseCodeError - 500 => Net::HTTPInternalServerError for
camden 63 0 -
burwood: Mechanize::ResponseCodeError - 500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response
cairns 46 0 -
See earlier output for details
from scraper.rb:68:in `run'
from scraper.rb:78:in `<main>'
dorset 0 0 [EXPECT BAD] RuntimeError - Couldn't find form daEnquiryForm for perio
lane_cove 13 0 -
nambucca 0 0 [EXPECT BAD] Mechanize::ResponseCodeError - 500 => Net::HTTPInternalSe
orange 0 0 [EXPECT BAD] Mechanize::ResponseCodeError - 500 => Net::HTTPInternalSe
vincent 32 0 -
wanneroo 0 0 [EXPECT BAD] Mechanize::ResponseCodeError - 500 => Net::HTTPInternalSe
whittlesea 0 0 [EXPECT BAD] Net::OpenTimeout - execution expired
woollahra 27 0 -
Data
Downloaded
5610 times
by
To download data sign in with GitHub
rows 10 / 1087
| council_reference | address | description | info_url | date_received | date_scraped | authority_label | on_notice_from | on_notice_to |
|---|---|---|---|---|---|---|---|---|
|
2025/129/1
|
3 Crest Road GLEDSWOOD HILLS NSW 2557
|
Construction of an inground fiberglass swimming pool.
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
|
2025/122/1
|
15 Epsom Street SPRING FARM NSW 2570
|
Inground Fibreglass Pool
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
|
2025/127/1
|
33 Meridian Street LEPPINGTON NSW 2179
|
Construction of a two storey dwelling and associated site works.
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
|
2021/1697/8
|
96 Rickard Road LEPPINGTON NSW 2179
|
Section 4.55 modification to an approved mixed use development to increase the height of the signage for the McDonalds restaurant
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
|
2025/123/1
|
70 Southwell Road ORAN PARK NSW 2570
|
Change of use and fit out of an existing unit to a gym facility - Unit 5
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
|
2025/128/1
|
21 Templeton Road ELDERSLIE NSW 2570
|
Demolition of an existing dwelling and construction of a two storey dwelling
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
|
13336/2025
|
21-25 Atherton Street YORKEYS KNOB QLD 4878
|
Operational Works Civil Works
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
|
|
13342/2025
|
Catalano Access GOLDSBOROUGH QLD 4865
|
Material Change of Use Dwelling House
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
|
|
13344/2025
|
Catalano Access GOLDSBOROUGH QLD 4865
|
Operational Works Major Earthworks
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
|
|
13339/2025
|
67 Del Manso Crescent EDMONTON QLD 4869
|
EXPRESS Material Change of Use Dual Occupancy
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
To download data sign in with GitHub
rows 10 / 744
| run_at | attempt | authority_label | records_saved | unprocessable_records | status | error_message | error_class | error_backtrace |
|---|---|---|---|---|---|---|---|---|
|
2025-05-23T20:31:18+00:00
|
1
|
bunbury
|
104
|
0
|
successful
|
|
|
|
|
2025-05-23T20:31:18+00:00
|
1
|
burwood
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
|
2025-05-23T20:31:18+00:00
|
1
|
camden
|
80
|
0
|
successful
|
|
|
|
|
2025-05-23T20:31:18+00:00
|
1
|
cairns
|
56
|
0
|
successful
|
|
|
|
|
2025-05-23T20:31:18+00:00
|
1
|
dorset
|
0
|
0
|
failed
|
Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238
|
RuntimeError
|
/app/lib/civica_scraper/page/search.rb:10:in `period'
/app/lib/civica_scraper.rb:63:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
|
|
2025-05-23T20:31:18+00:00
|
1
|
lane_cove
|
21
|
0
|
successful
|
|
|
|
|
2025-05-23T20:31:18+00:00
|
1
|
nambucca
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
|
2025-05-23T20:31:18+00:00
|
1
|
orange
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
|
2025-05-23T20:31:18+00:00
|
1
|
vincent
|
51
|
0
|
successful
|
|
|
|
|
2025-05-23T20:31:18+00:00
|
1
|
wanneroo
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
To download data sign in with GitHub
rows 10 / 62
| run_at | attempt | duration | successful | failed | interrupted | successful_count | interrupted_count | failed_count | public_ip |
|---|---|---|---|---|---|---|---|---|---|
|
2025-05-23T20:31:18+00:00
|
1
|
402.2
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-23T20:38:00+00:00
|
2
|
65.6
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-24T15:08:46+00:00
|
1
|
384.7
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-24T15:15:11+00:00
|
2
|
68.5
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-25T01:41:25+00:00
|
1
|
352.2
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-25T01:47:17+00:00
|
2
|
65.5
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-26T13:02:52+00:00
|
1
|
408.1
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-26T13:09:40+00:00
|
2
|
65.5
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-27T06:16:45+00:00
|
1
|
385.0
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
|
2025-05-27T06:23:10+00:00
|
2
|
65.3
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
Statistics
Total run time: about 8 hours
Total cpu time used: 2 minutes
Total disk space used: 6.45 MB
History
-
Auto
ran
revision
9e37d085
and
failed
.
269 records added, 269 records removed in the database
-
Auto
ran
revision
9e37d085
and
failed
.
284 records added, 280 records removed in the database
-
Auto
ran
revision
9e37d085
and
failed
.
292 records added, 290 records removed in the database
-
Auto
ran
revision
9e37d085
and
failed
.
304 records added, 290 records removed in the database
-
Auto
ran
revision
9e37d085
and
failed
.
322 records added, 297 records removed in the database
- ...
- Created on morph.io