ianheggie-oaf / multiple_civica-prs

Test All civica pull requests

README.md

This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

Contributors mlandauer ianheggie-oaf tseyiokorodudu

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: bunbury, burwood, camden, cairns, dorset, lane_cove, nambucca, orange, vincent, wanneroo, whittlesea, woollahra Collecting feed data for bunbury, attempt: 1... Saving record bunbury - 13 Allen Street EAST BUNBURY WA 6230 Saving record bunbury - 8 Ashbank Green SOUTH BUNBURY WA 6230 Saving record bunbury - 1 Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - Unit 1 25 Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 36A Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 45A Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 13 Beagle Place CAREY PARK WA 6230 Saving record bunbury - 6 Benson Court SOUTH BUNBURY WA 6230 Saving record bunbury - Bussell Highway COLLEGE GROVE WA 6230 Saving record bunbury - 15 Cambridge Crescent EAST BUNBURY WA 6230 Saving record bunbury - 4 Cavendish Green COLLEGE GROVE WA 6230 Saving record bunbury - 5 Churchill Drive SOUTH BUNBURY WA 6230 Saving record bunbury - 66 Clarke Street SOUTH BUNBURY WA 6230 Saving record bunbury - 18 Clifton Street BUNBURY WA 6230 Saving record bunbury - 28B Constitution Street SOUTH BUNBURY WA 6230 Saving record bunbury - 14 Coverley Street EAST BUNBURY WA 6230 Saving record bunbury - 35B Cranbrook Way USHER WA 6230 Saving record bunbury - 15 Craven Court WITHERS WA 6230 Saving record bunbury - 8 Darwin Way COLLEGE GROVE WA 6230 Saving record bunbury - 8 Darwin Way COLLEGE GROVE WA 6230 Saving record bunbury - 16 Dwyer Street EAST BUNBURY WA 6230 Saving record bunbury - 11 Dyinda Street CAREY PARK WA 6230 Saving record bunbury - 17 Eulalia Street CAREY PARK WA 6230 Saving record bunbury - 13 Fairway Court EAST BUNBURY WA 6230 Saving record bunbury - 15 Forrest Street EAST BUNBURY WA 6230 Saving record bunbury - 107 Forrest Avenue SOUTH BUNBURY WA 6230 Saving record bunbury - 47C Ganfield Street CAREY PARK WA 6230 Saving record bunbury - 30 Goldsmith Street SOUTH BUNBURY WA 6230 Saving record bunbury - 30 Goldsmith Street SOUTH BUNBURY WA 6230 Saving record bunbury - 49 Goldsmith Street SOUTH BUNBURY WA 6230 Saving record bunbury - Unit 1 21 Greensell Street BUNBURY WA 6230 Saving record bunbury - 35B Haig Crescent BUNBURY WA 6230 Saving record bunbury - 16 Halsey Street SOUTH BUNBURY WA 6230 Saving record bunbury - 16 Halsey Street SOUTH BUNBURY WA 6230 Saving record bunbury - 48 Hayes Street EAST BUNBURY WA 6230 Saving record bunbury - 8 Henry Street BUNBURY WA 6230 Saving record bunbury - Unit 1 31 Holman Street BUNBURY WA 6230 Saving record bunbury - Unit 2 31 Holman Street BUNBURY WA 6230 Saving record bunbury - Unit 7 31 Holman Street BUNBURY WA 6230 Saving record bunbury - 23C Holywell Street SOUTH BUNBURY WA 6230 Saving record bunbury - 8 Hotchin Street SOUTH BUNBURY WA 6230 Saving record bunbury - 2B Hudson Road SOUTH BUNBURY WA 6230 Saving record bunbury - 51A Jarvis Street SOUTH BUNBURY WA 6230 Saving record bunbury - 25 Jipse Crescent EAST BUNBURY WA 6230 Saving record bunbury - 37 Lingard Loop USHER WA 6230 Saving record bunbury - 13B Little Street CAREY PARK WA 6230 Saving record bunbury - 45 Mangles Street SOUTH BUNBURY WA 6230 Saving record bunbury - 11 Mary Street SOUTH BUNBURY WA 6230 Saving record bunbury - 8 Mason Street DAVENPORT WA 6230 Saving record bunbury - 16 Meredith Way USHER WA 6230 Saving record bunbury - 4 Merton Avenue COLLEGE GROVE WA 6230 Saving record bunbury - 18 Mindalong Close SOUTH BUNBURY WA 6230 Saving record bunbury - Unit 3 70 Minninup Road SOUTH BUNBURY WA 6230 Saving record bunbury - 83 Minninup Road SOUTH BUNBURY WA 6230 Saving record bunbury - 86A Minninup Road SOUTH BUNBURY WA 6230 Saving record bunbury - 53 Moonlight Drive GLEN IRIS WA 6230 Saving record bunbury - 15A-15B Morrissey Street GLEN IRIS WA 6230 Saving record bunbury - 27 Mossop Street SOUTH BUNBURY WA 6230 Saving record bunbury - 16 Mouarn Street CAREY PARK WA 6230 Saving record bunbury - 5 Munro Loop DAVENPORT WA 6230 Saving record bunbury - 7 Munro Loop DAVENPORT WA 6230 Saving record bunbury - 14 Norrie Street SOUTH BUNBURY WA 6230 Saving record bunbury - 26 Oriel Court COLLEGE GROVE WA 6230 Saving record bunbury - 39B Parry Street SOUTH BUNBURY WA 6230 Saving record bunbury - 39A Parry Street SOUTH BUNBURY WA 6230 Saving record bunbury - 21 Patrick Street SOUTH BUNBURY WA 6230 Saving record bunbury - 25 Payton Way USHER WA 6230 Saving record bunbury - 25 Payton Way USHER WA 6230 Saving record bunbury - 10 Rodsted Street EAST BUNBURY WA 6230 Saving record bunbury - 12A-12B Roman Road BUNBURY WA 6230 Saving record bunbury - 25 Rose Street BUNBURY WA 6230 Saving record bunbury - 9 Shanahan Road DAVENPORT WA 6230 Saving record bunbury - 7 Shenton Street EAST BUNBURY WA 6230 Saving record bunbury - Socceroos Place WITHERS WA 6230 Saving record bunbury - South Western Highway PICTON WA 6229 Saving record bunbury - 158 Spencer Street SOUTH BUNBURY WA 6230 Saving record bunbury - 59 Stirling Street BUNBURY WA 6230 Saving record bunbury - 42 Strickland Street BUNBURY WA 6230 Saving record bunbury - 42 Strickland Street BUNBURY WA 6230 Saving record bunbury - 42 Strickland Street BUNBURY WA 6230 Saving record bunbury - 42 Strickland Street BUNBURY WA 6230 Saving record bunbury - 12 Sunningdale Street SOUTH BUNBURY WA 6230 Saving record bunbury - Unit 1-3 17-19 Sunningdale Street SOUTH BUNBURY WA 6230 Saving record bunbury - 63 Sweeny Street CAREY PARK WA 6230 Saving record bunbury - 7 The Strand BUNBURY WA 6230 Saving record bunbury - 44B Thomas Street EAST BUNBURY WA 6230 Saving record bunbury - 10 Tilley Crescent EAST BUNBURY WA 6230 Saving record bunbury - 70 Timperley Road SOUTH BUNBURY WA 6230 Saving record bunbury - 15 Victoria Street BUNBURY WA 6230 Saving record bunbury - Vittoria Road GLEN IRIS WA 6230 Saving record bunbury - Vittoria Road GLEN IRIS WA 6230 Saving record bunbury - 38 Vittoria Road GLEN IRIS WA 6230 Saving record bunbury - 38 Vittoria Road GLEN IRIS WA 6230 Saving record bunbury - 38 Vittoria Road GLEN IRIS WA 6230 Saving record bunbury - 26 Ward Street SOUTH BUNBURY WA 6230 Saving record bunbury - 2-6 Wattle Street BUNBURY WA 6230 Saving record bunbury - 27 Wellington Street BUNBURY WA 6230 Saving record bunbury - 39 Westwood Street WITHERS WA 6230 Saving record bunbury - 11C White Street EAST BUNBURY WA 6230 Saving record bunbury - 40 White Street EAST BUNBURY WA 6230 Saving record bunbury - 22 Willis Cove PELICAN POINT WA 6230 Collecting feed data for burwood, attempt: 1... Collecting feed data for camden, attempt: 1... burwood: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:78:in `<main>' Saving record camden - 7 Abercrombie Place HARRINGTON PARK NSW 2567 Saving record camden - 32 Acre Street ORAN PARK NSW 2570 Saving record camden - 27 Allambie Circuit ORAN PARK NSW 2570 Saving record camden - 180-186 Argyle Street CAMDEN NSW 2570 Saving record camden - 101 Ballandean Boulevard GLEDSWOOD HILLS NSW 2557 Saving record camden - 37 Barry Avenue CATHERINE FIELD NSW 2557 Saving record camden - 19 Belgravia Avenue GLEDSWOOD HILLS NSW 2557 Saving record camden - 5 Bextor Avenue LEPPINGTON NSW 2179 Saving record camden - 8 Bextor Avenue LEPPINGTON NSW 2179 Saving record camden - 9 Bextor Avenue LEPPINGTON NSW 2179 Saving record camden - 24 Binda Way HARRINGTON PARK NSW 2567 Saving record camden - 18 Boxthorn Avenue LEPPINGTON NSW 2179 Saving record camden - 93 Brabham Drive ORAN PARK NSW 2570 Saving record camden - 94 Brabham Drive ORAN PARK NSW 2570 Saving record camden - 4 Brown Place MOUNT ANNAN NSW 2567 Saving record camden - 100 Byron Road LEPPINGTON NSW 2179 Saving record camden - 880 Camden Valley Way GLEDSWOOD HILLS NSW 2557 Saving record camden - 104 Candling Road LEPPINGTON NSW 2179 Saving record camden - 30 Capparis Lane LEPPINGTON NSW 2179 Saving record camden - 4 Carmody Street LEPPINGTON NSW 2179 Saving record camden - 10 Carmody Street LEPPINGTON NSW 2179 Saving record camden - 18 Carmody Street LEPPINGTON NSW 2179 Saving record camden - 57 Carmody Street LEPPINGTON NSW 2179 Saving record camden - 189 Catherine Fields Road CATHERINE FIELD NSW 2557 Saving record camden - 186 Cawdor Road CAWDOR NSW 2570 Saving record camden - 23 Central Hills Drive GREGORY HILLS NSW 2557 Saving record camden - 10 Christie Street ORAN PARK NSW 2570 Saving record camden - 13 Civic Way ORAN PARK NSW 2570 Saving record camden - 23 Civic Way ORAN PARK NSW 2570 Saving record camden - 499 Cobbitty Road COBBITTY NSW 2570 Saving record camden - 499 Cobbitty Road COBBITTY NSW 2570 Saving record camden - 3 Coliban Street GLEDSWOOD HILLS NSW 2557 Saving record camden - 7 Coliban Street GLEDSWOOD HILLS NSW 2557 Saving record camden - 57 Coliban Street GLEDSWOOD HILLS NSW 2557 Saving record camden - 181 Deepfields Road CATHERINE FIELD NSW 2557 Saving record camden - 133 Dickson Road LEPPINGTON NSW 2179 Saving record camden - 19 Digitaria Drive GLEDSWOOD HILLS NSW 2557 Saving record camden - 39 Dwyer Road LEPPINGTON NSW 2179 Saving record camden - 26A Elizabeth Macarthur Avenue CAMDEN SOUTH NSW 2570 Saving record camden - 9 Faithfull Street ELDERSLIE NSW 2570 Saving record camden - SE 103 3 Fordham Way ORAN PARK NSW 2570 Saving record camden - 26 Freshwater Drive COBBITTY NSW 2570 Saving record camden - 9 Goode Place CURRANS HILL NSW 2567 Saving record camden - 7A-7A Grandstand Loop ORAN PARK NSW 2570 Saving record camden - 11 Grazier Avenue GREGORY HILLS NSW 2557 Saving record camden - 35 Grebe Circuit ORAN PARK NSW 2570 Saving record camden - 1 Gregory Hills Drive GLEDSWOOD HILLS NSW 2557 Saving record camden - 4 Harben Vale Circuit GRASMERE NSW 2570 Saving record camden - 18 Heath Road LEPPINGTON NSW 2179 Saving record camden - 82 Hillston Circuit GREGORY HILLS NSW 2557 Saving record camden - 12 Holborn Circuit GLEDSWOOD HILLS NSW 2557 Saving record camden - 36 Holliday Circuit ORAN PARK NSW 2570 Saving record camden - 6 Homestead Court HARRINGTON PARK NSW 2567 Saving record camden - 175 Ingleburn Road LEPPINGTON NSW 2179 Saving record camden - 120-130 Lodges Road ELDERSLIE NSW 2570 Saving record camden - 120-130 Lodges Road ELDERSLIE NSW 2570 Saving record camden - 1 Lorimer Crescent ELDERSLIE NSW 2570 Saving record camden - 214 Macarthur Road SPRING FARM NSW 2570 Saving record camden - 27 Meridian Street LEPPINGTON NSW 2179 Saving record camden - 52A Merino Drive ELDERSLIE NSW 2570 Saving record camden - 4 Michele Place CAMDEN SOUTH NSW 2570 Saving record camden - 7-7A Milford Road ELLIS LANE NSW 2570 Saving record camden - 27 Mindari Street LEPPINGTON NSW 2179 Saving record camden - 44 Plowman Road CURRANS HILL NSW 2567 Saving record camden - 2-4 Porter Street ORAN PARK NSW 2570 Saving record camden - 11 Pottery Street COBBITTY NSW 2570 Saving record camden - 66 Rickard Road LEPPINGTON NSW 2179 Saving record camden - 103 Ridge Square LEPPINGTON NSW 2179 Saving record camden - 70 Southwell Road ORAN PARK NSW 2570 Saving record camden - 189A Springfield Road CATHERINE FIELD NSW 2557 Saving record camden - 43 Standish Avenue GREGORY HILLS NSW 2557 Saving record camden - 11 Stimpson Crescent GRASMERE NSW 2570 Saving record camden - 19 Sultana Avenue LEPPINGTON NSW 2179 Saving record camden - 680A The Northern Road ORAN PARK NSW 2570 Saving record camden - 175 Turner Road CURRANS HILL NSW 2567 Saving record camden - 187 Turner Road CURRANS HILL NSW 2567 Saving record camden - U 34 66 Turner Road SMEATON GRANGE NSW 2567 Saving record camden - 46 Ulmarra Avenue CAMDEN SOUTH NSW 2570 Saving record camden - 10-12 View Street CAMDEN NSW 2570 Saving record camden - 11 Webber Loop ORAN PARK NSW 2570 Saving record camden - 167 Werombi Road GRASMERE NSW 2570 Collecting feed data for cairns, attempt: 1... Saving record cairns - 19-25 Atherton Street WHITFIELD QLD 4870 Saving record cairns - 59-61 Aumuller Street PORTSMITH QLD 4870 Saving record cairns - Barbagallo Road ALOOMBA QLD 4871 Saving record cairns - 9-11 Bassett Street KANIMBLA QLD 4870 Saving record cairns - 39 Batt Street CLIFTON BEACH QLD 4879 Saving record cairns - 70R Bennett Road ALOOMBA QLD 4871 Saving record cairns - Bruce Highway GORDONVALE QLD 4865 Saving record cairns - 112 Cairns Street CAIRNS NORTH QLD 4870 Saving record cairns - 6 Cananga Close KAMERUNGA QLD 4870 Saving record cairns - 1L Captain Cook Highway CLIFTON BEACH QLD 4879 Saving record cairns - Captain Cook Highway ELLIS BEACH QLD 4879 Saving record cairns - Captain Cook Highway KEWARRA BEACH QLD 4879 Saving record cairns - 34L Captain Cook Highway KEWARRA BEACH QLD 4879 Saving record cairns - 1000L Coral Coast Drive PALM COVE QLD 4879 Saving record cairns - 25 East Parkridge Drive BRINSMEAD QLD 4870 Saving record cairns - Unit 132 53-57 Esplanade CAIRNS CITY QLD 4870 Saving record cairns - Fairweather Access GOLDSBOROUGH QLD 4865 Saving record cairns - 49 Flindersia Street REDLYNCH QLD 4870 Saving record cairns - 30-34 Fretwell Road WHITE ROCK QLD 4868 Saving record cairns - 174-180 Grafton Street CAIRNS CITY QLD 4870 Saving record cairns - 21 Granite Close BRINSMEAD QLD 4870 Saving record cairns - 209 Greenslopes Street EDGE HILL QLD 4870 Saving record cairns - 64 Hayward Street MOOROOBOOL QLD 4870 Saving record cairns - 12 Holmes Street STRATFORD QLD 4870 Saving record cairns - 25-29 Jackson Drive WOREE QLD 4868 Saving record cairns - 387-389 Kamerunga Road REDLYNCH QLD 4870 Saving record cairns - 44L Macaranga Road BENTLEY PARK QLD 4869 Saving record cairns - 57 Macaranga Road BENTLEY PARK QLD 4869 Saving record cairns - Machans Beach Road MACHANS BEACH QLD 4878 Saving record cairns - Maher Road GORDONVALE QLD 4865 Saving record cairns - 4B Maisel Close SMITHFIELD QLD 4878 Saving record cairns - 3 Mayo Court REDLYNCH QLD 4870 Saving record cairns - 519 McCormack Street EDGE HILL QLD 4870 Saving record cairns - 5 Michaelangelo Drive REDLYNCH QLD 4870 Saving record cairns - 58-64 Mill Street GORDONVALE QLD 4865 Saving record cairns - Moore Street TRINITY BEACH QLD 4879 Saving record cairns - 19-39 Palmer Street PORTSMITH QLD 4870 Saving record cairns - Parkinson Avenue KEWARRA BEACH QLD 4879 Saving record cairns - 136 Pease Street MANOORA QLD 4870 Saving record cairns - 63 Periwinkle Avenue TRINITY BEACH QLD 4879 Saving record cairns - 45 Poolwood Road KEWARRA BEACH QLD 4879 Saving record cairns - 13 Pyne Street EDGE HILL QLD 4870 Saving record cairns - Reed Road TRINITY PARK QLD 4879 Saving record cairns - 1-3 Reese Close GORDONVALE QLD 4865 Saving record cairns - 42-44 Runnymede Avenue REDLYNCH QLD 4870 Saving record cairns - 25 Sheoak Drive BENTLEY PARK QLD 4869 Saving record cairns - 161 Sheridan Street CAIRNS CITY QLD 4870 Saving record cairns - 339 Sheridan Street CAIRNS NORTH QLD 4870 Saving record cairns - 369 Sheridan Street CAIRNS NORTH QLD 4870 Saving record cairns - 17-21 Sicilian Avenue GORDONVALE QLD 4865 Saving record cairns - 35-41 Skull Road WHITE ROCK QLD 4868 Saving record cairns - 256 Spence Street BUNGALOW QLD 4870 Saving record cairns - 41L Swallow Road EDMONTON QLD 4869 Saving record cairns - 470-472 Varley Street YORKEYS KNOB QLD 4878 Saving record cairns - 19 Veivers Road PALM COVE QLD 4879 Saving record cairns - Williams Esplanade PALM COVE QLD 4879 Saving record cairns - 118 Woodward Street EDGE HILL QLD 4870 Saving record cairns - 219 Woodward Street WHITFIELD QLD 4870 Saving record cairns - 2-4 Zanzoo Close REDLYNCH QLD 4870 Collecting feed data for dorset, attempt: 1... Collecting feed data for lane_cove, attempt: 1... dorset: ERROR: Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238 /app/lib/civica_scraper/page/search.rb:10:in `period' /app/lib/civica_scraper.rb:63:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:78:in `<main>' Saving record lane_cove - 2 Anglo Road GREENWICH NSW 2065 (Lot: 33 Sec: 4 DP: 3044) Saving record lane_cove - 51 Arabella Street LONGUEVILLE NSW 2066 (Lot: 1 DP: 168957) Saving record lane_cove - 104 Arabella Street LONGUEVILLE NSW 2066 (Lot: 3 Sec: 9A DP: 5006) Saving record lane_cove - 22 Berry Road ST LEONARDS NSW 2065 (Lot: 29 Sec: 2 DP: 7259) Saving record lane_cove - 33A Bridge Street LANE COVE NSW 2066 (Lot: 1 DP: 507149) Saving record lane_cove - 73 Carlotta Street GREENWICH NSW 2065 (Lot: 1 DP: 708423) Saving record lane_cove - 1 Dettmann Avenue LONGUEVILLE NSW 2066 (Lot: 2 DP: 789232) Saving record lane_cove - 21 Flaumont Avenue RIVERVIEW NSW 2066 (Lot: 5 DP: 16472) Saving record lane_cove - 42 Kallaroo Road RIVERVIEW NSW 2066 (Lot: 109 DP: 16472) Saving record lane_cove - 8 Kullah Parade LANE COVE NORTH NSW 2066 (Lot: 117 DP: 36362) Saving record lane_cove - Unit 502 35 Little Street LANE COVE NSW 2066 (Lot: 55 SP: 96437) Saving record lane_cove - 266 Longueville Road LANE COVE NSW 2066 (Lot: 1 DP: 1227921) Saving record lane_cove - 28 Lucretia Avenue LONGUEVILLE NSW 2066 (Lot: 2 DP: 503186) Saving record lane_cove - 62 Northwood Road NORTHWOOD NSW 2066 (Lot: 1 DP: 826939) Saving record lane_cove - 2 Robert Street GREENWICH NSW 2065 (Lot: 1 DP: 86156) Saving record lane_cove - 74 Ronald Avenue LANE COVE NSW 2066 (Lot: 2 DP: 552010) Saving record lane_cove - 10 Wingadee Street LANE COVE NORTH NSW 2066 (Lot: 2 DP: 542456) Collecting feed data for nambucca, attempt: 1... Collecting feed data for orange, attempt: 1... nambucca: ERROR: 500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:78:in `<main>' Collecting feed data for vincent, attempt: 1... orange: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:78:in `<main>' Saving record vincent - 133 Alma Road NORTH PERTH WA 6006 (LOT: 15 D/P: 1657) Saving record vincent - 170B Alma Road NORTH PERTH WA 6006 (LOT: 3 STR: 88668) Saving record vincent - 170A Alma Road NORTH PERTH WA 6006 (LOT: 2 STR: 88668) Saving record vincent - 163 Anzac Road MOUNT HAWTHORN WA 6016 (LOT: 49 D/P: 2848) Saving record vincent - 521-525 Beaufort Street HIGHGATE WA 6003 (LOT: 20 D/P: 672) Saving record vincent - 609 Beaufort Street MOUNT LAWLEY WA 6050 (LOT: 500 D/P: 404875) Saving record vincent - 189 Brisbane Street PERTH WA 6000 (LOT: 33 D/P: 861) Saving record vincent - 77 Broome Street HIGHGATE WA 6003 (LOT: 123 D/P: 470) Saving record vincent - 389 Bulwer Street WEST PERTH WA 6005 (LOT: 3 D/P: 1283) Saving record vincent - 19A Burt Street MOUNT LAWLEY WA 6050 (LOT: 2 STR: 86091) Saving record vincent - 7B Campsie Street NORTH PERTH WA 6006 (LOT: 1 STR: 11397) Saving record vincent - 6 Carr Street WEST PERTH WA 6005 (LOT: 10 D/P: 375) Saving record vincent - 338 Charles Street NORTH PERTH WA 6006 (LOT: 107 D/P: 1823) Saving record vincent - 116 Charles Street WEST PERTH WA 6005 (LOT: 71 D/P: 27547) Saving record vincent - 125 Coogee Street MOUNT HAWTHORN WA 6016 (LOT: 279 D/P: 2503) Saving record vincent - 84A Cowle Street WEST PERTH WA 6005 (LOT: 2 STR: 63617) Saving record vincent - 24 Drummond Place WEST PERTH WA 6005 (LOT: 1 D/P: 3883) Saving record vincent - 135 Dunedin Street MOUNT HAWTHORN WA 6016 (LOT: 2 D/P: 11538) Saving record vincent - 17 Edinboro Street MOUNT HAWTHORN WA 6016 (LOT: 887 D/P: 42652) Saving record vincent - 98 Ellesmere Street MOUNT HAWTHORN WA 6016 (LOT: 177 D/P: 3845) Saving record vincent - 22 Ethel Street NORTH PERTH WA 6006 (LOT: 881 D/P: 411470) Saving record vincent - 408-410 Fitzgerald Street NORTH PERTH WA 6006 (LOT: 1 STR: 14218) Saving record vincent - 452 Fitzgerald Street NORTH PERTH WA 6006 (LOT: 7 D/P: 1843) Saving record vincent - 93 Forrest Street NORTH PERTH WA 6006 (LOT: 14 D/P: 97882) Saving record vincent - 29 Gill Street NORTH PERTH WA 6006 (LOT: 24 D/P: 555) Saving record vincent - 149 Grosvenor Road NORTH PERTH WA 6006 (LOT: 732 D/P: 89747) Saving record vincent - 198 Harold Street MOUNT LAWLEY WA 6050 (LOT: 6 D/P: 672) Saving record vincent - Unit 4 22 Knebworth Avenue PERTH WA 6000 (LOT: 4 STR: 14159) Saving record vincent - 162 Loftus Street NORTH PERTH WA 6006 (LOT: 2 D/P: 4856) Saving record vincent - 208 Loftus Street NORTH PERTH WA 6006 (LOT: 20 D/P: 2440) Saving record vincent - 4B Lynton Street MOUNT HAWTHORN WA 6016 (LOT: 3 STR: 24563) Saving record vincent - 4 Lynton Street MOUNT HAWTHORN WA 6016 (LOT: 1 STR: 24563) Saving record vincent - 91 Matlock Street MOUNT HAWTHORN WA 6016 (LOT: 231 D/P: 3845) Saving record vincent - 22A Melrose Street LEEDERVILLE WA 6007 (LOT: 1 STR: 24973) Saving record vincent - 5 Mignonette Street NORTH PERTH WA 6006 (LOT: 17 D/P: 1306) Saving record vincent - 65 Monmouth Street MOUNT LAWLEY WA 6050 (LOT: 412 D/P: 33988) Saving record vincent - 622 Newcastle Street LEEDERVILLE WA 6007 (LOT: 1 D/P: 1057) Saving record vincent - 249 Oxford Street LEEDERVILLE WA 6007 (LOT: 24 D/P: 1033) Saving record vincent - 266-268 Oxford Street LEEDERVILLE WA 6007 (LOT: 1 D/P: 1044) Saving record vincent - 26 Paddington Street NORTH PERTH WA 6006 (LOT: 123 D/P: 10666) Saving record vincent - 7A Pansy Street NORTH PERTH WA 6006 (LOT: 2 STR: 87641) Saving record vincent - 2 Persimmon Street NORTH PERTH WA 6006 (LOT: 13 D/P: 1577) Saving record vincent - 108 Richmond Street LEEDERVILLE WA 6007 (LOT: 4 D/P: 953) Saving record vincent - 121 Richmond Street LEEDERVILLE WA 6007 (LOT: 10 D/P: 854) Saving record vincent - 141 Scarborough Beach Road MOUNT HAWTHORN WA 6016 (LOT: 6 D/P: 98568) Saving record vincent - 177 Scarborough Beach Road MOUNT HAWTHORN WA 6016 (LOT: 2 D/P: 25122) Saving record vincent - 44 Shakespeare Street MOUNT HAWTHORN WA 6016 (LOT: 382 D/P: 2334) Saving record vincent - 34 View Street NORTH PERTH WA 6006 (LOT: 1 D/P: 66456) Saving record vincent - 45 Vincent Street MOUNT LAWLEY WA 6050 (LOT: 1 STR: 39960) Saving record vincent - 71 Wasley Street NORTH PERTH WA 6006 (LOT: 1 STR: 6775) Saving record vincent - 46 Waugh Street NORTH PERTH WA 6006 (LOT: 49 D/P: 3002) Saving record vincent - Unit 2 3 West Parade PERTH WA 6000 (LOT: 1 STR: 71797) Saving record vincent - 380 William Street PERTH WA 6000 (LOT: 67 D/P: 613) Saving record vincent - 26 Woodville Street NORTH PERTH WA 6006 (LOT: 1 STR: 76228) Collecting feed data for wanneroo, attempt: 1... Collecting feed data for whittlesea, attempt: 1... wanneroo: ERROR: 500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:78:in `<main>' whittlesea: ERROR: execution expired Collecting feed data for woollahra, attempt: 1... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:78:in `<main>' Saving record woollahra - 5 Cambridge Street PADDINGTON NSW 2021 (LOT: 2 DP: 515276) Saving record woollahra - 29 Carrara Road VAUCLUSE NSW 2030 (LOT: B DP: 367302) Saving record woollahra - 14-16 Comber Street PADDINGTON NSW 2021 (LOT: 1 DP: 67273) Saving record woollahra - 147 Darling Point Road DARLING POINT NSW 2027 (LOT: 2 DP: 1309778) Saving record woollahra - Unit 2 24 Derby Street VAUCLUSE NSW 2030 (LOT: 2 SP: 14069) Saving record woollahra - 440 Edgecliff Road EDGECLIFF NSW 2027 (LOT: 1 DP: 1310462) Saving record woollahra - 284 Edgecliff Road WOOLLAHRA NSW 2025 (LOT: 10 DP: 1145458) Saving record woollahra - 40 Epping Road DOUBLE BAY NSW 2028 (LOT: 2 DP: 74991) Saving record woollahra - 3 Fullerton Street WOOLLAHRA NSW 2025 (LOT: 0 SP: 16668) Saving record woollahra - 52 Gipps Street PADDINGTON NSW 2021 (LOT: 6 DP: 192270) Saving record woollahra - 20 Glenmore Road PADDINGTON NSW 2021 (LOT: 192 DP: 814101) Saving record woollahra - 110 Hopetoun Avenue VAUCLUSE NSW 2030 (LOT: 1 DP: 207737) Saving record woollahra - 56 John Street WOOLLAHRA NSW 2025 (LOT: 10 DP: 1052526) Saving record woollahra - 39 Liverpool Street PADDINGTON NSW 2021 (LOT: 11 DP: 1036153) Saving record woollahra - 17 Milton Avenue WOOLLAHRA NSW 2025 (LOT: X DP: 410562) Saving record woollahra - 9 Mona Road DARLING POINT NSW 2027 (LOT: 3 DP: 171284) Saving record woollahra - 453-457 New South Head Road DOUBLE BAY NSW 2028 (LOT: A DP: 159268) Saving record woollahra - 203-233 New South Head Road EDGECLIFF NSW 2027 (LOT: 2 DP: 553702) Saving record woollahra - 76 Newcastle Street ROSE BAY NSW 2029 (LOT: 7 DP: 4893) Saving record woollahra - 3 Nulla Street VAUCLUSE NSW 2030 (LOT: 1 DP: 228608) Saving record woollahra - 34 Ocean Street WOOLLAHRA NSW 2025 (LOT: 1 DP: 253392) Saving record woollahra - 208 Old South Head Road VAUCLUSE NSW 2030 (LOT: 8 SEC: 1 DP: 6203) Saving record woollahra - 380 Oxford Street PADDINGTON NSW 2021 (LOT: 1 DP: 63804) Saving record woollahra - 13 Robertson Place WATSONS BAY NSW 2030 (LOT: 22 DP: 10398) Saving record woollahra - 14 Rosemont Avenue WOOLLAHRA NSW 2025 (LOT: 2 DP: 554201) Saving record woollahra - 6 Spencer Street ROSE BAY NSW 2029 (LOT: 1 DP: 225551) Saving record woollahra - 6 Stephen Street PADDINGTON NSW 2021 (LOT: 3 DP: 440536) Saving record woollahra - 5A Vaucluse Road VAUCLUSE NSW 2030 (LOT: X DP: 403176) Saving record woollahra - 26 Vaucluse Road VAUCLUSE NSW 2030 (LOT: 1 DP: 948896) Saving record woollahra - 14 Village High Road VAUCLUSE NSW 2030 (LOT: 3 DP: 310064) Saving record woollahra - 84 Wallis Street WOOLLAHRA NSW 2025 (LOT: 1 DP: 771174) Saving record woollahra - 26 Wentworth Road VAUCLUSE NSW 2030 (LOT: 2 DP: 940029) Saving record woollahra - 102 Windsor Street PADDINGTON NSW 2021 (LOT: 1 DP: 432337) Saving record woollahra - 84-86 Wolseley Road POINT PIPER NSW 2027 (LOT: 0 SP: 62022) Saving record woollahra - 21 Wunulla Road POINT PIPER NSW 2027 (LOT: 1 DP: 976134) Saving record woollahra - 21 Wunulla Road POINT PIPER NSW 2027 (LOT: 1 DP: 976134) *************************************************** Now retrying authorities which earlier had failures burwood, dorset, nambucca, orange, wanneroo, whittlesea *************************************************** Collecting feed data for burwood, attempt: 2... Collecting feed data for dorset, attempt: 2... burwood: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:57:in `run' scraper.rb:78:in `<main>' Collecting feed data for nambucca, attempt: 2... dorset: ERROR: Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238 /app/lib/civica_scraper/page/search.rb:10:in `period' /app/lib/civica_scraper.rb:63:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:57:in `run' scraper.rb:78:in `<main>' Collecting feed data for orange, attempt: 2... nambucca: ERROR: 500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:57:in `run' scraper.rb:78:in `<main>' Collecting feed data for wanneroo, attempt: 2... orange: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:57:in `run' scraper.rb:78:in `<main>' Collecting feed data for whittlesea, attempt: 2... wanneroo: ERROR: 500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:57:in `run' scraper.rb:78:in `<main>' whittlesea: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:57:in `run' scraper.rb:78:in `<main>' /app/vendor/bundle/ruby/2.5.0/gems/scraper_utils-0.7.2/lib/scraper_utils/log_utils.rb:159:in `report_on_results': ERROR: Unexpected errors in: burwood (Add to MORPH_EXPECT_BAD?) (RuntimeError) MORPH_EXPECT_BAD=dorset,nambucca,orange,wanneroo,whittlesea Scraping Summary: Authority OK Bad Exception -------------------- ------ ------ -------------------------------------------------- bunbury 101 0 - burwood 0 0 Mechanize::ResponseCodeError - 500 => Net::HTTPInternalServerError for camden 81 0 - burwood: Mechanize::ResponseCodeError - 500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response See earlier output for details cairns 59 0 - from scraper.rb:68:in `run' from scraper.rb:78:in `<main>' dorset 0 0 [EXPECT BAD] RuntimeError - Couldn't find form daEnquiryForm for perio lane_cove 17 0 - nambucca 0 0 [EXPECT BAD] Mechanize::ResponseCodeError - 500 => Net::HTTPInternalSe orange 0 0 [EXPECT BAD] Mechanize::ResponseCodeError - 500 => Net::HTTPInternalSe vincent 54 0 - wanneroo 0 0 [EXPECT BAD] Mechanize::ResponseCodeError - 500 => Net::HTTPInternalSe whittlesea 0 0 [EXPECT BAD] Net::OpenTimeout - execution expired woollahra 36 0 -

Data

Downloaded 1452 times by ianheggie-oaf

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (514 KB) Use the API

rows 10 / 653

council_reference address description info_url date_received date_scraped authority_label on_notice_from on_notice_to
2025/129/1
3 Crest Road GLEDSWOOD HILLS NSW 2557
Construction of an inground fiberglass swimming pool.
https://eservice.camden.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010
2025-03-17
2025-04-16
camden
2025/122/1
15 Epsom Street SPRING FARM NSW 2570
Inground Fibreglass Pool
https://eservice.camden.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010
2025-03-17
2025-04-16
camden
2025/127/1
33 Meridian Street LEPPINGTON NSW 2179
Construction of a two storey dwelling and associated site works.
https://eservice.camden.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010
2025-03-17
2025-04-16
camden
2021/1697/8
96 Rickard Road LEPPINGTON NSW 2179
Section 4.55 modification to an approved mixed use development to increase the height of the signage for the McDonalds restaurant
https://eservice.camden.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010
2025-03-17
2025-04-16
camden
2025/123/1
70 Southwell Road ORAN PARK NSW 2570
Change of use and fit out of an existing unit to a gym facility - Unit 5
https://eservice.camden.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010
2025-03-17
2025-04-16
camden
2025/128/1
21 Templeton Road ELDERSLIE NSW 2570
Demolition of an existing dwelling and construction of a two storey dwelling
https://eservice.camden.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010
2025-03-17
2025-04-16
camden
13336/2025
21-25 Atherton Street YORKEYS KNOB QLD 4878
Operational Works Civil Works
https://eservices.cairns.qld.gov.au/eservice/daEnquiryInit.do?nodeNum=227
2025-03-17
2025-04-16
cairns
13342/2025
Catalano Access GOLDSBOROUGH QLD 4865
Material Change of Use Dwelling House
https://eservices.cairns.qld.gov.au/eservice/daEnquiryInit.do?nodeNum=227
2025-03-17
2025-04-16
cairns
13344/2025
Catalano Access GOLDSBOROUGH QLD 4865
Operational Works Major Earthworks
https://eservices.cairns.qld.gov.au/eservice/daEnquiryInit.do?nodeNum=227
2025-03-17
2025-04-16
cairns
13339/2025
67 Del Manso Crescent EDMONTON QLD 4869
EXPRESS Material Change of Use Dual Occupancy
https://eservices.cairns.qld.gov.au/eservice/daEnquiryInit.do?nodeNum=227
2025-03-17
2025-04-16
cairns

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (514 KB) Use the API

rows 10 / 504

run_at attempt authority_label records_saved unprocessable_records status error_message error_class error_backtrace
2025-04-15T22:41:24+00:00
1
bunbury
121
0
successful
2025-04-15T22:41:24+00:00
1
burwood
0
0
failed
500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each'
2025-04-15T22:41:24+00:00
1
camden
102
0
successful
2025-04-15T22:41:24+00:00
1
cairns
55
0
successful
2025-04-15T22:41:24+00:00
1
dorset
0
0
failed
Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238
RuntimeError
/app/lib/civica_scraper/page/search.rb:10:in `period' /app/lib/civica_scraper.rb:63:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape'
2025-04-15T22:41:24+00:00
1
lane_cove
17
0
successful
2025-04-15T22:41:24+00:00
1
nambucca
0
0
failed
500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each'
2025-04-15T22:41:24+00:00
1
orange
0
0
failed
500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each'
2025-04-15T22:41:24+00:00
1
vincent
51
0
successful
2025-04-15T22:41:24+00:00
1
wanneroo
0
0
failed
500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response
Mechanize::ResponseCodeError
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/civica_scraper.rb:41:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each'

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (514 KB) Use the API

rows 10 / 42

run_at attempt duration successful failed interrupted successful_count interrupted_count failed_count public_ip
2025-04-15T22:41:24+00:00
1
362.6
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-15T22:47:27+00:00
2
65.4
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-16T12:00:13+00:00
1
358.3
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-16T12:06:11+00:00
2
67.2
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-16T14:54:53+00:00
1
349.9
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-16T15:00:43+00:00
2
65.7
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-17T05:23:04+00:00
1
339.5
bunbury,camden,cairns,lane_cove,woollahra
burwood,dorset,nambucca,orange,vincent,wanneroo,whittlesea
5
0
7
2025-04-17T05:28:44+00:00
2
74.3
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-17T15:00:13+00:00
1
364.1
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6
2025-04-17T15:06:17+00:00
2
65.5
bunbury,camden,cairns,lane_cove,vincent,woollahra
burwood,dorset,nambucca,orange,wanneroo,whittlesea
6
0
6

Statistics

Total run time: about 3 hours

Total cpu time used: less than a minute

Total disk space used: 6.13 MB

History

  • Auto ran revision 9e37d085 and failed .
    374 records added, 327 records removed in the database
  • Auto ran revision 9e37d085 and failed .
    385 records added, 346 records removed in the database
  • Auto ran revision 9e37d085 and failed .
    372 records added, 319 records removed in the database
  • Auto ran revision 9e37d085 and failed .
    345 records added, 307 records removed in the database
  • Manually ran revision 9e37d085 and failed .
    349 records added, 220 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_civica-prs / scraper.rb