ianheggie-oaf / multiple_civica-prs

Test All civica pull requests


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

Contributors mlandauer ianheggie-oaf simonzippy tseyiokorodudu

The scraper is running. It was queued manually .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: bunbury, camden, cairns, dorset, lane_cove, nambucca, orange, vincent, wanneroo, whittlesea, woollahra Collecting feed data for bunbury, attempt: 1... Saving record bunbury - 81 Albert Road EAST BUNBURY WA 6230 Saving record bunbury - 5 Austin Street SOUTH BUNBURY WA 6230 Saving record bunbury - 11 Austin Street SOUTH BUNBURY WA 6230 Saving record bunbury - 7 Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 23 Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 36A Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 39B Austral Parade EAST BUNBURY WA 6230 Saving record bunbury - 39 Beach Road SOUTH BUNBURY WA 6230 Saving record bunbury - 67B Beach Road SOUTH BUNBURY WA 6230 Saving record bunbury - 67B Beach Road SOUTH BUNBURY WA 6230 Saving record bunbury - 6 Burt Street EAST BUNBURY WA 6230 Saving record bunbury - 1 Bushell Street CAREY PARK WA 6230 Saving record bunbury - 11 Bushell Street CAREY PARK WA 6230 Saving record bunbury - 12 Bushell Street CAREY PARK WA 6230 Saving record bunbury - 6 Cambridge Crescent EAST BUNBURY WA 6230 Saving record bunbury - 105 Clarke Street SOUTH BUNBURY WA 6230 Saving record bunbury - 105 Clarke Street SOUTH BUNBURY WA 6230 Saving record bunbury - 12 Clifford Street DAVENPORT WA 6230 Saving record bunbury - 16B Clifford Street DAVENPORT WA 6230 Saving record bunbury - 17 Columba Street SOUTH BUNBURY WA 6230 Saving record bunbury - 52 Constitution Street SOUTH BUNBURY WA 6230 Saving record bunbury - 20 Coral Street SOUTH BUNBURY WA 6230 Saving record bunbury - 2 Cusworth Drive GLEN IRIS WA 6230 Saving record bunbury - 23 Delaporte Way CAREY PARK WA 6230 Saving record bunbury - 33 Denning Road EAST BUNBURY WA 6230 Saving record bunbury - Dettman Drive COLLEGE GROVE WA 6230 Saving record bunbury - 36 Ecclestone Street CAREY PARK WA 6230 Saving record bunbury - 44 Forrest Avenue SOUTH BUNBURY WA 6230 Saving record bunbury - 1C Frankel Street SOUTH BUNBURY WA 6230 Saving record bunbury - 47C Ganfield Street CAREY PARK WA 6230 Saving record bunbury - 46B Goldsmith Street SOUTH BUNBURY WA 6230 Saving record bunbury - 7 Hakea Crescent SOUTH BUNBURY WA 6230 Saving record bunbury - 57 Hakea Crescent SOUTH BUNBURY WA 6230 Saving record bunbury - 83 Halifax Drive DAVENPORT WA 6230 Saving record bunbury - 84 Halifax Drive DAVENPORT WA 6230 Saving record bunbury - 46 Halsey Street SOUTH BUNBURY WA 6230 Saving record bunbury - 43 Hands Avenue CAREY PARK WA 6230 Saving record bunbury - 43 Hands Avenue CAREY PARK WA 6230 Saving record bunbury - 25 Hastie Street SOUTH BUNBURY WA 6230 Saving record bunbury - 1 Henley Drive EAST BUNBURY WA 6230 Saving record bunbury - 4 Hensen Street DAVENPORT WA 6230 Saving record bunbury - 4 Jarvis Street SOUTH BUNBURY WA 6230 Saving record bunbury - Unit 8 13 Jubilee Road GLEN IRIS WA 6230 Saving record bunbury - 50 King Road EAST BUNBURY WA 6230 Saving record bunbury - 50 King Road EAST BUNBURY WA 6230 Saving record bunbury - Koombana Drive BUNBURY WA 6230 Saving record bunbury - 22 Lambert Loop COLLEGE GROVE WA 6230 Saving record bunbury - 24 Lambert Loop COLLEGE GROVE WA 6230 Saving record bunbury - 16A Lee Street SOUTH BUNBURY WA 6230 Saving record bunbury - 11 Maiden Park Road WITHERS WA 6230 Saving record bunbury - Unit 4 112 Mangles Street SOUTH BUNBURY WA 6230 Saving record bunbury - Unit 6 125 Mangles Street SOUTH BUNBURY WA 6230 Saving record bunbury - 39 Mary Street SOUTH BUNBURY WA 6230 Saving record bunbury - 113 Minninup Road SOUTH BUNBURY WA 6230 Saving record bunbury - 20 Mitchell Crescent CAREY PARK WA 6230 Saving record bunbury - 17 Moorland Avenue GLEN IRIS WA 6230 Saving record bunbury - 273 Ocean Drive WITHERS WA 6230 Saving record bunbury - Unit 1 12 Olsen Grove SOUTH BUNBURY WA 6230 Saving record bunbury - Olympic Lane WITHERS WA 6230 Saving record bunbury - 14 Palmer Crescent DAVENPORT WA 6230 Saving record bunbury - 50 Petherick Street EAST BUNBURY WA 6230 Saving record bunbury - 14 Picton Road EAST BUNBURY WA 6230 Saving record bunbury - 21 Queensbury Street SOUTH BUNBURY WA 6230 Saving record bunbury - 198 South Western Highway PICTON WA 6229 Saving record bunbury - 27 Spencer Street BUNBURY WA 6230 Saving record bunbury - Spencer Street SOUTH BUNBURY WA 6230 Saving record bunbury - 39 Stockley Road BUNBURY WA 6230 Saving record bunbury - 11 Stone Street BUNBURY WA 6230 Saving record bunbury - 64 Strickland Street EAST BUNBURY WA 6230 Saving record bunbury - 64 Strickland Street EAST BUNBURY WA 6230 Saving record bunbury - 161 Tuart Street SOUTH BUNBURY WA 6230 Saving record bunbury - 25 Twilight Terrace CAREY PARK WA 6230 Saving record bunbury - 2 Vittoria Road GLEN IRIS WA 6230 Saving record bunbury - 31 Wallrodt Crescent GLEN IRIS WA 6230 Saving record bunbury - 2-6 Wattle Street BUNBURY WA 6230 Saving record bunbury - 2-6 Wattle Street BUNBURY WA 6230 Saving record bunbury - 2 Webber Street CAREY PARK WA 6230 Saving record bunbury - 28 Willis Cove PELICAN POINT WA 6230 Saving record bunbury - 16 Wimbledon Way WITHERS WA 6230 Saving record bunbury - Unit 1 27 Worcestor Bend DAVENPORT WA 6230 Collecting feed data for camden, attempt: 1... Saving record camden - 13 Abercrombie Place HARRINGTON PARK NSW 2567 Saving record camden - 24 Abercrombie Place HARRINGTON PARK NSW 2567 Saving record camden - 9 Abidi Street SPRING FARM NSW 2570 Saving record camden - 26 Allambie Circuit ORAN PARK NSW 2570 Saving record camden - 28 Allambie Circuit ORAN PARK NSW 2570 Saving record camden - 122 Ballandean Boulevard GLEDSWOOD HILLS NSW 2557 Saving record camden - 9 Bextor Avenue LEPPINGTON NSW 2179 Saving record camden - 106 Brabham Drive ORAN PARK NSW 2570 Saving record camden - 45 Burnham Road GLEDSWOOD HILLS NSW 2557 Saving record camden - 46 Burnham Road GLEDSWOOD HILLS NSW 2557 Saving record camden - 48 Burnham Road GLEDSWOOD HILLS NSW 2557 Saving record camden - 50 Burnham Road GLEDSWOOD HILLS NSW 2557 Saving record camden - 59 Burnham Road GLEDSWOOD HILLS NSW 2557 Saving record camden - 890 Camden Valley Way GLEDSWOOD HILLS NSW 2557 Saving record camden - 102 Candling Road LEPPINGTON NSW 2179 Saving record camden - 51 Carmody Street LEPPINGTON NSW 2179 Saving record camden - 24 Chesterman Loop ORAN PARK NSW 2570 Saving record camden - 12 Christie Street ORAN PARK NSW 2570 Saving record camden - 1 Civic Way ORAN PARK NSW 2570 Saving record camden - 605-635 Cobbitty Road COBBITTY NSW 2570 Saving record camden - 1-5 Cohen Street GLEDSWOOD HILLS NSW 2557 Saving record camden - 39 Cohen Street GLEDSWOOD HILLS NSW 2557 Saving record camden - 230 Cut Hill Road COBBITTY NSW 2570 Saving record camden - 290 Cut Hill Road COBBITTY NSW 2570 Saving record camden - 770 Cut Hill Road COBBITTY NSW 2570 Saving record camden - 7 Dawson Avenue CAMDEN SOUTH NSW 2570 Saving record camden - Unit 3 14-16 Exchange Parade SMEATON GRANGE NSW 2567 Saving record camden - 13 Fenwick Street GLEDSWOOD HILLS NSW 2557 Saving record camden - 10 Forrest Crescent CAMDEN NSW 2570 Saving record camden - 19 Grebe Circuit ORAN PARK NSW 2570 Saving record camden - 26 Gribbin Road LEPPINGTON NSW 2179 Saving record camden - 84 Hillston Circuit GREGORY HILLS NSW 2557 Saving record camden - 88 Hillston Circuit GREGORY HILLS NSW 2557 Saving record camden - 51 Houghton Road GLEDSWOOD HILLS NSW 2557 Saving record camden - 36 Hughes Avenue HARRINGTON PARK NSW 2567 Saving record camden - 167 Ingleburn Road LEPPINGTON NSW 2179 Saving record camden - 2 Leland Street ORAN PARK NSW 2570 Saving record camden - 10 Long Street ORAN PARK NSW 2570 Saving record camden - MOUNT ANNAN MARKET PLACE Saving record camden - 39 Meridian Street LEPPINGTON NSW 2179 Saving record camden - 25 Milford Road ELLIS LANE NSW 2570 Saving record camden - 6 Oaklawn Street CURRANS HILL NSW 2567 Saving record camden - 91-93 Ridge Square LEPPINGTON NSW 2179 Saving record camden - 49 Rodeo Road GREGORY HILLS NSW 2557 Saving record camden - 18 Rowell Drive ORAN PARK NSW 2570 Saving record camden - 13 Sharp Street ORAN PARK NSW 2570 Saving record camden - Unit 2 59 Smeaton Grange Road SMEATON GRANGE NSW 2567 Saving record camden - 7 Solar Street LEPPINGTON NSW 2179 Saving record camden - 27 Stoke Place COBBITTY NSW 2570 Saving record camden - 772 The Northern Road ORAN PARK NSW 2570 Saving record camden - 3 The Outlook KIRKHAM NSW 2570 Saving record camden - 165 Turner Road GREGORY HILLS NSW 2557 Saving record camden - 20 Universe Street LEPPINGTON NSW 2565 Saving record camden - 22 Universe Street LEPPINGTON NSW 2565 Saving record camden - 27 Universe Street LEPPINGTON NSW 2565 Saving record camden - 167 Werombi Road GRASMERE NSW 2570 Collecting feed data for cairns, attempt: 1... Saving record cairns - 6-8 Alamanda Street HOLLOWAYS BEACH QLD 4878 Saving record cairns - 1 Anne Street SMITHFIELD QLD 4878 Saving record cairns - 2 Brockhurst Close REDLYNCH QLD 4870 Saving record cairns - 29A Cairns Street CAIRNS NORTH QLD 4870 Saving record cairns - 50-54 Canopy's Edge Boulevard SMITHFIELD QLD 4878 Saving record cairns - 100L Captain Cook Highway CLIFTON BEACH QLD 4879 Saving record cairns - 42 Casella Street EARLVILLE QLD 4870 Saving record cairns - 126 Cassowary Street FRESHWATER QLD 4870 Saving record cairns - 97-99 Catalano Access GOLDSBOROUGH QLD 4865 Saving record cairns - 60 Christensen Street MACHANS BEACH QLD 4878 Saving record cairns - 60 Cinderella Street MACHANS BEACH QLD 4878 Saving record cairns - Denver Street WHITE ROCK QLD 4868 Saving record cairns - Denver Street WHITE ROCK QLD 4868 Saving record cairns - 142 Dillon Street WESTCOURT QLD 4870 Saving record cairns - 98-114 Fearnley Street PORTSMITH QLD 4870 Saving record cairns - 51 Fisher Road GORDONVALE QLD 4865 Saving record cairns - Gillies Range Road LITTLE MULGRAVE QLD 4865 Saving record cairns - 48 Granadilla Drive EARLVILLE QLD 4870 Saving record cairns - 36 Hibiscus Lane HOLLOWAYS BEACH QLD 4878 Saving record cairns - 172 Hoare Street MANOORA QLD 4870 Saving record cairns - 7 Hussar Close KANIMBLA QLD 4870 Saving record cairns - 192-224 Isabella Road EDMONTON QLD 4869 Saving record cairns - 1 Jaye Street EDGE HILL QLD 4870 Saving record cairns - 156 Lake Street CAIRNS NORTH QLD 4870 Saving record cairns - 300L Laurel Avenue MOUNT SHERIDAN QLD 4868 Saving record cairns - Little Mulgrave Road LITTLE MULGRAVE QLD 4865 Saving record cairns - 127-133 Louie Piccone Way EDMONTON QLD 4869 Saving record cairns - 44L Macaranga Road BENTLEY PARK QLD 4869 Saving record cairns - Maher Road GORDONVALE QLD 4865 Saving record cairns - 6 Mayo Court REDLYNCH QLD 4870 Saving record cairns - 50A McLeod Street CAIRNS CITY QLD 4870 Saving record cairns - 146 McLeod Street CAIRNS CITY QLD 4870 Saving record cairns - 6 Miller Street PARRAMATTA PARK QLD 4870 Saving record cairns - 1L Moore Road KEWARRA BEACH QLD 4879 Saving record cairns - 3000L Moorinya Circuit MOUNT PETER QLD 4869 Saving record cairns - 3000L Moorinya Circuit MOUNT PETER QLD 4869 Saving record cairns - 187 Mulgrave Road BUNGALOW QLD 4870 Saving record cairns - 32 Poinciana Street HOLLOWAYS BEACH QLD 4878 Saving record cairns - 6 Rennel Close MOUNT SHERIDAN QLD 4868 Saving record cairns - Unit 29 9 Savaii Close PALM COVE QLD 4879 Saving record cairns - 41-43 Seaside Parade PALM COVE QLD 4879 Saving record cairns - 3 Sicilian Avenue GORDONVALE QLD 4865 Saving record cairns - 75R Stewart Road FISHERY FALLS QLD 4871 Saving record cairns - 21 Stokes Street EDMONTON QLD 4869 Saving record cairns - Stoney Creek Road KAMERUNGA QLD 4870 Saving record cairns - 13 Trevally Close KANIMBLA QLD 4870 Saving record cairns - 10 Tyrie Close EARLVILLE QLD 4870 Saving record cairns - 10 Valda Close EDMONTON QLD 4869 Saving record cairns - 65-75 Vasey Esplanade TRINITY BEACH QLD 4879 Saving record cairns - 1-7 Veivers Road PALM COVE QLD 4879 Saving record cairns - 95-97 Williams Esplanade PALM COVE QLD 4879 Collecting feed data for dorset, attempt: 1... Collecting feed data for lane_cove, attempt: 1... dorset: ERROR: Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238 /app/lib/civica_scraper/page/search.rb:10:in `period' /app/lib/civica_scraper.rb:67:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:85:in `<main>' Saving record lane_cove - 102 Arabella Street LONGUEVILLE NSW 2066 (Lot: 3 Sec: 9A DP: 5006) Saving record lane_cove - 2 Belcote Road LONGUEVILLE NSW 2066 (Lot: 7 DP: 10846) Saving record lane_cove - 32A College Rd South RIVERVIEW NSW 2066 (Lot: 2 DP: 215135) Saving record lane_cove - 29 Currawong Avenue LANE COVE WEST NSW 2066 (Lot: 85 DP: 16189) Saving record lane_cove - 40A Finlayson Street LANE COVE NSW 2066 (Lot: 812 DP: 836727) Saving record lane_cove - 47 Johnston Crescent LANE COVE NORTH NSW 2066 (Lot: 42 DP: 12792) Saving record lane_cove - 4 Lane Cove Plaza LANE COVE NSW 2066 (Lot: 5 DP: 12147) Saving record lane_cove - 7-9 Lynvale Close LANE COVE NORTH NSW 2066 (Lot: 1 DP: 900701) Saving record lane_cove - 38 Mary Street LONGUEVILLE NSW 2066 (Lot: 1 DP: 227409) Saving record lane_cove - 34 Moore Street LANE COVE WEST NSW 2066 (Lot: 1 DP: 853786) Saving record lane_cove - 5 Northwood Road LONGUEVILLE NSW 2066 (Lot: C DP: 317163) Saving record lane_cove - 5 Oak Avenue LANE COVE WEST NSW 2066 (Lot: 1 DP: 830095) lane_cove: ERROR: invalid date Collecting feed data for nambucca, attempt: 1... /app/lib/civica_scraper/page/detail.rb:17:in `strptime' /app/lib/civica_scraper/page/detail.rb:17:in `scrape' /app/lib/civica_scraper.rb:94:in `block in scrape_period' /app/lib/civica_scraper/page/index.rb:14:in `block in scrape' /app/vendor/bundle/ruby/3.2.0/gems/nokogiri-1.15.7-x86_64-linux/lib/nokogiri/xml/node_set.rb:235:in `block in each' /app/vendor/bundle/ruby/3.2.0/gems/nokogiri-1.15.7-x86_64-linux/lib/nokogiri/xml/node_set.rb:234:in `upto' /app/vendor/bundle/ruby/3.2.0/gems/nokogiri-1.15.7-x86_64-linux/lib/nokogiri/xml/node_set.rb:234:in `each' /app/lib/civica_scraper/page/index.rb:10:in `scrape' /app/lib/civica_scraper.rb:71:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:85:in `<main>' Collecting feed data for orange, attempt: 1... nambucca: ERROR: 500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/civica_scraper.rb:42:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:85:in `<main>' Collecting feed data for vincent, attempt: 1... orange: ERROR: 500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:333:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/civica_scraper.rb:42:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:85:in `<main>' Saving record vincent - 91B Anzac Road MOUNT HAWTHORN WA 6016 (LOT: 1 STR: 20860) Saving record vincent - 151 Anzac Road MOUNT HAWTHORN WA 6016 (LOT: 3 STR: 81152) Saving record vincent - 11 Barnet Street NORTH PERTH WA 6006 (LOT: 24 D/P: 1296) Saving record vincent - 15 Barnet Street NORTH PERTH WA 6006 (LOT: 1 STR: 64931) Saving record vincent - 484 Beaufort Street HIGHGATE WA 6003 (LOT: 51 D/P: 29193) Saving record vincent - 644-648 Beaufort Street MOUNT LAWLEY WA 6050 (LOT: 100 D/P: 692) Saving record vincent - 15 Blake Street NORTH PERTH WA 6006 (LOT: 3 D/P: 3660) Saving record vincent - Unit 17 1 Bourke Street NORTH PERTH WA 6006 (LOT: 17 STR: 67275) Saving record vincent - 42A Brady Street MOUNT HAWTHORN WA 6016 (LOT: 2 STR: 30553) Saving record vincent - Unit 6 115 Brisbane Street PERTH WA 6000 (LOT: 6 STR: 29323) Saving record vincent - Unit 12 212 Carr Place LEEDERVILLE WA 6007 (LOT: 12 STR: 81432) Saving record vincent - 475 Charles Street NORTH PERTH WA 6006 (LOT: 3 D/P: 555) Saving record vincent - 24 Drummond Place WEST PERTH WA 6005 (LOT: 1 D/P: 3883) Saving record vincent - 24 Drummond Place WEST PERTH WA 6005 (LOT: 1 D/P: 3883) Saving record vincent - 91 East Street MOUNT HAWTHORN WA 6016 (LOT: 123 D/P: 2099) Saving record vincent - 23 Egina Street MOUNT HAWTHORN WA 6016 (LOT: 633 D/P: 2177) Saving record vincent - 9 Emmerson Street NORTH PERTH WA 6006 (LOT: 27 D/P: 3243) Saving record vincent - 79 Fairfield Street MOUNT HAWTHORN WA 6016 (LOT: 881 D/P: 46356) Saving record vincent - 4 Fitzroy Street WEST PERTH WA 6005 (LOT: 12 D/P: 375) Saving record vincent - 93 Flinders Street MOUNT HAWTHORN WA 6016 (LOT: 152 D/P: 2503) Saving record vincent - 93 Forrest Street NORTH PERTH WA 6006 (LOT: 14 D/P: 97882) Saving record vincent - 1 Galwey Street LEEDERVILLE WA 6007 (LOT: 1 STR: 31622) Saving record vincent - 51B Galwey Street LEEDERVILLE WA 6007 (LOT: 302 D/P: 88459) Saving record vincent - 1 Glenelg Street MOUNT HAWTHORN WA 6016 (LOT: 50 D/P: 76132) Saving record vincent - 137 Grosvenor Road NORTH PERTH WA 6006 (LOT: 79 D/P: 2359) Saving record vincent - 168 Grosvenor Road NORTH PERTH WA 6006 (LOT: 2 D/P: 3834) Saving record vincent - 6 Hammond Street WEST PERTH WA 6005 (LOT: 8 D/P: 785) Saving record vincent - 13 Janet Street WEST PERTH WA 6005 (LOT: 1 STR: 8576) Saving record vincent - 25 Jugan Street MOUNT HAWTHORN WA 6016 (LOT: 134 D/P: 6275) Saving record vincent - 201 Loftus Street LEEDERVILLE WA 6007 (LOT: 19 D/P: 2330) Saving record vincent - 206 Loftus Street NORTH PERTH WA 6006 (LOT: 21 D/P: 2440) Saving record vincent - 208 Loftus Street NORTH PERTH WA 6006 (LOT: 20 D/P: 2440) Saving record vincent - 242 Loftus Street NORTH PERTH WA 6006 (LOT: 3 D/P: 2440) Saving record vincent - 33 Marian Street LEEDERVILLE WA 6007 (LOT: 4 D/P: 1210) Saving record vincent - 742 Newcastle Street LEEDERVILLE WA 6007 (LOT: 301 D/P: 416772) Saving record vincent - 306 Newcastle Street PERTH WA 6000 (LOT: 1 D/P: 5814) Saving record vincent - 567 Newcastle Street WEST PERTH WA 6005 (LOT: 7 D/P: 34714) Saving record vincent - 145 Oxford Street LEEDERVILLE WA 6007 (LOT: 4 D/P: 3984) Saving record vincent - Unit 18 7-9 Peach Street NORTH PERTH WA 6006 (LOT: 18 STR: 8754) Saving record vincent - 2 Pennant Street NORTH PERTH WA 6006 (LOT: 88 D/P: 35090) Saving record vincent - 20 Prospect Place WEST PERTH WA 6005 (LOT: 16 D/P: 30666) Saving record vincent - 54 Raglan Road MOUNT LAWLEY WA 6050 (LOT: 215 D/P: 32578) Saving record vincent - 14 Redfern Street NORTH PERTH WA 6006 (LOT: 6 D/P: 28338) Saving record vincent - 7 Roy Street MOUNT LAWLEY WA 6050 (LOT: 1 STR: 87297) Saving record vincent - 85 Scarborough Beach Road MOUNT HAWTHORN WA 6016 (LOT: 18 D/P: 2463) Saving record vincent - Unit 3 201 Scarborough Beach Road MOUNT HAWTHORN WA 6016 (LOT: 3 STR: 15340) Saving record vincent - 366 Stirling Street HIGHGATE WA 6003 (LOT: 361 D/P: 32210) Saving record vincent - 241 Stirling Street PERTH WA 6000 (LOT: 450 D/P: 301681) Saving record vincent - Unit 1 111-113 Summers Street PERTH WA 6000 (LOT: 1 STR: 56446) Saving record vincent - 34 Tasman Street MOUNT HAWTHORN WA 6016 (LOT: 475 D/P: 1939) Saving record vincent - 175 Vincent Street WEST PERTH WA 6005 (LOT: 3 D/P: 2730) Saving record vincent - 7 Violet Street WEST PERTH WA 6005 (LOT: 1 STR: 85338) Saving record vincent - 7A Violet Street WEST PERTH WA 6005 (LOT: 2 STR: 85338) Collecting feed data for wanneroo, attempt: 1... Collecting feed data for whittlesea, attempt: 1... wanneroo: ERROR: Couldn't find form daEnquiryForm for period on https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 /app/lib/civica_scraper/page/search.rb:10:in `period' /app/lib/civica_scraper.rb:67:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:85:in `<main>' Collecting feed data for woollahra, attempt: 1... whittlesea: ERROR: Failed to open TCP connection to eservice.whittlesea.vic.gov.au:443 (execution expired) /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `initialize' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `open' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1271:in `block in connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:189:in `block in timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/timeout.rb:196:in `timeout' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1269:in `connect' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1248:in `do_start' /app/vendor/ruby-3.2.2/lib/ruby/3.2.0/net/http.rb:1243:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:712:in `start' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:641:in `connection_for' /app/vendor/bundle/ruby/3.2.0/gems/net-http-persistent-4.0.6/lib/net/http/persistent.rb:942:in `request' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/http/agent.rb:284:in `fetch' /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize.rb:465:in `get' /app/lib/civica_scraper.rb:42:in `scrape_period' /app/lib/civica_scraper.rb:23:in `scrape' scraper.rb:19:in `block in scrape' scraper.rb:15:in `each' scraper.rb:15:in `scrape' scraper.rb:41:in `run' scraper.rb:85:in `<main>' Saving record woollahra - 7 Annandale Street DARLING POINT NSW 2027 (LOT: A DP: 402500) Saving record woollahra - 2 Bay Street DOUBLE BAY NSW 2028 (LOT: 1 DP: 1286687) Saving record woollahra - 6 Bayview Hill Road ROSE BAY NSW 2029 (LOT: 10 DP: 881615) Saving record woollahra - Unit 1 2 Beach Street DOUBLE BAY NSW 2028 (LOT: 7 SP: 73631) Saving record woollahra - 7 Bell Street VAUCLUSE NSW 2030 (LOT: 288 DP: 1232705) Saving record woollahra - 18 Boronia Road BELLEVUE HILL NSW 2023 (LOT: 12 SEC: G DP: 8103) Saving record woollahra - 23 Bulkara Road BELLEVUE HILL NSW 2023 (LOT: 12 SEC: 5 DP: 5816) Saving record woollahra - 7 Cranbrook Road BELLEVUE HILL NSW 2023 (LOT: 4 DP: 28700) Saving record woollahra - 19 Cranbrook Lane BELLEVUE HILL NSW 2023 (LOT: A DP: 420609) Saving record woollahra - 141 Darling Point Road DARLING POINT NSW 2027 (LOT: B DP: 316619) Saving record woollahra - 55 Drumalbyn Road BELLEVUE HILL NSW 2023 (LOT: B DP: 186880) Saving record woollahra - 2 Dumaresq Road ROSE BAY NSW 2029 (LOT: B DP: 33652) Saving record woollahra - 365 Edgecliff Road EDGECLIFF NSW 2027 (LOT: 0 SP: 40122) Saving record woollahra - 10 Edward Street WOOLLAHRA NSW 2025 (LOT: 6 DP: 115330) Saving record woollahra - 33 Elizabeth Street PADDINGTON NSW 2021 (LOT: 1 DP: 902766) Saving record woollahra - 1 Fernleigh Gardens ROSE BAY NSW 2029 (LOT: X DP: 403381) Saving record woollahra - 69 Fitzwilliam Road VAUCLUSE NSW 2030 (LOT: 1 DP: 572925) Saving record woollahra - Unit 4B Georges Road VAUCLUSE NSW 2030 (LOT: 2 SP: 105339) Saving record woollahra - 40 Glendon Road DOUBLE BAY NSW 2028 (LOT: 0 SP: 106392) Saving record woollahra - 69 Goodhope Street PADDINGTON NSW 2021 (LOT: B DP: 447467) Saving record woollahra - 1A Graylind Place VAUCLUSE NSW 2030 (LOT: B DP: 341305) Saving record woollahra - 12 Greenoaks Avenue DARLING POINT NSW 2027 (LOT: 2 DP: 1019931) Saving record woollahra - 1A Guilfoyle Avenue DOUBLE BAY NSW 2028 (MS: 999) Saving record woollahra - 22 Kulgoa Road BELLEVUE HILL NSW 2023 (LOT: 16 SEC: 4 DP: 5816) Saving record woollahra - 32 Lawson Street PADDINGTON NSW 2021 (LOT: 16 DP: 219641) Saving record woollahra - 32 Lawson Street PADDINGTON NSW 2021 (LOT: 16 DP: 219641) Saving record woollahra - 1 Macdonald Street PADDINGTON NSW 2021 (LOT: 3 DP: 78943) Saving record woollahra - 51 Manning Road DOUBLE BAY NSW 2028 (LOT: 7 DP: 8336) Saving record woollahra - 23 Marine Parade WATSONS BAY NSW 2030 (LOT: B DP: 433647) Saving record woollahra - 64-66 Oxford Street WOOLLAHRA NSW 2025 (LOT: 31 DP: 131503) Saving record woollahra - 68 Queen Street WOOLLAHRA NSW 2025 (LOT: 73 SEC: B DP: 12) Saving record woollahra - 2 Salisbury Road ROSE BAY NSW 2029 (LOT: 30 DP: 6283) Saving record woollahra - 22 Stafford Street PADDINGTON NSW 2021 (LOT: D DP: 436366) Saving record woollahra - 6 Tivoli Street PADDINGTON NSW 2021 (LOT: 24 DP: 234740) Saving record woollahra - 175 Underwood Street PADDINGTON NSW 2021 (LOT: 22 DP: 261544) Saving record woollahra - 24 Victoria Road BELLEVUE HILL NSW 2023 (LOT: 5 DP: 23041) Saving record woollahra - 142 Victoria Road BELLEVUE HILL NSW 2023 (LOT: B DP: 340491) Saving record woollahra - 61 Wallaroy Road WOOLLAHRA NSW 2025 (LOT: A DP: 386000) Saving record woollahra - 69 Wallaroy Road WOOLLAHRA NSW 2025 (LOT: 1 DP: 34400) Saving record woollahra - 19A Warren Road BELLEVUE HILL NSW 2023 (LOT: B DP: 390094) Saving record woollahra - 10 Wentworth Street POINT PIPER NSW 2027 (LOT: 0 SP: 34312) Saving record woollahra - 11A Wentworth Street POINT PIPER NSW 2027 (LOT: 0 SP: 70360) Saving record woollahra - 3 Wilberforce Avenue ROSE BAY NSW 2029 (LOT: 2 DP: 940017) Saving record woollahra - 2 William Street DOUBLE BAY NSW 2028 (LOT: 1 DP: 1121182) Saving record woollahra - Unit 1 55 William Street DOUBLE BAY NSW 2028 (LOT: 1 SP: 15996) Saving record woollahra - 58 William Street PADDINGTON NSW 2021 (LOT: 1 DP: 200621) Saving record woollahra - 60 Wunulla Road POINT PIPER NSW 2027 (LOT: 2 DP: 210150) *************************************************** Now retrying authorities which earlier had failures dorset, lane_cove, nambucca, orange, wanneroo, whittlesea *************************************************** Collecting feed data for dorset, attempt: 2...

Statistics

Total run time: less than 5 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 5.6 MB

History

  • Created on morph.io

Scraper code

Ruby

multiple_civica-prs / scraper.rb