planningalerts-scrapers / surf_coast

Surf Coast Shire Council Development Applications

README.md

Archived as it is replaced by the multiple_t1_data_table scraper

Surf Coast Shire Council Development Applications for PlanningAlerts

Note that the system on the council side that is showing the development applications is the same as used by Stonnington. At some point it might be worthwhile to combine these two scrapers into one.

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

Set MORPH_AUSTRALIAN_PROXY to an Australian proxy, preferably one that rotates its IP address

Expected Output

Requesting pageful of details ...
Storing 26/0097 - 3410 Princes Highway, WINCHELSEA VIC 3241
Storing 26/0098 - 35 ODonohue Road, ANGLESEA VIC 3230
...
Storing 26/0093 (VicSmart) - 49 Wybellenna Drive, FAIRHAVEN VIC 3231
Storing PG19/0086 - 2 - 125 Austin Street, WINCHELSEA VIC 3241 & 135 Austin Street and 50 Witcombe Street and part 235 Austin Street, WINCHELSEA VIC 3241
Requesting pageful of details ...
...
Storing 26/0073 - 2 Cottage Crescent, TORQUAY VIC 3228
Finished - processed 44 records

Expected runtime: ~ 5 seconds

To run the scraper

bundle exec ruby scraper.rb

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors mlandauer daveslutzkin LoveMyData henare MichaelBone benrfairless ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0323 - 5 Sky Court, JAN JUC VIC 3228 Storing 26/0324 - 25/18-22 Castles Drive, TORQUAY VIC 3228 Storing 26/0178 - PC1 (VicSmart) - 22 Beach View Crescent, TORQUAY VIC 3228 Storing 26/0179 - PC1 (VicSmart) - 22 Beach View Crescent, TORQUAY VIC 3228 Storing 26/0321 - 70 Darian Road, TORQUAY VIC 3228 Storing 22/0106-2 - 1A McMahon Avenue, ANGLESEA VIC 3230 Storing 26/0322 - 155 Blackgate Road, BREAMLEA VIC 3227 Storing 23/0349 - 1 - PC2 - 30 Willis Street, WINCHELSEA VIC 3241 & 31 Austin Street, WINCHELSEA VIC 3241 & 28 Willis Street, WINCHELSEA VIC 3241 & 24 Willis Street, WINCHELSEA VIC 3241 Storing 26/0190-1 (VicSmart) - 16 Lubel Street, ANGLESEA VIC 3230 Storing 26/0213 - PC1 - 114 Geelong Road, TORQUAY VIC 3228 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 25/0313 - PC1 - 49 Richardson Boulevard, LORNE VIC 3232 Storing 25/0382 - PC1 - 23 Albert Street, LORNE VIC 3232 Storing 26/0318 (VicSmart) - "QUIKSILVER/ROXY WAREHOUSE SHOP", 15 Baines Crescent, TORQUAY VIC 3228 Storing 26/0319 - 165 Great Ocean Road, ANGLESEA VIC 3230 Storing 26/0320 - 305 Parkers Road, DEANS MARSH VIC 3235 Storing 20/0448 - 1 - PC22 - 235 AUSTIN STREET, WINCHELSEA VIC 3241 & 50 WITCOMBE STREET, WINCHELSEA VIC 3241 & 135 AUSTIN STREET, WINCHELSEA VIC 3241 Storing 25/0103 - PC2 - 15 Illawong Drive, TORQUAY VIC 3228 Storing 02/0157-1 - 106 Beach Road, TORQUAY VIC 3228 Storing 26/0316 - 1 St Georges Way, TORQUAY VIC 3228 Storing 26/0317 - 900 Mt Duneed Road, FRESHWATER CREEK VIC 3217 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0245-1 (VicSmart) - 70 Aireys Street, AIREYS INLET VIC 3231 Storing 26/0211 - PC1 - 33 Third Avenue, ANGLESEA VIC 3230 Storing 26/0312 - 128 Strathmore Drive, JAN JUC VIC 3228 Storing 26/0313 - 28 Deans Marsh Road, LORNE VIC 3232 Storing 26/0314 (VicSmart) - 40 Main Street, WINCHELSEA VIC 3241 Storing 26/0315 - 31 Hopetoun Terrace, LORNE VIC 3232 Storing 15/0476 - PC2 - 235 Coombes Road, TORQUAY VIC 3228 Storing 26/0311 - COOMBE COTTAGE, 70 Lauders Lane, WINCHELSEA VIC 3241 & COOMBE COTTAGE, 64 Lauders Lane, WINCHELSEA VIC 3241 Storing 26/0308 (VicSmart) - 22 McMillan Street, ANGLESEA VIC 3230 Storing 26/0309 (VicSmart) - 12 Stuart Avenue, JAN JUC VIC 3228 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0310 (VicSmart) - 18 Strathcairn Avenue, JAN JUC VIC 3228 Storing 26/0307 - 85 Ocean Boulevard, JAN JUC VIC 3228 Storing 14/0026 - 8 - PC7 - LOT "G04" - RESTAURANT, 4/141 Great Ocean Road, ANGLESEA VIC 3230 & 137-141 GREAT OCEAN ROAD, ANGLESEA VIC 3230 Storing 26/0071 - PC1 - 8 Yellow Gum Place, TORQUAY VIC 3228 Storing 26/0306 - 45 Charles Street, LORNE VIC 3232 Storing 22/0483-1 - 415 Gundrys Road, BELLBRAE VIC 3228 Storing 24/0168-3 - 125 Briody Drive, TORQUAY VIC 3228 & 31 Illawong Drive, TORQUAY VIC 3228 & 111 Briody Drive, TORQUAY VIC 3228 & 119 Briody Drive, TORQUAY VIC 3228 & 95 Briody Drive, TORQUAY VIC 3228 & 105 Briody Drive, TORQUAY VIC 3228 & 120 Grossmans Road, TORQUAY VIC 3228 & 96 Grossmans Road, TORQUAY VIC 3228 Storing 25/0388 - PC1 - 47 ODonohue Road, ANGLESEA VIC 3230 Storing 26/0304 - 1 Willis Street, WINCHELSEA VIC 3241 Storing 26/0305 - 2/43 Dorman Street, LORNE 3232 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0271-1 (VicSmart) - 28 Hopkins Street, WINCHELSEA VIC 3241 Storing 24/0081-2 - 73 The Esplanade, TORQUAY VIC 3228 Storing 25/0023 - 1 - PC4 - 13 Waverley Avenue, LORNE VIC 3232 & 10 Erskine Avenue, LORNE VIC 3232 Storing 24/0279 - 1 - PC1 - BARWON RIVER RESERVE, 4 Barwon Terrace, WINCHELSEA VIC 3241 Storing 26/0058 - PC1 - 30 Melba Parade, ANGLESEA VIC 3230 Storing 26/0104 - PC1 - 74 Bingley Parade, ANGLESEA VIC 3230 Storing 26/0302 - 8 Belton Street, ANGLESEA VIC 3230 Storing 26/0168-1 - 24 Delview Drive, JAN JUC VIC 3228 Storing 26/0303 - 13 Beales Street, TORQUAY VIC 3228 Storing 26/0200 - PC1 - 69 Fraser Avenue, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0300 (VicSmart) - 13 Sands Terrace, TORQUAY VIC 3228 Storing 26/0301 (VicSmart) - 3 Nancy Street, AIREYS INLET VIC 3231 Storing 23/0127-2 - 460 Grossmans Road, BELLBRAE VIC 3228 Storing 26/0168 - PC1 - 24 Delview Drive, JAN JUC VIC 3228 Storing 20/0448 - 1 - PC21 - 50 WITCOMBE STREET, WINCHELSEA VIC 3241 & 235 AUSTIN STREET, WINCHELSEA VIC 3241 & 135 AUSTIN STREET, WINCHELSEA VIC 3241 Storing 26/0296 - 11 Anderson Street, WINCHELSEA VIC 3241 Storing 26/0297 - 4 Elizabeth Street, ANGLESEA VIC 3230 Storing 25/0296-1 - 285 Nortons Road, BELLBRAE VIC 3228 & 250 Vickerys Road, BELLBRAE VIC 3228 Storing 26/0298 (VicSmart) - 3/12 Cylinders Drive, TORQUAY VIC 3228 Storing 26/0299 - 42 Parker Street, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0293 - 19 Yandanah Road, FAIRHAVEN VIC 3231 Storing 25/0023-2 - 13 Waverley Avenue, LORNE VIC 3232 & 10 Erskine Avenue, LORNE VIC 3232 Storing 26/0294 (VicSmart) - 15 Birkdale Close, ANGLESEA VIC 3230 Storing 26/0295 (VicSmart) - 13 Dunkeith Avenue, JAN JUC VIC 3228 Storing 26/0218 - PC1 - 12 Smith Street, WINCHELSEA VIC 3241 Storing 20/0552 - PC3 - 20A Coombes Road, TORQUAY VIC 3228 Storing 25/0213 - PC1 - 5 Francis Street, LORNE VIC 3232 & 5 Francis Street, LORNE VIC 3232 Storing 26/0290 - 890 Great Ocean Road, BELLBRAE VIC 3228 Storing 26/0291 (VicSmart) - 4/40 The Esplanade, TORQUAY VIC 3228 & 3/40 The Esplanade, TORQUAY VIC 3228 Storing 26/0292 (VicSmart) - 14 Cameron Road, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0082 - PC1 - 31-33 Railway Terrace, DEANS MARSH VIC 3235 Storing 26/0240 - PC1 - 95 Monahans Road, GNARWARRE VIC 3221 Storing 23/0132-1 - 13 Jackson Street, ANGLESEA VIC 3230 Storing 24/0254-1 - 13 Jackson Street, ANGLESEA VIC 3230 Storing 26/0288 - 40 Old Lorne Road, DEANS MARSH VIC 3235 Storing 25/0160-1 - 3 Supertubes Drive, TORQUAY VIC 3228 Storing 26/0289 - 8/18-22 Castles Drive, TORQUAY VIC 3228 Storing 25/0316 - PC1 - 32 Cylinders Drive, TORQUAY VIC 3228 Storing 26/0193-2 - 20 Warner Street, WINCHELSEA VIC 3241 Storing 26/0287 - 1 First Avenue, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0259 - PC1 - 5 Zeally Bay Road, TORQUAY VIC 3228 Finished - processed 81 records

Data

Downloaded 6050 times by openaustralia mlandauer dcalde LoveMyData jesse-a-reilly tkrikke repose-lecture DevAppProject TheZepto Manasaanand 538digital davidyu37 Shawnyu0217 Jedwards157 MichaelBone odnagroup planometric-vic MikeRalphson GitHubMLee TornMarketing

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.83 MB) Use the API

rows 10 / 4022

date_scraped description info_url address council_reference on_notice_from on_notice_to comment_url date_received
2012-04-25
Use of the land to sell and consume liquor
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Merrijig_Drive_Torquay
1 Merrijig Drive, Torquay, VIC
12/0118
2012-04-26
2012-05-10
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Merrijig_Drive_Torquay
2012-04-25
Construction of a dwelling with a building site coverage greater than 150m2
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/9_Hedley_Street_Anglesea
9 Hedley Street, Anglesea, VIC
12/0099
2012-04-26
2012-05-10
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/9_Hedley_Street_Anglesea
2012-04-25
Subdivision of the land into two lots
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1B_River_Reserve_Road_Anglesea
1B River Reserve Road, Anglesea, VIC
12/0010
2012-04-25
2012-05-09
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1B_River_Reserve_Road_Anglesea
2012-04-25
Construction of a dwelling with a maximum building height in excess of 7.5 metres
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/14_Glengarry_Drive_Torquay
14 Glengarry Drive, Torquay, VIC
12/0112
2012-04-24
2012-05-08
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/14_Glengarry_Drive_Torquay
2012-04-25
Development of buildings and works (dwelling alterations and additions)
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/2_Dorman_Street_Lorne
2 Dorman Street, Lorne, VIC
10/0222
2012-04-24
2012-05-08
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/2_Dorman_Street_Lorne
2012-04-25
Construction of a fence
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Holding_Court_Anglesea
1 Holding Court, Anglesea, VIC
12/0113
2012-04-20
2012-05-04
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Holding_Court_Anglesea
2012-04-25
Subdivision of the land into three lots
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/625_Cape_Otway_Road_Moriac
625 Cape Otway Road, Moriac, VIC
11/0181
2012-04-23
2012-05-07
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/625_Cape_Otway_Road_Moriac
2012-04-25
Alterations and additions to an existing dwelling with a maximum height greater than 5m
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/110_Melba_Parade_Anglesea
110 Melba Parade, Anglesea, VIC
12/0091
2012-04-17
2012-05-01
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/110_Melba_Parade_Anglesea
2012-04-25
Subdivision of the land into four lots
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/44_Jackson_Street_Winchelsea
44 Jackson Street, Winchelsea, VIC
12/0074
2012-04-13
2012-04-27
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/44_Jackson_Street_Winchelsea
2012-04-25
Construction of a relocated dwelling
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/197_Great_Ocean_Road_Anglesea
197 Great Ocean Road, Anglesea, VIC
12/0085
2012-04-11
2012-04-25
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/197_Great_Ocean_Road_Anglesea

Statistics

Average successful run time: less than a minute

Total run time: 9 days

Total cpu time used: about 1 hour

Total disk space used: 1.9 MB

History

  • Auto ran revision e44795b8 and completed successfully .
    81 records added, 81 records removed in the database
  • Auto ran revision e44795b8 and completed successfully .
    86 records added, 86 records removed in the database
  • Auto ran revision e44795b8 and completed successfully .
    88 records added, 88 records removed in the database
  • Auto ran revision e44795b8 and completed successfully .
    90 records added, 84 records removed in the database
  • Auto ran revision e44795b8 and completed successfully .
    87 records added, 84 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

surf_coast / scraper.rb