planningalerts-scrapers / wanneroo

City Of Wanneroo Open Planning Proposals


City Of Wanneroo - Planning Proposals Scraper

  • Cookie tracking - No
  • Pagnation - yes, via a flag in json data
  • Javascript - No
  • Clearly defined data within a row - No, data is in a json record, but council reference is inconsistent, sometimes you have to look in various places on detail page
  • System - socialpinpoint and Hive (v5?) - https://docs.strangebee.com/

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

Set MORPH_AUSTRALIAN_PROXY to an Australian proxy, as yoursay.wanneroo.wa.gov.au returns 403 Forbidden to morph.io

To run the scraper

bundle exec ruby scraper.rb

Expected output

Getting planning-proposals page
  Pausing 3.16s
Getting page: 0: https://yoursay.wanneroo.wa.gov.au/ccm/the_hive_projects/tools/the_hive_projects_list/load_more/2693?page=0
/home/ianh/.local/share/mise/installs/ruby/3.2.2/lib/ruby/gems/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated.
Saving record DA2025/1791 - 33 Ocean Falls Boulevard, Mindarie, WA
Saving record DA2025/1622 - 102 Glasshouse Drive, Banksia Grove, WA
Saving record DA2025/1795 - 111 Girrawheen Avenue, Girrawheen, WA
Saving record DA2025/1536 - 64 Caraway Loop, Two Rocks, WA
Saving record DA2025/1630 - 6 Southampton Lane, Mindarie, WA
Saving record DA2025/1835 - 19 Jamaica Lane, Clarkson, WA
Saving record DA2025/1435 - 35 Blackberry Drive, Ashby, WA
Saving record DA2025/1861 - 4 Corinda Way, Ridgewood, WA
Saving record DA2025/1670 - 23 Sierra Key, Mindarie, WA
  Pausing 0.837s
Getting page: 1: https://yoursay.wanneroo.wa.gov.au/ccm/the_hive_projects/tools/the_hive_projects_list/load_more/2693?page=1
/home/ianh/.local/share/mise/installs/ruby/3.2.2/lib/ruby/gems/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated.
Saving record DA2025/1549 - 71 Waddington Crescent, Koondoola, WA
  Pausing 0.837s
  Fetching detail page: https://yoursay.wanneroo.wa.gov.au/jindalee-dap-10-multiple-dwelling-19-bowsprit-view
  Extracted DA2025/1820 from page h1 heading
Saving record DA2025/1820 - 19 Bowsprit View, Jindalee, WA
Saving record DA2025/1635 - 7 Agonis Place, Wanneroo, WA
Saving record DA2025/1821 - DAP - Commercial Development - 37 Amalfi Avenue Mindarie, WA
Saving record DA2025/1524 - 22 McPharlin Avenue, Quinns Rocks, WA
  Pausing 1.154s
  Fetching detail page: https://yoursay.wanneroo.wa.gov.au/draft-local-planning-policy-28-licensed-premises
  Extracted 21033 from contact line instruction
Saving record 21033 - Draft Local Planning Policy 2.8 - Licensed Premises, WA
  Pausing 1.371s
  Fetching detail page: https://yoursay.wanneroo.wa.gov.au/mindarie-amendment-no-234-district-planning-scheme-no-2
  Extracted 54343 from contact line instruction
Saving record 54343 - Mindarie - Amendment No. 234 to District Planning Scheme no. 2, WA
Deleting 0 applications scraped between  and 2025-12-28
  Running VACUUM to reclaim space...
Finished! Added 16 records, and skipped 0 unprocessable records from 2 pages.

Execution time: ~ 15 seconds

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors ianheggie-oaf benrfairless

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy... Getting planning-proposals page Pausing 3.013s Getting page: 0: https://yoursay.wanneroo.wa.gov.au/ccm/the_hive_projects/tools/the_hive_projects_list/load_more/2693?page=0 Saving record DA2026/1411 - Proposed Single House - 3 Lynton Court, Yanchep, WA Saving record DA2026/1475 - Proposed Change of Use - 62 Basil Avenue, Landsdale, WA Saving record DA2026/1520 - Proposed Place of Worship (Amendment) - 238 Elliot Road, Wanneroo, WA Saving record DA2026/1434 - Proposed Community Purpose Facility - 18 Franklin Road, Wanneroo, WA Saving record DA2026/1202 - Proposed Single House Addition - 16 Ocean Dr, Quinns Rocks, WA Pausing 0.888s Fetching detail page: https://yoursay.wanneroo.wa.gov.au/amendment-no-2-eglington-district-centre-precinct-structure-plan Extracted 36999 from contact line instruction Saving record 36999 - Amendment No. 2 to Eglington District Centre Precinct Structure Plan, Eglinton, WA Saving record DA2026/1398 - Proposed Single House - 46 Oregano Drive, Two Rocks, WA Saving record DA2026/1266 - Proposed Single House & Ancillary Dwelling - 20 View Tce, Quinns Rocks, WA Saving record DA2026/1370 - Proposed Single House - 79 Burnham Way, Girrawheen, WA Pausing 1.669s Getting page: 1: https://yoursay.wanneroo.wa.gov.au/ccm/the_hive_projects/tools/the_hive_projects_list/load_more/2693?page=1 Saving record DA2026/1021 - Proposed Single House Addition - 8 Alexandria View, Mindarie, WA Pausing 0.98s Fetching detail page: https://yoursay.wanneroo.wa.gov.au/east-wanneroo-cells-1-9-annual-review-cost-sharing-arrangements Unable to extract reference from: https://yoursay.wanneroo.wa.gov.au/east-wanneroo-cells-1-9-annual-review-cost-sharing-arrangements Warning - Unable to extract council reference for East Wanneroo Cells 1-9 – Annual Review of Cost Sharing Arrangements Finished! Added 10 records, and skipped 1 unprocessable records from 2 pages.

Data

Downloaded 509 times by mlandauer dcalde Manasaanand qs4v8thvrq-boop 538digital AthleticoPrawn Joel-Tan_valocity benrfairless

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (28 KB) Use the API

rows 10 / 30

council_reference address description info_url date_scraped
DA2026/993
Proposed Single House Addition - 16 Marjoram Vista, Two Rocks, WA
Two Rocks - Proposed Single House Addition - 16 Marjoram Vista
2026-11-15
DA2026/1187
Proposed Single House - 41 Graham Road, Quinns Rocks, WA
Quinns Rocks - Proposed Single House - 41 Graham Road DA2026/1187
2026-11-15
DA2026/1593
Proposed Single House Addition - 40 Barquentine Avenue, Jindalee, WA
Jindalee - Proposed Single House Addition - 40 Barquentine Avenue
2026-11-15
DA2026/1501
Proposed Multiple Dwellings - 8 Leach Road, Wanneroo, WA
Wanneroo - Proposed Multiple Dwellings - 8 Leach Road (DA2026/1501)
2026-11-15
DA2026/1401
Proposed Amendment - 24 Midsummer Avenue, Jindalee, WA
Jindalee - Proposed Amendment - 24 Midsummer Avenue (DA2026/1401)
2026-11-15
DA2026/1316
Proposed Single House Addition - 65 Conductor Retreat, Mariginiup, WA
Mariginiup - Proposed Single House Addition - 65 Conductor Retreat
2026-11-15
DA2026/1515
Proposed Home Business - 9 Rogart Bend, Butler, WA
Butler - Proposed Home Business - 9 Rogart Bend (DA2026/1515)
2026-11-15
DA2026/1422
Proposed Tavern Addition - 2 Innesvale Way, Carramar, WA
Carramar - Proposed Tavern Addition - 2 Innesvale Way (DA2026/1422)
2026-11-15
DA2026/1205
Proposed Change of Use - 17 Trafalgar Gardens, Marangaroo, WA
Marangaroo - Proposed Change of Use - 17 Trafalgar Gardens DA2026/1205
2026-11-15
DA2026/1269
Proposed Medical Centre & Pharmacy - 2 Pollino Gardens, Landsdale, WA
Landsdale - Proposed Medical Centre & Pharmacy - 2 Pollino Gardens
2026-11-15

Statistics

Average successful run time: less than 20 seconds

Total run time: 36 minutes

Total cpu time used: 5 minutes

Total disk space used: 104 KB

History

  • Auto ran revision 1b7f65bc and completed successfully .
    10 records added, 9 records removed in the database
  • Auto ran revision 1b7f65bc and completed successfully .
    9 records added, 8 records removed in the database
  • Auto ran revision 1b7f65bc and completed successfully .
    8 records added, 7 records removed in the database
  • Auto ran revision 1b7f65bc and completed successfully .
    9 records added, 8 records removed in the database
  • Auto ran revision 1b7f65bc and completed successfully .
    8 records added, 7 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wanneroo / scraper.rb