planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 20.69s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 96 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26002120 Saving record 26002120, 40 MUNDOORA RD PORT BROUGHTON SA 5522 Reusing comment email and authority from existing record: 26011684 Saving record 26011684, 193 HANCOCK RD INMAN VALLEY SA 5211 Reusing comment email and authority from existing record: 26011439 Saving record 26011439, 74 -78 HENLEY BEACH RD MILE END SA 5031 Reusing comment email and authority from existing record: 26009506 Saving record 26009506, LOT 6 RAILWAY PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26004347 Saving record 26004347, 150 -154 RUNDLE MALL ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26004812 Saving record 26004812, 207 MARINE PDE PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 26016351 Saving record 26016351, LOT 100 BAROSSA VALLEY WAY LYNDOCH SA 5351 Reusing comment email and authority from existing record: 26008258 Saving record 26008258, 11 LLOYD ST ST MARYS SA 5042 Reusing comment email and authority from existing record: 26010502 Saving record 26010502, 173 WOODFORD RD ELIZABETH NORTH SA 5113 Reusing comment email and authority from existing record: 25038393 Saving record 25038393, LOT 404 HICKMONT LANE LITTLEHAMPTON Reusing comment email and authority from existing record: 26011501 Saving record 26011501, 53 WEBB RD TINTINARA SA 5266 Reusing comment email and authority from existing record: 25036475 Saving record 25036475, 112 ROENNFELDT RD SEPPELTSFIELD SA 5355 Reusing comment email and authority from existing record: 25040246 Saving record 25040246, 83 SHUEARD RD OVERLAND CORNER SA 5330 Reusing comment email and authority from existing record: 25030670 Saving record 25030670, 66 -68 ESMOND RD PORT PIRIE SOUTH SA 5540 Reusing comment email and authority from existing record: 25040254 Saving record 25040254, 44 POSEN RD BIRDWOOD SA 5234 Reusing comment email and authority from existing record: 26012457 Saving record 26012457, 67 GRAND JUNCTION RD ROSEWATER SA 5013 Reusing comment email and authority from existing record: 26005314 Saving record 26005314, 110A MANNUM RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 26006760 Saving record 26006760, 78 THIRD AV JOSLIN SA 5070 Reusing comment email and authority from existing record: 25033204 Saving record 25033204, 11 ROMNEY RD HAPPY VALLEY SA 5159 Reusing comment email and authority from existing record: 26012643 Saving record 26012643, 69B BOYLE ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 26016138 Saving record 26016138, 9A QUEEN ELIZABETH DR BARMERA SA 5345 Reusing comment email and authority from existing record: 26012749 Saving record 26012749, 36 DARLING TCE WHYALLA SA 5600 Reusing comment email and authority from existing record: 26013204 Saving record 26013204, 2 NEWACOTT PL GOOLWA SA 5214 Reusing comment email and authority from existing record: 26000098 Saving record 26000098, 7 CAPTAIN STURT RD HINDMARSH ISLAND SA 5214 Reusing comment email and authority from existing record: 25037316 Saving record 25037316, 56 TUSCAN RD GOLDEN GROVE SA 5125 Reusing comment email and authority from existing record: 26010716 Saving record 26010716, 86 GILLMAN RD OAKBANK SA 5243 Reusing comment email and authority from existing record: 26011076 Saving record 26011076, UNIT 1-3 1A MOUNT CRAWFORD RD WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 26014024 Saving record 26014024, 61 BATTYE RD ENCOUNTER BAY SA 5211 Reusing comment email and authority from existing record: 25039504 Saving record 25039504, 31A BRIGALOW AV KENSINGTON GARDENS SA 5068 Reusing comment email and authority from existing record: 26010237 Saving record 26010237, 30 ONKAPARINGA VALLEY RD VERDUN SA 5245 Reusing comment email and authority from existing record: 26002117 Saving record 26002117, 7 THELMA AV FULHAM GARDENS SA 5024 Reusing comment email and authority from existing record: 26007961 Saving record 26007961, LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26003430 Saving record 26003430, 18 -22 HILL ST PORT ELLIOT SA 5212 Reusing comment email and authority from existing record: 25027428 Saving record 25027428, 19388 STURT HWY MONASH SA 5342 Reusing comment email and authority from existing record: 26009868 Saving record 26009868, 287 NORTH EAST RD HAMPSTEAD GARDENS SA 5086 Reusing comment email and authority from existing record: 26011454 Saving record 26011454, 19 GALE RD EVANSTON SOUTH SA 5116 Reusing comment email and authority from existing record: 26015537 Saving record 26015537, 236 TANUNDA CREEK RD FLAXMAN VALLEY SA 5235 Reusing comment email and authority from existing record: 26007757 Saving record 26007757, 346 BLEWITT SPRINGS RD BLEWITT SPRINGS SA 5171 Reusing comment email and authority from existing record: 26007274 Saving record 26007274, 26 FRONTENAC AV PANORAMA SA 5041 Reusing comment email and authority from existing record: 26013292 Saving record 26013292, 13 FOURTH AV ST MORRIS SA 5068 Reusing comment email and authority from existing record: 26003340 Saving record 26003340, 533 THE PARADE MAGILL SA 5072 Reusing comment email and authority from existing record: 26013522 Saving record 26013522, 37 GARTRELL BVD CRAIGBURN FARM SA 5051 Reusing comment email and authority from existing record: 26011472 Saving record 26011472, 58 -66 ST KILDA RD WATERLOO CORNER SA 5110 Reusing comment email and authority from existing record: 26000778 Saving record 26000778, 168 DERRICK RD LOXTON NORTH SA 5333 Reusing comment email and authority from existing record: 26013377 Saving record 26013377, 2B HAWKER RD BURTON SA 5110 Reusing comment email and authority from existing record: 23031694 Saving record 23031694, 720 WHITE RIVER RD TUMBY BAY SA 5605 Reusing comment email and authority from existing record: 26016308 Saving record 26016308, UNIT 1 6 WILSON CT GRANGE SA 5022 Reusing comment email and authority from existing record: 26000366 Saving record 26000366, 4366 VICTOR HARBOR RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26010016 Saving record 26010016, LOT 40 VICTOR HARBOR RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 25038850 Saving record 25038850, 17736 PRINCES HWY COORONG SA 5264 Reusing comment email and authority from existing record: 26015724 Saving record 26015724, UNIT 3 6 HERIOT ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25000819 Saving record 25000819, 110 -112 TOLLEY RD ST AGNES SA 5097 Reusing comment email and authority from existing record: 25012386 Saving record 25012386, LOT 58 LIMEROCK RD LOWER LIGHT SA 5501 Reusing comment email and authority from existing record: 26010328 Saving record 26010328, 64 OCEAN PDE MIDDLETON SA 5213 Reusing comment email and authority from existing record: 26007001 Saving record 26007001, 846 GRAND JUNCTION RD GILLES PLAINS SA 5086 Reusing comment email and authority from existing record: 26002370 Saving record 26002370, 37 GREVILLEA WAY BLACKWOOD SA 5051 Reusing comment email and authority from existing record: 25037579 Saving record 25037579, 137 JOHN LEWIS DR PORT BROUGHTON SA 5522 Reusing comment email and authority from existing record: 26012119 Saving record 26012119, 114 CHELLASTON RD MUNNO PARA WEST SA 5115 Reusing comment email and authority from existing record: 26007442 Saving record 26007442, 45 PORT ELLIOT RD PORT ELLIOT SA 5212 Reusing comment email and authority from existing record: 25031162 Saving record 25031162, 63 LIGHT RD COROMANDEL VALLEY SA 5051 Reusing comment email and authority from existing record: 26012758 Saving record 26012758, 13 FRENCH ST NETHERBY SA 5062 Reusing comment email and authority from existing record: 26013767 Saving record 26013767, 17 JARRAH WAY MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26002894 Saving record 26002894, UNIT 2 331 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26006077 Saving record 26006077, LOT 500 CEMETERY RD TAUNTON SA 5235 Reusing comment email and authority from existing record: 26004551 Saving record 26004551, 22 FOURTH ST GAWLER SOUTH SA 5118 Reusing comment email and authority from existing record: 25040006 Saving record 25040006, 173 -175 GRANGE RD FINDON SA 5023 Reusing comment email and authority from existing record: 26015365 Saving record 26015365, 36 BUTTROSE ST GLENELG EAST SA 5045 Reusing comment email and authority from existing record: 26010337 Saving record 26010337, 23 HARRIS ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26010814 Saving record 26010814, 1 BRUMBY CT KAPUNDA SA 5373 Reusing comment email and authority from existing record: 26012787 Saving record 26012787, 61 -79 MARION RD COWANDILLA SA 5033 Reusing comment email and authority from existing record: 26006138 Saving record 26006138, 3 RINGMER DR BURNSIDE SA 5066 Reusing comment email and authority from existing record: 26015597 Saving record 26015597, 1 RITANA RD MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26000424 Saving record 26000424, 197 RAL RAL AV RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 26014796 Saving record 26014796, 35 FIEDLER ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26006698 Saving record 26006698, 304 NORTON SUMMIT RD TERINGIE SA 5072 Reusing comment email and authority from existing record: 26007645 Saving record 26007645, LOT 125 GASTON RD FISHER SA 5354 Reusing comment email and authority from existing record: 25040288 Saving record 25040288, 290A SIR DONALD BRADMAN DR BROOKLYN PARK SA 5032 Reusing comment email and authority from existing record: 26004771 Saving record 26004771, 2 BARR AV MITCHAM SA 5062 Reusing comment email and authority from existing record: 26009886 Saving record 26009886, 2 HOOKING AV ROYSTON PARK SA 5070 Reusing comment email and authority from existing record: 26015929 Saving record 26015929, 5 SHELLEY ST FIRLE SA 5070 Reusing comment email and authority from existing record: 26011120 Saving record 26011120, 19128 STURT HWY MONASH SA 5342 Reusing comment email and authority from existing record: 26008341 Saving record 26008341, 254 NORTH TCE ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26012430 Saving record 26012430, 3 LYTTON ST QUORN SA 5433 Reusing comment email and authority from existing record: 26014622 Saving record 26014622, 41 GEORGE ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26012943 Saving record 26012943, 184 FISHER ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26013875 Saving record 26013875, LOT 63 COWELL-KIMBA RD MINBRIE SA 5602 Reusing comment email and authority from existing record: 25005507 Saving record 25005507, 1 BORROW DR BURNSIDE SA 5066 Reusing comment email and authority from existing record: 24026805 Saving record 24026805, 1116 PORT ELLIOT RD MIDDLETON SA 5213 Reusing comment email and authority from existing record: 26009707 Saving record 26009707, 29 -31 AUSTRAL TCE MORPHETTVILLE SA 5043 Reusing comment email and authority from existing record: 26013131 Saving record 26013131, 36 DAVENPORT TCE WAYVILLE SA 5034 Reusing comment email and authority from existing record: 26006670 Saving record 26006670, 5 CORBYN CT MOANA SA 5169 Reusing comment email and authority from existing record: 26010639 Saving record 26010639, 52 HENRY ST WEST CROYDON SA 5008 Reusing comment email and authority from existing record: 26008105 Saving record 26008105, 22 PANMURE PL WOODVILLE NORTH SA 5012 Reusing comment email and authority from existing record: 25030989 Saving record 25030989, 28 SALEYARDS RD MILLICENT SA 5280 Reusing comment email and authority from existing record: 26009919 Saving record 26009919, 13 INVERLOCH AV TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26011183 Saving record 26011183, 1229 NORTH EAST RD RIDGEHAVEN SA 5097 First Application data retrieved: {"publicNotificationID"=>13343, "applicationID"=>26002120, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"40 MUNDOORA RD PORT BROUGHTON SA 5522", "developmentDescription"=>"Single storey detached dwelling, and partial change of use of existing agricultural building to home based industry (up to 66m²) for the processing of fresh fish", "closingDate"=>"6/26/2026 12:00:00 AM", "decisionAuthority"=>"Barunga West Council", "relevantAuthority"=>"Barunga West Council", "locationCouncil"=>"BARUNGA WEST COUNCIL", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1055540, "applicationId"=>26002120, "contactName"=>"Dennis Chung ", "address"=>" "}, {"interestedPartyId"=>1055541, "applicationId"=>26002120, "contactName"=>"ANDREW HEWETT ", "address"=>"8 MILDREN AVENUE PORT BROUGHTON 5522"}]} Found 96 applications that were already in the database, and added 0 new applications. Added 20.69 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 4 Adelaide Hills Council 1 Adelaide Plains Council 6 Alexandrina Council 2 Barunga West Council 1 City of Adelaide 4 City of Burnside 6 City of Charles Sturt 1 City of Holdfast Bay 7 City of Mitcham 2 City of Mt Gambier 6 City of Norwood, Payneham and St. Peters 5 City of Onkaparinga 2 City of Playford 2 City of Port Adelaide Enfield 1 City of Prospect 2 City of Salisbury 4 City of Tea Tree Gully 2 City of Unley 2 City of Victor Harbor 3 City of West Torrens 1 City of Whyalla 1 District Council of Franklin Harbour 1 District Council of Kingston 1 District Council of Loxton Waikerie 1 District Council of Tumby Bay 1 Flinders Ranges Council 2 Light Regional Council 1 Mid Murray Council 3 Mount Barker District Council 1 Port Pirie Regional Council 1 Rural City of Murray Bridge 7 State Planning Commission 4 The Barossa Council 4 The Berri Barmera Council 1 The Coorong District Council 2 Town of Gawler 1 Wattle Range Council

Data

Downloaded 4784 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke AthleticoPrawn softgrow qs4v8thvrq-boop DevAppProject odnagroup ianheggie-oaf MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.9 MB) Use the API

rows 10 / 74618

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    96 records added, 96 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    96 records added, 84 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and failed .
    nothing changed in the database
  • Auto ran revision b38f71b9 and completed successfully .
    104 records added, 96 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    102 records added, 102 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb