planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 18.86s to avoid 429 Too Many Requests errors Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 97 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 25035339 Saving record 25035339, 63A PARK TCE OVINGHAM SA 5082 Reusing comment email and authority from existing record: 26023964 Saving record 26023964, UNIT 2 26 -42 LONDON RD MILE END SOUTH SA 5031 Reusing comment email and authority from existing record: 26022654 Saving record 26022654, 25 GILES ST TOORAK GARDENS SA 5065 Reusing comment email and authority from existing record: 26015374 Saving record 26015374, 31 SMITH ST THEBARTON SA 5031 Reusing comment email and authority from existing record: 26017871 Saving record 26017871, 17 HIGHLANDS CT WOODFORDE SA 5072 Reusing comment email and authority from existing record: 26008941 Saving record 26008941, 1 ADELE AV KIDMAN PARK SA 5025 Reusing comment email and authority from existing record: 26017424 Saving record 26017424, 82 NICOLAI RD ROCKY GULLY SA 5254 Reusing comment email and authority from existing record: 26023799 Saving record 26023799, UNIT 2 27A TOLMIE ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26019362 Saving record 26019362, 187 TATACHILLA RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 26021735 Saving record 26021735, UNIT 1 54 COTTAGE LANE HACKHAM SA 5163 Reusing comment email and authority from existing record: 25040452 Saving record 25040452, 254 MELBOURNE ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26019301 Saving record 26019301, 2 YOEY CT MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26020860 Saving record 26020860, 2 MAXWELL TCE EMU BAY SA 5223 Reusing comment email and authority from existing record: 26023907 Saving record 26023907, 29 LIGHT CR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26009215 Saving record 26009215, 329 SWAMP RD BALHANNAH SA 5242 Reusing comment email and authority from existing record: 26019813 Saving record 26019813, 14 PENONG ST HYDE PARK SA 5061 Reusing comment email and authority from existing record: 26021226 Saving record 26021226, 233 POLISH HILL RIVER RD POLISH HILL RIVER SA 5453 Reusing comment email and authority from existing record: 25038398 Saving record 25038398, 185 -199 ARCHER ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26024782 Saving record 26024782, 19 WILLIAM ST ALBERTON SA 5014 Reusing comment email and authority from existing record: 26009745 Saving record 26009745, 165 MCVITTIES RD BIRDWOOD SA 5234 Reusing comment email and authority from existing record: 26023339 Saving record 26023339, 5 FOSTER ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26020314 Saving record 26020314, 26 TOBRUK AV KENSINGTON PARK SA 5068 Reusing comment email and authority from existing record: 26012856 Saving record 26012856, 278 TATACHILLA RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 26020575 Saving record 26020575, 18 OLIVERS PDE HAYBOROUGH SA 5211 Reusing comment email and authority from existing record: 25001262 Saving record 25001262, 279 SAMPSON RD MYPONGA BEACH SA 5202 Reusing comment email and authority from existing record: 26020146 Saving record 26020146, 64 ADELAIDE RD HAYBOROUGH SA 5211 Reusing comment email and authority from existing record: 26021929 Saving record 26021929, LOT 61 WELLS ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26022811 Saving record 26022811, UNIT 7 24 COMMERCIAL ST MARLESTON SA 5033 Reusing comment email and authority from existing record: 26022616 Saving record 26022616, 74 -74A MELBOURNE ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26019008 Saving record 26019008, 18 BRIAR AV MEDINDIE SA 5081 Reusing comment email and authority from existing record: 26020234 Saving record 26020234, 14 ANN ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 25028168 Saving record 25028168, 3029 RIDDOCH HWY WILLALOOKA SA 5267 Reusing comment email and authority from existing record: 25001452 Saving record 25001452, 624 GREENHILL RD BURNSIDE SA 5066 Reusing comment email and authority from existing record: 26008150 Saving record 26008150, 59 ARCHER ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26023378 Saving record 26023378, 19A EMILY ST MILLICENT SA 5280 Reusing comment email and authority from existing record: 25038472 Saving record 25038472, 23 OLAVE HILL RD UPPER STURT SA 5156 Reusing comment email and authority from existing record: 26013913 Saving record 26013913, LOT 52 FLETCHER RD ELIZABETH EAST SA 5112 Reusing comment email and authority from existing record: 25040602 Saving record 25040602, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26010679 Saving record 26010679, 9 STELLA ST DARLINGTON SA 5047 Reusing comment email and authority from existing record: 26005514 Saving record 26005514, 67 LUHRS RD PAYNEHAM SOUTH SA 5070 Reusing comment email and authority from existing record: 26017876 Saving record 26017876, LOT 3 KINGSTON RD PYAP SA 5333 Reusing comment email and authority from existing record: 25040132 Saving record 25040132, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26019658 Saving record 26019658, 62 AYTON AV FULHAM SA 5024 Reusing comment email and authority from existing record: 25008904 Saving record 25008904, 59 -61 GRANGE RD WELLAND SA 5007 Reusing comment email and authority from existing record: 26018035 Saving record 26018035, 6 ALPHA CR PANORAMA SA 5041 Reusing comment email and authority from existing record: 26013955 Saving record 26013955, 64 BELLMORE RD WISANGER SA 5223 Reusing comment email and authority from existing record: 26022786 Saving record 26022786, 3 HILLCREST DR EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 26021756 Saving record 26021756, 41 WELLS ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26018546 Saving record 26018546, 14 ESPLANADE SELLICKS BEACH SA 5174 Reusing comment email and authority from existing record: 26009650 Saving record 26009650, 10 FOURTH ST WINGFIELD SA 5013 Reusing comment email and authority from existing record: 26020663 Saving record 26020663, 2B BAKEWELL ST TUSMORE SA 5065 Reusing comment email and authority from existing record: 26018820 Saving record 26018820, 7 -9 GAYNOR AV KEITH SA 5267 Reusing comment email and authority from existing record: 26015207 Saving record 26015207, 23 VICTORIA ST HAHNDORF SA 5245 Reusing comment email and authority from existing record: 26021409 Saving record 26021409, 4 OWEN ST TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26018969 Saving record 26018969, 1 -3 MOSELEY ST GLENELG SA 5045 Reusing comment email and authority from existing record: 26017036 Saving record 26017036, 7 OMAR PL UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 26019703 Saving record 26019703, 3 BONVIEW AV PANORAMA SA 5041 Reusing comment email and authority from existing record: 26014434 Saving record 26014434, 57 ROEBUCK ST MILE END SA 5031 Reusing comment email and authority from existing record: 26023626 Saving record 26023626, 110 NEWELL AV MIDDLETON SA 5213 Reusing comment email and authority from existing record: 26021583 Saving record 26021583, 438 TAYLORS RD VIRGINIA SA 5120 Reusing comment email and authority from existing record: 26018979 Saving record 26018979, LOT 1 SNAPPER HILL RD WANGARY SA 5607 Reusing comment email and authority from existing record: 26014625 Saving record 26014625, 1 GILES ST TOORAK GARDENS SA 5065 Reusing comment email and authority from existing record: 26016411 Saving record 26016411, LOT 1001 PARK LAKE BVD BLAKEVIEW SA 5114 Reusing comment email and authority from existing record: 25037077 Saving record 25037077, 20 SEAVIEW DR PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 25040600 Saving record 25040600, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26020189 Saving record 26020189, UNIT 1-9 183 PHILIP HWY ELIZABETH SOUTH SA 5112 Reusing comment email and authority from existing record: 25040601 Saving record 25040601, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26014751 Saving record 26014751, 5 KALEV CT HAPPY VALLEY SA 5159 Reusing comment email and authority from existing record: 26023142 Saving record 26023142, 13 FRANK ST ST MORRIS SA 5068 Reusing comment email and authority from existing record: 25034514 Saving record 25034514, LOT 1 SMITH HILL RD CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 26023705 Saving record 26023705, 44 FREDERICK ST MAYLANDS SA 5069 Reusing comment email and authority from existing record: 26017522 Saving record 26017522, UNIT 1 4 TRIMMER RD ELIZABETH SOUTH SA 5112 Reusing comment email and authority from existing record: 26023951 Saving record 26023951, 135 -140 EAST TCE ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26020624 Saving record 26020624, 152 MAURICE RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 25032103 Saving record 25032103, LOT 1 DE MANNU RD MUNNO PARA DOWNS SA 5115 Reusing comment email and authority from existing record: 26023343 Saving record 26023343, 39 HERO AV MIDDLETON SA 5213 Reusing comment email and authority from existing record: 25038776 Saving record 25038776, 17 O'HALLORAN TCE MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26022248 Saving record 26022248, 5 MAJORS RD O'HALLORAN HILL SA 5158 Reusing comment email and authority from existing record: 26009103 Saving record 26009103, 137 KENSINGTON RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26011456 Saving record 26011456, 20 LEWIS RD CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 26022133 Saving record 26022133, 187 NORTH EAST RD HAMPSTEAD GARDENS SA 5086 Reusing comment email and authority from existing record: 26022747 Saving record 26022747, 83 MINTARO RD MINTARO SA 5415 Reusing comment email and authority from existing record: 25039620 Saving record 25039620, 506 CROSS RD GLANDORE SA 5037 Reusing comment email and authority from existing record: 25040599 Saving record 25040599, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 23031960 Saving record 23031960, 1016 GREENHILL RD SUMMERTOWN SA 5141 Reusing comment email and authority from existing record: 26023313 Saving record 26023313, 11 COLLEGE RD KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26015050 Saving record 26015050, 15 ARABRIE AV EDWARDSTOWN SA 5039 Reusing comment email and authority from existing record: 26025500 Saving record 26025500, 7 SENNA RD WINGFIELD SA 5013 Reusing comment email and authority from existing record: 24035616 Saving record 24035616, 53 GOODWOOD RD WAYVILLE SA 5034 Reusing comment email and authority from existing record: 26018498 Saving record 26018498, 218 STRANGWAYS RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26022061 Saving record 26022061, 64 MORCOMBE RD MOONTA MINES SA 5558 Reusing comment email and authority from existing record: 26015690 Saving record 26015690, LOT 121 PORTLAND ST PENOLA SA 5277 Reusing comment email and authority from existing record: 26021717 Saving record 26021717, 2 -3 AROHA TCE FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26022564 Saving record 26022564, 20 DRUID AV STIRLING SA 5152 Reusing comment email and authority from existing record: 26021132 Saving record 26021132, 2A PORTRUSH RD PAYNEHAM SA 5070 Reusing comment email and authority from existing record: 26023500 Saving record 26023500, 27 MARLBOROUGH ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26022765 Saving record 26022765, 51 STEPHEN TCE ST PETERS SA 5069 First Application data retrieved: {"publicNotificationID"=>13755, "applicationID"=>26023343, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"39 HERO AV MIDDLETON SA 5213", "developmentDescription"=>"Demolition of the existing dwelling and, construction of a new two-storey detached dwelling with retaining walls up to 2.25m in height including associated earthworks and infrastructure", "closingDate"=>"9/3/2026 12:00:00 AM", "decisionAuthority"=>"Fleurieu Regional Assessment Panel", "relevantAuthority"=>"Alexandrina Council", "locationCouncil"=>"ALEXANDRINA COUNCIL", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1163143, "applicationId"=>26023343, "contactName"=>"Scott Salisbury Homes ", "address"=>"474B ANZAC HIGHWAY CAMDEN PARK 5038"}]} Found 97 applications that were already in the database, and added 0 new applications. Added 18.86 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 5 Adelaide Hills Council 2 Alexandrina Council 1 City of Adelaide 5 City of Burnside 3 City of Charles Sturt 3 City of Marion 5 City of Mitcham 3 City of Mt Gambier 11 City of Norwood, Payneham and St. Peters 5 City of Onkaparinga 6 City of Playford 4 City of Port Adelaide Enfield 5 City of Unley 3 City of Victor Harbor 5 City of West Torrens 2 Clare and Gilbert Valleys Council 1 Copper Coast Council 1 District Council of Kingston 1 District Council of Loxton Waikerie 3 District Council of Yankalilla 2 Kangaroo Island Council 1 Lower Eyre Council 7 Mount Barker District Council 2 Rural City of Murray Bridge 6 State Planning Commission 2 Tatiara District Council 1 The Corporation of the Town of Walkerville 2 Wattle Range Council

Data

Downloaded 4964 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn qs4v8thvrq-boop DevAppProject softgrow ianheggie-oaf 538digital odnagroup seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339 eucodepy

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.1 MB) Use the API

rows 10 / 74940

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.2 MB

History

  • Auto ran revision e1d6b96b and completed successfully .
    97 records added, 97 records removed, 1 record updated in the database
  • Auto ran revision e1d6b96b and completed successfully .
    97 records added, 93 records removed, 1 record updated in the database
  • Auto ran revision e1d6b96b and completed successfully .
    110 records added, 103 records removed, 1 record updated in the database
  • Auto ran revision e1d6b96b and completed successfully .
    108 records added, 101 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    107 records added, 100 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb