planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 15.63s to avoid 429 Too Many Requests errors Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 106 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26016619 Saving record 26016619, 134 CRABB RD LOWER LIGHT SA 5501 Reusing comment email and authority from existing record: 26028539 Saving record 26028539, 118 THOMAS RD MASLIN BEACH SA 5170 Reusing comment email and authority from existing record: 26015707 Saving record 26015707, 541 MEDLOW RD ULEYBURY SA 5114 Reusing comment email and authority from existing record: 26025455 Saving record 26025455, 38 FLINDERS ST KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26031003 Saving record 26031003, 92 GOLD COAST DR CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 25036469 Saving record 25036469, 63 MONMOUTH RD WESTBOURNE PARK SA 5041 Reusing comment email and authority from existing record: 26026985 Saving record 26026985, LOT 11 MEMFORD WAY FLAGSTAFF HILL SA 5159 Reusing comment email and authority from existing record: 26029247 Saving record 26029247, 35A FERRERS ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26013778 Saving record 26013778, LOT 2000 HEYSEN BVD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26023536 Saving record 26023536, LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26026404 Saving record 26026404, 451 RESEARCH RD NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 26022462 Saving record 26022462, 42 CASTLE ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26022893 Saving record 26022893, 159 NORTH EAST RD MANNINGHAM SA 5086 Reusing comment email and authority from existing record: 26028085 Saving record 26028085, 39 ADDISON RD PENNINGTON SA 5013 Reusing comment email and authority from existing record: 26011733 Saving record 26011733, 360 OLD NORTON SUMMIT RD HORSNELL GULLY SA 5141 Reusing comment email and authority from existing record: 25014614 Saving record 25014614, 804 MOUNT BARKER RD VERDUN SA 5245 Reusing comment email and authority from existing record: 26018268 Saving record 26018268, 8 PINKS BEACH RD PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 26012140 Saving record 26012140, 12 NETHERBY AV NETHERBY SA 5062 Reusing comment email and authority from existing record: 26022693 Saving record 26022693, 2223 MAITLAND RD ARDROSSAN SA 5571 Reusing comment email and authority from existing record: 26027719 Saving record 26027719, 25 MOUNT OSMOND RD MOUNT OSMOND SA 5064 Reusing comment email and authority from existing record: 26028979 Saving record 26028979, 13 WINDERMERE AV NOVAR GARDENS SA 5040 Reusing comment email and authority from existing record: 26029799 Saving record 26029799, 42 HOLLY RISE HACKHAM WEST SA 5163 Reusing comment email and authority from existing record: 26025443 Saving record 26025443, 38 ESMOND ST HYDE PARK SA 5061 Reusing comment email and authority from existing record: 26029295 Saving record 26029295, 8 STOTT PL STIRLING SA 5152 Reusing comment email and authority from existing record: 26028108 Saving record 26028108, 28 ESPLANADE VICTOR HARBOR SA 5211 Reusing comment email and authority from existing record: 26017997 Saving record 26017997, 36 NAYLOR TCE WUDINNA SA 5652 Reusing comment email and authority from existing record: 26025716 Saving record 26025716, 525 WINTON RD GUMERACHA SA 5233 Reusing comment email and authority from existing record: 26013171 Saving record 26013171, 248 CALIFORNIA RD TATACHILLA SA 5171 Reusing comment email and authority from existing record: 26028689 Saving record 26028689, 14 ANNESLEY AV TRINITY GARDENS SA 5068 Reusing comment email and authority from existing record: 26026834 Saving record 26026834, 21 LASCELLES AV BEAUMONT SA 5066 Reusing comment email and authority from existing record: 26015575 Saving record 26015575, 130 WILLISON RD GOULD CREEK SA 5114 Reusing comment email and authority from existing record: 26029346 Saving record 26029346, 548 -560 MILNE RD REDWOOD PARK SA 5097 Reusing comment email and authority from existing record: 26021322 Saving record 26021322, 69 NELSON ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26025773 Saving record 26025773, 77 PALMER PL NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25032366 Saving record 25032366, 1680 HINDMARSH TIERS RD MYPONGA SA 5202 Reusing comment email and authority from existing record: 26027087 Saving record 26027087, 39 FOURTH AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 26026211 Saving record 26026211, 320 GLEN OSMOND RD MYRTLE BANK SA 5064 Reusing comment email and authority from existing record: 23028686 Saving record 23028686, 7 GREENWOOD CR GLENALTA SA 5052 Reusing comment email and authority from existing record: 26015739 Saving record 26015739, 4 HIGHVIEW CT ONKAPARINGA HEIGHTS SA 5163 Reusing comment email and authority from existing record: 26019171 Saving record 26019171, 3 CIRCUIT DR HENDON SA 5014 Reusing comment email and authority from existing record: 26030467 Saving record 26030467, 2 -10 SURREY FARM DR GOLDEN GROVE SA 5125 Reusing comment email and authority from existing record: 26025040 Saving record 26025040, 7 EDWARD ST EVANDALE SA 5069 Reusing comment email and authority from existing record: 26029573 Saving record 26029573, 344 WATERLOO RD WATERLOO SA 5413 Reusing comment email and authority from existing record: 21027183 Saving record 21027183, 198 GOYDER HWY CRYSTAL BROOK SA 5523 Reusing comment email and authority from existing record: 26029082 Saving record 26029082, 139 TAPLEYS HILL RD SEATON SA 5023 Reusing comment email and authority from existing record: 26030062 Saving record 26030062, LOT 17 MAIN SOUTH RD ALDINGA SA 5173 Reusing comment email and authority from existing record: 26030966 Saving record 26030966, LOT 180 WILKIN RD MURRAY BRIDGE NORTH SA 5253 Reusing comment email and authority from existing record: 26029377 Saving record 26029377, 109 ALMOND GROVE RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26024150 Saving record 26024150, 232 RICHMOND RD MARLESTON SA 5033 Reusing comment email and authority from existing record: 26029311 Saving record 26029311, 36 GROSSER ST MILLICENT SA 5280 Reusing comment email and authority from existing record: 26031026 Saving record 26031026, UNIT 1-3 500 CHURCHILL RD KILBURN SA 5084 Reusing comment email and authority from existing record: 26016582 Saving record 26016582, 10 FRY LANE FOREST RANGE SA 5139 Reusing comment email and authority from existing record: 26029014 Saving record 26029014, 100 CHURCHETT RD PARACOMBE SA 5132 Reusing comment email and authority from existing record: 26014029 Saving record 26014029, 33 CUTTING CT WORROLONG SA 5291 Reusing comment email and authority from existing record: 26030365 Saving record 26030365, 20 CHARLICK RD CRAFERS WEST SA 5152 Reusing comment email and authority from existing record: 26027195 Saving record 26027195, 101 RAL RAL AV RENMARK SA 5341 Reusing comment email and authority from existing record: 26028961 Saving record 26028961, LOT 1 FARM BEACH RD COULTA SA 5607 Reusing comment email and authority from existing record: 26027740 Saving record 26027740, 2 GEORGE ST CEDUNA SA 5690 Reusing comment email and authority from existing record: 26011336 Saving record 26011336, 3201 OLD PRINCES HWY MONARTO SA 5254 Reusing comment email and authority from existing record: 26024894 Saving record 26024894, 3680 OLD PRINCES HWY MONARTO SOUTH SA 5254 Reusing comment email and authority from existing record: 25040550 Saving record 25040550, 73 PRESSER RD TANUNDA SA 5352 Reusing comment email and authority from existing record: 26017387 Saving record 26017387, 70 BATH ST GLENELG SOUTH SA 5045 Reusing comment email and authority from existing record: 25032364 Saving record 25032364, 130 RICHMOND AV MELROSE PARK SA 5039 Reusing comment email and authority from existing record: 26026412 Saving record 26026412, 20 ELLA ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26028061 Saving record 26028061, 2A CHAPMAN CR GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 26027610 Saving record 26027610, 2 MANRESA CT ATHELSTONE SA 5076 Reusing comment email and authority from existing record: 26027160 Saving record 26027160, 6 MOUNTBATTEN GR WEST BEACH SA 5024 Reusing comment email and authority from existing record: 26029188 Saving record 26029188, 37 WILLIAM ST HAWTHORN SA 5062 Reusing comment email and authority from existing record: 26027706 Saving record 26027706, 17 CALCOOLAT TCE HATHERLEIGH SA 5280 Reusing comment email and authority from existing record: 26029198 Saving record 26029198, 325 ROWLEY RD MYPONGA SA 5202 Reusing comment email and authority from existing record: 26028052 Saving record 26028052, UNIT 1 67 PORTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25002250 Saving record 25002250, 383 ALDINGA RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26031059 Saving record 26031059, 32 ROSEMARY CT ENCOUNTER BAY SA 5211 Reusing comment email and authority from existing record: 26001776 Saving record 26001776, 4004 COWELL-KIMBA RD MILTALIE SA 5602 Reusing comment email and authority from existing record: 26028377 Saving record 26028377, 14 WEST TCE COWELL SA 5602 Reusing comment email and authority from existing record: 26028099 Saving record 26028099, LOT 344 NORTHBRI AV SALISBURY EAST SA 5109 Reusing comment email and authority from existing record: 26028627 Saving record 26028627, 21 JENNIFER AV RIDGEHAVEN SA 5097 Reusing comment email and authority from existing record: 26026940 Saving record 26026940, UNIT 2 52A LEICESTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25030958 Saving record 25030958, 112 BAKEWELL DR MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 26030568 Saving record 26030568, LOT 100 NAUTILUS RD ELIZABETH EAST SA 5112 Reusing comment email and authority from existing record: 26030881 Saving record 26030881, 9 -11 MYRTLE PL TAILEM BEND SA 5260 Reusing comment email and authority from existing record: 26027825 Saving record 26027825, 214 -216 STURT ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26008896 Saving record 26008896, 91 ALAWOONA AV MITCHELL PARK SA 5043 Reusing comment email and authority from existing record: 26007018 Saving record 26007018, 23 WEHL ST S MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26013047 Saving record 26013047, LOT 128 CASSINI RD CASSINI SA 5223 Reusing comment email and authority from existing record: 26010061 Saving record 26010061, 61A DAVID TCE WOODVILLE PARK SA 5011 Reusing comment email and authority from existing record: 26029621 Saving record 26029621, 29 ENGINEHOUSE DR SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 26031179 Saving record 26031179, 49 BASKET RANGE RD URAIDLA SA 5142 Reusing comment email and authority from existing record: 25023950 Saving record 25023950, 3 SOUTH TCE EUDUNDA SA 5374 Reusing comment email and authority from existing record: 26030871 Saving record 26030871, 14 RICHARD CT HINDMARSH ISLAND SA 5214 Reusing comment email and authority from existing record: 26030665 Saving record 26030665, 14 SCOTT ST BEULAH PARK SA 5067 Reusing comment email and authority from existing record: 26003412 Saving record 26003412, 131 CROSS RD HAWTHORN SA 5062 Reusing comment email and authority from existing record: 25040776 Saving record 25040776, LOT 14 JAMES ST CAMPBELLTOWN SA 5074 Reusing comment email and authority from existing record: 26008728 Saving record 26008728, 14 KING ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 26018517 Saving record 26018517, 12 ANDERSON RD ALDGATE SA 5154 Reusing comment email and authority from existing record: 26030658 Saving record 26030658, 410 -412 PAYNEHAM RD GLYNDE SA 5070 Reusing comment email and authority from existing record: 26001778 Saving record 26001778, 2777 COWELL-KIMBA RD MILTALIE SA 5602 Reusing comment email and authority from existing record: 26001790 Saving record 26001790, 967 SECTUS TANKS RD BARNA SA 5641 Reusing comment email and authority from existing record: 26020076 Saving record 26020076, 75 PENONG AV CAMDEN PARK SA 5038 Reusing comment email and authority from existing record: 26004305 Saving record 26004305, 8 MATSON TCE VENUS BAY SA 5607 Reusing comment email and authority from existing record: 25036494 Saving record 25036494, 58 MAIN NORTH RD PROSPECT SA 5082 Reusing comment email and authority from existing record: 26031546 Saving record 26031546, LOT 13 COPPER COAST HWY SOUTH HUMMOCKS SA 5550 Reusing comment email and authority from existing record: 26029180 Saving record 26029180, 12 WOOLSTON RD MONASH SA 5342 Reusing comment email and authority from existing record: 26018413 Saving record 26018413, 61 GROVE AV MARLESTON SA 5033 Reusing comment email and authority from existing record: 26022695 Saving record 26022695, 23 PONY RIDGE RD BELAIR SA 5052 Reusing comment email and authority from existing record: 26027814 Saving record 26027814, 342A MAIN NORTH RD BLAIR ATHOL SA 5084 First Application data retrieved: {"publicNotificationID"=>14108, "applicationID"=>26018268, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"8 PINKS BEACH RD PINKS BEACH SA 5275", "developmentDescription"=>"Single Storey detached dwelling with deck and veranda", "closingDate"=>"11/4/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"District Council of Kingston", "locationCouncil"=>"Kingston", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1137560, "applicationId"=>26018268, "contactName"=>"Longridge Group Pty Ltd ", "address"=>"158 RAILWAY TERRACE MILE END SOUTH 5031"}]} Found 106 applications that were already in the database, and added 0 new applications. Added 15.63 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 8 Adelaide Hills Council 1 Adelaide Plains Council 1 Alexandrina Council 1 Barunga West Council 2 City of Adelaide 4 City of Burnside 2 City of Campbelltown 4 City of Charles Sturt 1 City of Holdfast Bay 1 City of Marion 7 City of Mitcham 2 City of Mt Gambier 6 City of Norwood, Payneham and St. Peters 9 City of Onkaparinga 3 City of Playford 3 City of Port Adelaide Enfield 2 City of Prospect 1 City of Salisbury 4 City of Tea Tree Gully 6 City of Unley 2 City of Victor Harbor 5 City of West Torrens 1 Clare and Gilbert Valleys Council 1 District Council of Ceduna 1 District Council of Elliston 3 District Council of Franklin Harbour 1 District Council of Kimba 3 District Council of Yankalilla 1 Light Regional Council 1 Mount Barker District Council 1 Port Pirie Regional Council 1 Regional Council of Goyder 1 Renmark Paringa Council 3 Rural City of Murray Bridge 1 Southern Limestone Coast Council 5 State Planning Commission 1 The Barossa Council 1 The Berri Barmera Council 1 The Coorong District Council 2 Wattle Range Council 1 Wudinna District Council 1 Yorke Peninsula Council

Data

Downloaded 5075 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn qs4v8thvrq-boop DevAppProject softgrow ianheggie-oaf 538digital odnagroup seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339 eucodepy

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.3 MB) Use the API

rows 10 / 75235

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.4 MB

History

  • Auto ran revision 5a25f2a3 and completed successfully .
    106 records added, 106 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    106 records added, 106 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    116 records added, 113 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    119 records added, 119 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    119 records added, 101 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb