planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 15.83s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 101 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 25038306 Saving record 25038306, 13 ALEXANDRA ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 26010023 Saving record 26010023, 38 AUGUSTA ST MAYLANDS SA 5069 Reusing comment email and authority from existing record: 26008341 Saving record 26008341, 254 NORTH TCE ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26006851 Saving record 26006851, 419 PAYNEHAM RD FELIXSTOW SA 5070 Reusing comment email and authority from existing record: 25024230 Saving record 25024230, 16 TISCHENDORF ST TROTT PARK SA 5158 Reusing comment email and authority from existing record: 26011977 Saving record 26011977, 8 WILLIAMS AV ROBE SA 5276 Reusing comment email and authority from existing record: 26012801 Saving record 26012801, 233 MILITARY RD HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26007651 Saving record 26007651, 41 MCLAREN PDE PORT ADELAIDE SA 5015 Reusing comment email and authority from existing record: 25014486 Saving record 25014486, LOT 2 MOUNT CRAWFORD RD WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 26008959 Saving record 26008959, 33 TUSMORE AV LEABROOK SA 5068 Reusing comment email and authority from existing record: 26000778 Saving record 26000778, 168 DERRICK RD LOXTON NORTH SA 5333 Reusing comment email and authority from existing record: 26011367 Saving record 26011367, Corner of 294 Payneham Road and Sewell Avenue Reusing comment email and authority from existing record: 26012473 Saving record 26012473, UNIT 1 81 OSMOND TCE NORWOOD SA 5067 Reusing comment email and authority from existing record: 26000366 Saving record 26000366, 4366 VICTOR HARBOR RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26010347 Saving record 26010347, 19 THIRD AV FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 25037979 Saving record 25037979, LOT 3 HUXTABLE RD WATERLOO CORNER SA 5110 Reusing comment email and authority from existing record: 26011675 Saving record 26011675, LOT 21 ALDINGA RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 25036758 Saving record 25036758, 13 GREEN ST ST MORRIS SA 5068 Reusing comment email and authority from existing record: 26006138 Saving record 26006138, 3 RINGMER DR BURNSIDE SA 5066 Reusing comment email and authority from existing record: 24029725 Saving record 24029725, 8 NEWEYS RD MITCHAM SA 5062 Reusing comment email and authority from existing record: 26013738 Saving record 26013738, 381 -385 COMMERCIAL ST W MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26002894 Saving record 26002894, UNIT 2 331 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26006181 Saving record 26006181, 19 VINTAGE RD UNDERDALE SA 5032 Reusing comment email and authority from existing record: 25035872 Saving record 25035872, 67A DARLEY RD PARADISE SA 5075 Reusing comment email and authority from existing record: 25030299 Saving record 25030299, 65 PRECOLUMB RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 24026805 Saving record 24026805, 1116 PORT ELLIOT RD MIDDLETON SA 5213 Reusing comment email and authority from existing record: 24036351 Saving record 24036351, 2794 SOUTH COAST RD FOUL BAY SA 5577 Reusing comment email and authority from existing record: 25000819 Saving record 25000819, 110 -112 TOLLEY RD ST AGNES SA 5097 Reusing comment email and authority from existing record: 26002406 Saving record 26002406, 155 MARION RD RICHMOND SA 5033 Reusing comment email and authority from existing record: 26007960 Saving record 26007960, 260 TWENTYFIRST ST RENMARK SA 5341 Reusing comment email and authority from existing record: 26009408 Saving record 26009408, 6 MILL ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26010502 Saving record 26010502, 173 WOODFORD RD ELIZABETH NORTH SA 5113 Reusing comment email and authority from existing record: 25030883 Saving record 25030883, 21 ASHLEIGH AV FELIXSTOW SA 5070 Reusing comment email and authority from existing record: 26003269 Saving record 26003269, 827 STOCKWELL RD ANGASTON SA 5353 Reusing comment email and authority from existing record: 26010337 Saving record 26010337, 23 HARRIS ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26008751 Saving record 26008751, 8 CADNA AV FELIXSTOW SA 5070 Reusing comment email and authority from existing record: 26000424 Saving record 26000424, 197 RAL RAL AV RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 26013133 Saving record 26013133, 103 WALKERVILLE TCE WALKERVILLE SA 5081 Reusing comment email and authority from existing record: 26010237 Saving record 26010237, 30 ONKAPARINGA VALLEY RD VERDUN SA 5245 Reusing comment email and authority from existing record: 26006035 Saving record 26006035, LOT 197 CLIFF CL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26011501 Saving record 26011501, 53 WEBB RD TINTINARA SA 5266 Reusing comment email and authority from existing record: 26011684 Saving record 26011684, 193 HANCOCK RD INMAN VALLEY SA 5211 Reusing comment email and authority from existing record: 25018068 Saving record 25018068, 19 -23 ADELAIDE RD KAPUNDA SA 5373 Reusing comment email and authority from existing record: 26011439 Saving record 26011439, 74 -78 HENLEY BEACH RD MILE END SA 5031 Reusing comment email and authority from existing record: 26006828 Saving record 26006828, 12 COLWOOD AV FULHAM SA 5024 Reusing comment email and authority from existing record: 25012386 Saving record 25012386, LOT 58 LIMEROCK RD LOWER LIGHT SA 5501 Reusing comment email and authority from existing record: 26013818 Saving record 26013818, 25 FIRST AV FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26006077 Saving record 26006077, LOT 500 CEMETERY RD TAUNTON SA 5235 Reusing comment email and authority from existing record: 25037830 Saving record 25037830, 3572 BRATTEN WAY CUMMINS SA 5631 Reusing comment email and authority from existing record: 26009417 Saving record 26009417, 7 CAMBRIDGE ST HACKNEY SA 5069 Reusing comment email and authority from existing record: 26000655 Saving record 26000655, 16 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26009809 Saving record 26009809, 575 NORTH EAST RD GILLES PLAINS SA 5086 Reusing comment email and authority from existing record: 26010639 Saving record 26010639, 52 HENRY ST WEST CROYDON SA 5008 Reusing comment email and authority from existing record: 26011183 Saving record 26011183, 1229 NORTH EAST RD RIDGEHAVEN SA 5097 Reusing comment email and authority from existing record: 26004016 Saving record 26004016, 9 NOBLE CR TWO WELLS SA 5501 Reusing comment email and authority from existing record: 26007955 Saving record 26007955, 65 BEULAH RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26012673 Saving record 26012673, 2837 ALEXANDRINA RD CURRENCY CREEK SA 5214 Reusing comment email and authority from existing record: 26009425 Saving record 26009425, 81 YOUNG ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26012119 Saving record 26012119, 114 CHELLASTON RD MUNNO PARA WEST SA 5115 Reusing comment email and authority from existing record: 25033935 Saving record 25033935, 668 MARION RD PARK HOLME SA 5043 Reusing comment email and authority from existing record: 26008100 Saving record 26008100, 190 WATTLE ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26011544 Saving record 26011544, 15A SHEFFIELD ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26008816 Saving record 26008816, 10 MOSS RD WINGFIELD SA 5013 Reusing comment email and authority from existing record: 26010892 Saving record 26010892, 15 CAMBRIDGE TCE BRIGHTON SA 5048 Reusing comment email and authority from existing record: 26013960 Saving record 26013960, 20 -24 EDWARDS ST WILMINGTON SA 5485 Reusing comment email and authority from existing record: 25028814 Saving record 25028814, 228 GLEN OSMOND RD FULLARTON SA 5063 Reusing comment email and authority from existing record: 26006040 Saving record 26006040, 644 BOUNDARY RD BROOKER SA 5607 Reusing comment email and authority from existing record: 26009060 Saving record 26009060, 45 CORNY POINT RD CORNY POINT SA 5575 Reusing comment email and authority from existing record: 25040246 Saving record 25040246, 83 SHUEARD RD OVERLAND CORNER SA 5330 Reusing comment email and authority from existing record: 25037213 Saving record 25037213, 77 GLADSTONE RD MILE END SA 5031 Reusing comment email and authority from existing record: 26011004 Saving record 26011004, 25 OAKLEIGH RD MARION SA 5043 Reusing comment email and authority from existing record: 26009052 Saving record 26009052, 15 ELMGLADE RD SPRINGFIELD SA 5062 Reusing comment email and authority from existing record: 26002320 Saving record 26002320, 7 PARA WIRRA RD WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 26012014 Saving record 26012014, 1 PARSONS ST MAYLANDS SA 5069 Reusing comment email and authority from existing record: 26010435 Saving record 26010435, 14 GEORGE ST TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26002117 Saving record 26002117, 7 THELMA AV FULHAM GARDENS SA 5024 Reusing comment email and authority from existing record: 26010248 Saving record 26010248, 12 AYTON AV FULHAM SA 5024 Reusing comment email and authority from existing record: 26009102 Saving record 26009102, 1 EDWARD ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26009550 Saving record 26009550, 37 BANDON TCE MARINO SA 5049 Reusing comment email and authority from existing record: 26009141 Saving record 26009141, 69 EDWARD ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26014187 Saving record 26014187, 9 -11 HOLDER AV RICHMOND SA 5033 Reusing comment email and authority from existing record: 25022453 Saving record 25022453, 21 ALLANDALE AV GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 26007645 Saving record 26007645, LOT 125 GASTON RD FISHER SA 5354 Reusing comment email and authority from existing record: 26010814 Saving record 26010814, 1 BRUMBY CT KAPUNDA SA 5373 Reusing comment email and authority from existing record: 26015365 Saving record 26015365, 36 BUTTROSE ST GLENELG EAST SA 5045 Reusing comment email and authority from existing record: 25038775 Saving record 25038775, 104 EDUCATION RD ONKAPARINGA HILLS SA 5163 Reusing comment email and authority from existing record: 26004221 Saving record 26004221, 325 TORRENS RD WEST CROYDON SA 5008 Reusing comment email and authority from existing record: 25035365 Saving record 25035365, 49 ARUMPO ST RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 26008264 Saving record 26008264, 9 WATSON ST BEVERLEY SA 5009 Reusing comment email and authority from existing record: 26007961 Saving record 26007961, LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26001738 Saving record 26001738, LOT 10 CARRUTH RD TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 25038795 Saving record 25038795, 17 HARDY AV GLENGOWRIE SA 5044 Reusing comment email and authority from existing record: 25023201 Saving record 25023201, 75 MCGILP RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 26010973 Saving record 26010973, 14488 FLINDERS HWY BRAMFIELD SA 5670 Reusing comment email and authority from existing record: 25037015 Saving record 25037015, LOT 2 RAVENDALE RD PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26010563 Saving record 26010563, 322 HALIFAX ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26006078 Saving record 26006078, LOT 1 CEMETERY RD EDEN VALLEY SA 5235 Reusing comment email and authority from existing record: 26011884 Saving record 26011884, 90 FIRST AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25000594 Saving record 25000594, 15 COACH-HOUSE DR TERINGIE SA 5072 Reusing comment email and authority from existing record: 26001634 Saving record 26001634, 64 MARION ST UNLEY SA 5061 Reusing comment email and authority from existing record: 26012430 Saving record 26012430, 3 LYTTON ST QUORN SA 5433 First Application data retrieved: {"publicNotificationID"=>13271, "applicationID"=>26000424, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"197 RAL RAL AV RENMARK WEST SA 5341, LOT 123 BOOKMARK AV RENMARK WEST SA 5341, LOT 54 RAL RAL AV RENMARK WEST SA 5341", "developmentDescription"=>"Land division 3 into 4 allotments, together with associated road closure", "closingDate"=>"6/19/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"Renmark Paringa Council", "locationCouncil"=>"RENMARK PARINGA COUNCIL", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1046836, "applicationId"=>26000424, "contactName"=>"SA Power Networks ", "address"=>"C\\- Alexander Symonds Pty Ltd, 62 The Parade Norwood 5067"}]} Found 101 applications that were already in the database, and added 0 new applications. Added 15.83 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 2 Adelaide Hills Council 2 Adelaide Plains Council 2 Alexandrina Council 1 City of Adelaide 3 City of Burnside 1 City of Campbelltown 6 City of Charles Sturt 2 City of Holdfast Bay 5 City of Marion 4 City of Mitcham 1 City of Mt Gambier 14 City of Norwood, Payneham and St. Peters 2 City of Onkaparinga 5 City of Playford 3 City of Port Adelaide Enfield 1 City of Port Lincoln 1 City of Prospect 2 City of Tea Tree Gully 7 City of Unley 1 City of Victor Harbor 7 City of West Torrens 1 District Council of Elliston 1 District Council of Loxton Waikerie 1 District Council of Mount Remarkable 1 District Council of Robe 1 District Council of Tumby Bay 1 Flinders Ranges Council 2 Light Regional Council 1 Lower Eyre Council 1 Mid Murray Council 2 Mount Barker District Council 1 Renmark Paringa Council 8 State Planning Commission 4 The Barossa Council 1 The Berri Barmera Council 1 The Coorong District Council 1 The Corporation of the Town of Walkerville 1 Yorke Peninsula Council

Data

Downloaded 4735 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke DevAppProject softgrow qs4v8thvrq-boop odnagroup ianheggie-oaf Jedwards157 MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.9 MB) Use the API

rows 10 / 74549

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    101 records added, 101 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and failed .
    nothing changed in the database
  • Auto ran revision b38f71b9 and completed successfully .
    109 records added, 103 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    113 records added, 105 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    118 records added, 109 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb