planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 23.09s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 109 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26002242 Saving record 26002242, 6 HOWARDS RD BEVERLEY SA 5009 Reusing comment email and authority from existing record: 26013738 Saving record 26013738, 381 -385 COMMERCIAL ST W MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26009417 Saving record 26009417, 7 CAMBRIDGE ST HACKNEY SA 5069 Reusing comment email and authority from existing record: 26008959 Saving record 26008959, 33 TUSMORE AV LEABROOK SA 5068 Reusing comment email and authority from existing record: 26003557 Saving record 26003557, UNIT 1-2 539 -541 GOODWOOD RD COLONEL LIGHT GARDENS SA 5041 Reusing comment email and authority from existing record: 26010347 Saving record 26010347, 19 THIRD AV FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 25037015 Saving record 25037015, LOT 2 RAVENDALE RD PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26010973 Saving record 26010973, 14488 FLINDERS HWY BRAMFIELD SA 5670 Reusing comment email and authority from existing record: 26000386 Saving record 26000386, 7 WALTER ST KIDMAN PARK SA 5025 Reusing comment email and authority from existing record: 25040927 Saving record 25040927, 242 MEDLOW RD ULEYBURY SA 5114 Reusing comment email and authority from existing record: 26012014 Saving record 26012014, 1 PARSONS ST MAYLANDS SA 5069 Reusing comment email and authority from existing record: 25022032 Saving record 25022032, 89 ST BERNARDS RD MAGILL SA 5072 Reusing comment email and authority from existing record: 25035872 Saving record 25035872, 67A DARLEY RD PARADISE SA 5075 Reusing comment email and authority from existing record: 26007960 Saving record 26007960, 260 TWENTYFIRST ST RENMARK SA 5341 Reusing comment email and authority from existing record: 26001738 Saving record 26001738, LOT 10 CARRUTH RD TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26006164 Saving record 26006164, UNIT 1 7 HOOD ST HILLCREST SA 5086 Reusing comment email and authority from existing record: 25030008 Saving record 25030008, 65B JUNCTION RD LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26009408 Saving record 26009408, 6 MILL ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 25033935 Saving record 25033935, 668 MARION RD PARK HOLME SA 5043 Reusing comment email and authority from existing record: 25018068 Saving record 25018068, 19 -23 ADELAIDE RD KAPUNDA SA 5373 Reusing comment email and authority from existing record: 24036351 Saving record 24036351, 2794 SOUTH COAST RD FOUL BAY SA 5577 Reusing comment email and authority from existing record: 26010890 Saving record 26010890, 12 JOHN ST GOODWOOD SA 5034 Reusing comment email and authority from existing record: 26009425 Saving record 26009425, 81 YOUNG ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26012473 Saving record 26012473, UNIT 1 81 OSMOND TCE NORWOOD SA 5067 Reusing comment email and authority from existing record: 25023551 Saving record 25023551, 7 ESPLANADE SELLICKS BEACH SA 5174 Reusing comment email and authority from existing record: 26004016 Saving record 26004016, 9 NOBLE CR TWO WELLS SA 5501 Reusing comment email and authority from existing record: 26008500 Saving record 26008500, 15 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26004003 Saving record 26004003, 211 NORTH EAST RD HAMPSTEAD GARDENS SA 5086 Reusing comment email and authority from existing record: 26007884 Saving record 26007884, LOT 154 THIRD ST ROSETOWN SA 5275 Reusing comment email and authority from existing record: 26006828 Saving record 26006828, 12 COLWOOD AV FULHAM SA 5024 Reusing comment email and authority from existing record: 26010822 Saving record 26010822, LOT 246 SOUTHSHORE RD HARDWICKE BAY SA 5575 Reusing comment email and authority from existing record: 26012801 Saving record 26012801, 233 MILITARY RD HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26004936 Saving record 26004936, 12 DALY TCE HARDWICKE BAY SA 5575 Reusing comment email and authority from existing record: 26009052 Saving record 26009052, 15 ELMGLADE RD SPRINGFIELD SA 5062 Reusing comment email and authority from existing record: 26007651 Saving record 26007651, 41 MCLAREN PDE PORT ADELAIDE SA 5015 Reusing comment email and authority from existing record: 26009608 Saving record 26009608, 1314 JERVOIS RD WOODS POINT SA 5253 Reusing comment email and authority from existing record: 26010892 Saving record 26010892, 15 CAMBRIDGE TCE BRIGHTON SA 5048 Reusing comment email and authority from existing record: 25037979 Saving record 25037979, LOT 3 HUXTABLE RD WATERLOO CORNER SA 5110 Reusing comment email and authority from existing record: 26013818 Saving record 26013818, 25 FIRST AV FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26008751 Saving record 26008751, 8 CADNA AV FELIXSTOW SA 5070 Reusing comment email and authority from existing record: 26008072 Saving record 26008072, 10 -14 KING ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26007961 Saving record 26007961, LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26008631 Saving record 26008631, 9 PADMAN CR MIDDLETON SA 5213 Reusing comment email and authority from existing record: 26009141 Saving record 26009141, 69 EDWARD ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26008799 Saving record 26008799, 21 LITTLE PAXTON ST WILLASTON SA 5118 Reusing comment email and authority from existing record: 26006725 Saving record 26006725, 3 BRIDGE ST LOBETHAL SA 5241 Reusing comment email and authority from existing record: 26013960 Saving record 26013960, 20 -24 EDWARDS ST WILMINGTON SA 5485 Reusing comment email and authority from existing record: 26011722 Saving record 26011722, 129 WILLISS DR NORMANVILLE SA 5204 Reusing comment email and authority from existing record: 26006538 Saving record 26006538, 20 STUART RD DULWICH SA 5065 Reusing comment email and authority from existing record: 26011977 Saving record 26011977, 8 WILLIAMS AV ROBE SA 5276 Reusing comment email and authority from existing record: 26007652 Saving record 26007652, 56 BELLEVUE DR WYOMI SA 5275 Reusing comment email and authority from existing record: 26010428 Saving record 26010428, 35 FIFTH ST ARDROSSAN SA 5571 Reusing comment email and authority from existing record: 26006851 Saving record 26006851, 419 PAYNEHAM RD FELIXSTOW SA 5070 Reusing comment email and authority from existing record: 25038306 Saving record 25038306, 13 ALEXANDRA ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 25030883 Saving record 25030883, 21 ASHLEIGH AV FELIXSTOW SA 5070 Reusing comment email and authority from existing record: 26011506 Saving record 26011506, 34 NORSEMAN AV WESTBOURNE PARK SA 5041 Reusing comment email and authority from existing record: 24029725 Saving record 24029725, 8 NEWEYS RD MITCHAM SA 5062 Reusing comment email and authority from existing record: 26007170 Saving record 26007170, 150 ESPLANADE PORT NOARLUNGA SOUTH SA 5167 Reusing comment email and authority from existing record: 25035365 Saving record 25035365, 49 ARUMPO ST RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 26014187 Saving record 26014187, 9 -11 HOLDER AV RICHMOND SA 5033 Reusing comment email and authority from existing record: 26012401 Saving record 26012401, 2 OLDHAM CL MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26006077 Saving record 26006077, LOT 500 CEMETERY RD TAUNTON SA 5235 Reusing comment email and authority from existing record: 26011884 Saving record 26011884, 90 FIRST AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25000594 Saving record 25000594, 15 COACH-HOUSE DR TERINGIE SA 5072 Reusing comment email and authority from existing record: 26006078 Saving record 26006078, LOT 1 CEMETERY RD EDEN VALLEY SA 5235 Reusing comment email and authority from existing record: 26011125 Saving record 26011125, UNIT 1 108 WATSON AV TOORAK GARDENS SA 5065 Reusing comment email and authority from existing record: 26010817 Saving record 26010817, LOT 84 GIBBS ST COONALPYN SA 5265 Reusing comment email and authority from existing record: 26010124 Saving record 26010124, 180 BLOMBERY RD ARNO BAY SA 5603 Reusing comment email and authority from existing record: 26009550 Saving record 26009550, 37 BANDON TCE MARINO SA 5049 Reusing comment email and authority from existing record: 25022453 Saving record 25022453, 21 ALLANDALE AV GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 26011004 Saving record 26011004, 25 OAKLEIGH RD MARION SA 5043 Reusing comment email and authority from existing record: 25038775 Saving record 25038775, 104 EDUCATION RD ONKAPARINGA HILLS SA 5163 Reusing comment email and authority from existing record: 26001634 Saving record 26001634, 64 MARION ST UNLEY SA 5061 Reusing comment email and authority from existing record: 26008816 Saving record 26008816, 10 MOSS RD WINGFIELD SA 5013 Reusing comment email and authority from existing record: 26002320 Saving record 26002320, 7 PARA WIRRA RD WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 26010563 Saving record 26010563, 322 HALIFAX ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26006181 Saving record 26006181, 19 VINTAGE RD UNDERDALE SA 5032 Reusing comment email and authority from existing record: 25030299 Saving record 25030299, 65 PRECOLUMB RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 25014486 Saving record 25014486, LOT 2 MOUNT CRAWFORD RD WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 25037213 Saving record 25037213, 77 GLADSTONE RD MILE END SA 5031 Reusing comment email and authority from existing record: 26009199 Saving record 26009199, 485 MAIN NORTH RD EVANSTON SA 5116 Reusing comment email and authority from existing record: 26003269 Saving record 26003269, 827 STOCKWELL RD ANGASTON SA 5353 Reusing comment email and authority from existing record: 26006035 Saving record 26006035, LOT 197 CLIFF CL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 25030599 Saving record 25030599, 58 ANN ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26009060 Saving record 26009060, 45 CORNY POINT RD CORNY POINT SA 5575 Reusing comment email and authority from existing record: 26010435 Saving record 26010435, 14 GEORGE ST TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26008100 Saving record 26008100, 190 WATTLE ST MALVERN SA 5061 Reusing comment email and authority from existing record: 25023201 Saving record 25023201, 75 MCGILP RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 26009102 Saving record 26009102, 1 EDWARD ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26011544 Saving record 26011544, 15A SHEFFIELD ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26000655 Saving record 26000655, 16 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26002244 Saving record 26002244, 17 LAKEVIEW AV WEST LAKES SA 5021 Reusing comment email and authority from existing record: 26011367 Saving record 26011367, Corner of 294 Payneham Road and Sewell Avenue Reusing comment email and authority from existing record: 26008193 Saving record 26008193, 397 ACKLAND HILL RD COROMANDEL EAST SA 5157 Reusing comment email and authority from existing record: 26009721 Saving record 26009721, 7 RAILWAY TCE CHELTENHAM SA 5014 Reusing comment email and authority from existing record: 26007955 Saving record 26007955, 65 BEULAH RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 25036758 Saving record 25036758, 13 GREEN ST ST MORRIS SA 5068 Reusing comment email and authority from existing record: 26010248 Saving record 26010248, 12 AYTON AV FULHAM SA 5024 Reusing comment email and authority from existing record: 26009809 Saving record 26009809, 575 NORTH EAST RD GILLES PLAINS SA 5086 Reusing comment email and authority from existing record: 26011080 Saving record 26011080, 34 STAMFORD ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25036850 Saving record 25036850, 24 GOTHIC RD BELLEVUE HEIGHTS SA 5050 Reusing comment email and authority from existing record: 25028814 Saving record 25028814, 228 GLEN OSMOND RD FULLARTON SA 5063 Reusing comment email and authority from existing record: 25038949 Saving record 25038949, 24 OLDHAM RD ELIZABETH VALE SA 5112 Reusing comment email and authority from existing record: 26011675 Saving record 26011675, LOT 21 ALDINGA RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26008264 Saving record 26008264, 9 WATSON ST BEVERLEY SA 5009 Reusing comment email and authority from existing record: 23015397 Saving record 23015397, 5 BARFIELD CR EDINBURGH NORTH SA 5113 Reusing comment email and authority from existing record: 25037830 Saving record 25037830, 3572 BRATTEN WAY CUMMINS SA 5631 Reusing comment email and authority from existing record: 25024230 Saving record 25024230, 16 TISCHENDORF ST TROTT PARK SA 5158 Reusing comment email and authority from existing record: 26012035 Saving record 26012035, 256 -258 BRIDGE RD POORAKA SA 5095 First Application data retrieved: {"publicNotificationID"=>13229, "applicationID"=>26007961, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211", "developmentDescription"=>"Land Division 1 into 2 and road closure", "closingDate"=>"6/12/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"City of Victor Harbor", "locationCouncil"=>"CITY OF VICTOR HARBOR", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1085133, "applicationId"=>26007961, "contactName"=>"City of Victor Harbor", "address"=>"PO Box 11 Victor Harbor 5211"}]} Found 109 applications that were already in the database, and added 0 new applications. Added 23.09 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 2 Adelaide Hills Council 1 Adelaide Plains Council 1 Alexandrina Council 1 City of Adelaide 4 City of Burnside 2 City of Campbelltown 6 City of Charles Sturt 1 City of Holdfast Bay 4 City of Marion 7 City of Mitcham 2 City of Mt Gambier 14 City of Norwood, Payneham and St. Peters 5 City of Onkaparinga 6 City of Playford 5 City of Port Adelaide Enfield 1 City of Port Lincoln 1 City of Prospect 1 City of Salisbury 9 City of Unley 5 City of West Torrens 1 District Council of Cleve 1 District Council of Elliston 2 District Council of Kingston 1 District Council of Mount Remarkable 1 District Council of Robe 1 District Council of Yankalilla 1 Light Regional Council 1 Lower Eyre Council 4 Mount Barker District Council 1 Renmark Paringa Council 1 Rural City of Murray Bridge 5 State Planning Commission 4 The Barossa Council 1 The Coorong District Council 2 Town of Gawler 4 Yorke Peninsula Council

Data

Downloaded 4715 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke qs4v8thvrq-boop DevAppProject softgrow odnagroup ianheggie-oaf 93399339 eucodepy seegolovemee tobiasoberrauch Jedwards157 MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.9 MB) Use the API

rows 10 / 74519

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 25.9 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    109 records added, 109 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    112 records added, 104 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    108 records added, 108 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    109 records added, 97 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    111 records added, 111 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb