planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 20.87s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 107 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26017957 Saving record 26017957, 238 -248 WIRELESS RD W SUTTONTOWN SA 5291 Reusing comment email and authority from existing record: 26016885 Saving record 26016885, 23 MCFARLANE RD COOMUNGA SA 5607 Reusing comment email and authority from existing record: 25033204 Saving record 25033204, 11 ROMNEY RD HAPPY VALLEY SA 5159 Reusing comment email and authority from existing record: 26006698 Saving record 26006698, 304 NORTON SUMMIT RD TERINGIE SA 5072 Reusing comment email and authority from existing record: 26002120 Saving record 26002120, 40 MUNDOORA RD PORT BROUGHTON SA 5522 Reusing comment email and authority from existing record: 25032087 Saving record 25032087, 36 SURREY RD KESWICK SA 5035 Reusing comment email and authority from existing record: 26017246 Saving record 26017246, LOT 21 PORT RD BEVERLEY SA 5009 Reusing comment email and authority from existing record: 26010861 Saving record 26010861, LOT 31 SHOLL ST WALLAROO SA 5556 Reusing comment email and authority from existing record: 26004226 Saving record 26004226, 7 SPROD AV TOORAK GARDENS SA 5065 Reusing comment email and authority from existing record: 26005314 Saving record 26005314, 110A MANNUM RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 26016706 Saving record 26016706, UNIT 1-3 65 -67 NELSON ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26016308 Saving record 26016308, UNIT 1 6 WILSON CT GRANGE SA 5022 Reusing comment email and authority from existing record: 26004305 Saving record 26004305, 8 MATSON TCE VENUS BAY SA 5607 Reusing comment email and authority from existing record: 25039432 Saving record 25039432, 3 MOLVIG CT TROTT PARK SA 5158 Reusing comment email and authority from existing record: 26016380 Saving record 26016380, 8 FIRST AV TANUNDA SA 5352 Reusing comment email and authority from existing record: 26010355 Saving record 26010355, 26 INNOVATION DR TOTNESS SA 5250 Reusing comment email and authority from existing record: 26013875 Saving record 26013875, LOT 63 COWELL-KIMBA RD MINBRIE SA 5602 Reusing comment email and authority from existing record: 26016399 Saving record 26016399, 3 VENNING ST COWELL SA 5602 Reusing comment email and authority from existing record: 26017658 Saving record 26017658, 1510 LINCOLN HWY POONINDIE SA 5607 Reusing comment email and authority from existing record: 26010975 Saving record 26010975, 122 MUNDOO CHANNEL DR HINDMARSH ISLAND SA 5214 Reusing comment email and authority from existing record: 26004571 Saving record 26004571, 98 FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 26012643 Saving record 26012643, 69B BOYLE ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 26006728 Saving record 26006728, 36 -40 DENTON ST HENDON SA 5014 Reusing comment email and authority from existing record: 26005118 Saving record 26005118, 19 MOULDEN ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26013185 Saving record 26013185, 16A DEVONSHIRE RD HAWTHORNDENE SA 5051 Reusing comment email and authority from existing record: 26004771 Saving record 26004771, 2 BARR AV MITCHAM SA 5062 Reusing comment email and authority from existing record: 26012543 Saving record 26012543, 26 KENNETT RD MURRAY BRIDGE EAST SA 5253 Reusing comment email and authority from existing record: 26016183 Saving record 26016183, UNIT 1 13 SECOND AV FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26017440 Saving record 26017440, 5 LANSELL ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26013292 Saving record 26013292, 13 FOURTH AV ST MORRIS SA 5068 Reusing comment email and authority from existing record: 26013839 Saving record 26013839, 150 RIVER LANE PORT MANNUM SA 5238 Reusing comment email and authority from existing record: 25038850 Saving record 25038850, 17736 PRINCES HWY COORONG SA 5264 Reusing comment email and authority from existing record: 26000098 Saving record 26000098, 7 CAPTAIN STURT RD HINDMARSH ISLAND SA 5214 Reusing comment email and authority from existing record: 26015463 Saving record 26015463, 12 -16 EYRE HWY WUDINNA SA 5652 Reusing comment email and authority from existing record: 26008790 Saving record 26008790, LOT 101 WEST LAKES BVD HENDON SA 5014 Reusing comment email and authority from existing record: 26013871 Saving record 26013871, 10 SUNNYBRAE RD SUTTONTOWN SA 5291 Reusing comment email and authority from existing record: 26016993 Saving record 26016993, 22B COWAN ST GAWLER SA 5118 Reusing comment email and authority from existing record: 25024495 Saving record 25024495, 104 MOUNT BARKER RD STIRLING SA 5152 Reusing comment email and authority from existing record: 26015352 Saving record 26015352, 171 HALIFAX ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26012854 Saving record 26012854, 5 REYNOLDS ST BLACKWOOD SA 5051 Reusing comment email and authority from existing record: 26015707 Saving record 26015707, 541 MEDLOW RD ULEYBURY SA 5114 Reusing comment email and authority from existing record: 26012457 Saving record 26012457, 67 GRAND JUNCTION RD ROSEWATER SA 5013 Reusing comment email and authority from existing record: 26010520 Saving record 26010520, LOT 30 SOUTH RD CLARENCE GARDENS SA 5039 Reusing comment email and authority from existing record: 26004174 Saving record 26004174, 14 VALIANT RD HOLDEN HILL SA 5088 Reusing comment email and authority from existing record: 26016351 Saving record 26016351, LOT 100 BAROSSA VALLEY WAY LYNDOCH SA 5351 Reusing comment email and authority from existing record: 26010495 Saving record 26010495, 146 SEAVIEW RD HENLEY BEACH SOUTH SA 5022 Reusing comment email and authority from existing record: 24038885 Saving record 24038885, 10 MATSON TCE VENUS BAY SA 5607 Reusing comment email and authority from existing record: 26008771 Saving record 26008771, 76 ANDREW SCOTT DR BRAMFIELD SA 5670 Reusing comment email and authority from existing record: 26014048 Saving record 26014048, 85 DAVENPORT TCE SEAVIEW DOWNS SA 5049 Reusing comment email and authority from existing record: 26016138 Saving record 26016138, 9A QUEEN ELIZABETH DR BARMERA SA 5345 Reusing comment email and authority from existing record: 26012749 Saving record 26012749, 36 DARLING TCE WHYALLA SA 5600 Reusing comment email and authority from existing record: 25035190 Saving record 25035190, 12 -14 OLD STURT HWY NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 25040006 Saving record 25040006, 173 -175 GRANGE RD FINDON SA 5023 Reusing comment email and authority from existing record: 26014443 Saving record 26014443, 556 BATTUNGA RD JUPITER CREEK SA 5153 Reusing comment email and authority from existing record: 25040773 Saving record 25040773, 25 MILLS ST CLARENCE PARK SA 5034 Reusing comment email and authority from existing record: 25038762 Saving record 25038762, 4 GAMAY CT AULDANA SA 5072 Reusing comment email and authority from existing record: 24010255 Saving record 24010255, 38 BRANDWOOD DR CHERRY GARDENS SA 5157 Reusing comment email and authority from existing record: 26014622 Saving record 26014622, 41 GEORGE ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26014227 Saving record 26014227, LOT 604 MILLSWOOD CR MILLSWOOD SA 5034 Reusing comment email and authority from existing record: 26004551 Saving record 26004551, 22 FOURTH ST GAWLER SOUTH SA 5118 Reusing comment email and authority from existing record: 26011092 Saving record 26011092, 51 -51A REGENCY RD CROYDON PARK SA 5008 Reusing comment email and authority from existing record: 25031162 Saving record 25031162, 63 LIGHT RD COROMANDEL VALLEY SA 5051 Reusing comment email and authority from existing record: 26015883 Saving record 26015883, 15 NORWICH AV BURNSIDE SA 5066 Reusing comment email and authority from existing record: 26010377 Saving record 26010377, 724 FINNISS-CLAYTON RD FINNISS SA 5255 Reusing comment email and authority from existing record: 25034609 Saving record 25034609, 96A ALBANY AV PORT NOARLUNGA SOUTH SA 5167 Reusing comment email and authority from existing record: 25038846 Saving record 25038846, 346 -354 TAPLEYS HILL RD SEATON SA 5023 Reusing comment email and authority from existing record: 26017204 Saving record 26017204, 5 HEREFORD AV TRINITY GARDENS SA 5068 Reusing comment email and authority from existing record: 26014796 Saving record 26014796, 35 FIEDLER ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26012123 Saving record 26012123, LOT 30 HAMPDEN RD HAMPDEN SA 5374 Reusing comment email and authority from existing record: 26017339 Saving record 26017339, 660 SEAVIEW RD GRANGE SA 5022 Reusing comment email and authority from existing record: 25032526 Saving record 25032526, 11A FLINDERS ST KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26002155 Saving record 26002155, 100 REGENCY RD FERRYDEN PARK SA 5010 Reusing comment email and authority from existing record: 25032688 Saving record 25032688, 5 SALTASH AV CHRISTIES BEACH SA 5165 Reusing comment email and authority from existing record: 26010111 Saving record 26010111, 16A WONOKA ST EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 26010724 Saving record 26010724, 3 SANCTUARY AV SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 25024804 Saving record 25024804, 42 WHITINGS RD MCLAREN FLAT SA 5171 Reusing comment email and authority from existing record: 25040288 Saving record 25040288, 290A SIR DONALD BRADMAN DR BROOKLYN PARK SA 5032 Reusing comment email and authority from existing record: 23003648 Saving record 23003648, 24-26A OLD PRINCES HWY MURRAY BRIDGE EAST SA 5253 Reusing comment email and authority from existing record: 26015210 Saving record 26015210, 9 BLIGH AV PANORAMA SA 5041 Reusing comment email and authority from existing record: 26014763 Saving record 26014763, 51 MEAD ST BIRKENHEAD SA 5015 Reusing comment email and authority from existing record: 26004812 Saving record 26004812, 207 MARINE PDE PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 26007001 Saving record 26007001, 846 GRAND JUNCTION RD GILLES PLAINS SA 5086 Reusing comment email and authority from existing record: 25039504 Saving record 25039504, 31A BRIGALOW AV KENSINGTON GARDENS SA 5068 Reusing comment email and authority from existing record: 26014247 Saving record 26014247, 16 VERNON CT PENNESHAW SA 5222 Reusing comment email and authority from existing record: 26012943 Saving record 26012943, 184 FISHER ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26007757 Saving record 26007757, 346 BLEWITT SPRINGS RD BLEWITT SPRINGS SA 5171 Reusing comment email and authority from existing record: 25040254 Saving record 25040254, 44 POSEN RD BIRDWOOD SA 5234 Reusing comment email and authority from existing record: 26012912 Saving record 26012912, 11 EDMUND ST PORT BROUGHTON SA 5522 Reusing comment email and authority from existing record: 26012829 Saving record 26012829, UNIT 1-2 1285 SOUTH RD ST MARYS SA 5042 Reusing comment email and authority from existing record: 26018106 Saving record 26018106, 6 -8 COMMERCIAL RD SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 26013253 Saving record 26013253, 170 YORKTOWN RD ELIZABETH PARK SA 5113 Reusing comment email and authority from existing record: 26014232 Saving record 26014232, 40 LEAH ST FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26008430 Saving record 26008430, 73 MORPHETT ST ROBE SA 5276 Reusing comment email and authority from existing record: 26015537 Saving record 26015537, 236 TANUNDA CREEK RD FLAXMAN VALLEY SA 5235 Reusing comment email and authority from existing record: 26012511 Saving record 26012511, 15 HERBERT ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26010016 Saving record 26010016, LOT 40 VICTOR HARBOR RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 25021414 Saving record 25021414, LOT 462 EDEN VALLEY RD FLAXMAN VALLEY SA 5235 Reusing comment email and authority from existing record: 26011906 Saving record 26011906, LOT 51 HARTWIG RD TAYLORVILLE SA 5330 Reusing comment email and authority from existing record: 26007156 Saving record 26007156, 10 GETHING CR BOWDEN SA 5007 Reusing comment email and authority from existing record: 26010716 Saving record 26010716, 86 GILLMAN RD OAKBANK SA 5243 Reusing comment email and authority from existing record: 25030989 Saving record 25030989, 28 SALEYARDS RD MILLICENT SA 5280 Reusing comment email and authority from existing record: 26011113 Saving record 26011113, 28 CHURCH ST HIGHGATE SA 5063 Reusing comment email and authority from existing record: 26015929 Saving record 26015929, 5 SHELLEY ST FIRLE SA 5070 Reusing comment email and authority from existing record: 25003195 Saving record 25003195, 1043 OLD DUKES HWY COOMANDOOK SA 5261 Reusing comment email and authority from existing record: 25035193 Saving record 25035193, 373 DIAGONAL RD STURT SA 5047 Reusing comment email and authority from existing record: 25037367 Saving record 25037367, 249 MONTAGUE RD INGLE FARM SA 5098 Reusing comment email and authority from existing record: 26003981 Saving record 26003981, 730 SEPPELTSFIELD RD SEPPELTSFIELD SA 5355 First Application data retrieved: {"publicNotificationID"=>13437, "applicationID"=>26011906, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"LOT 51 HARTWIG RD TAYLORVILLE SA 5330, LOT 54 CARTER RD TAYLORVILLE SA 5330", "developmentDescription"=>"Boundary realignment", "closingDate"=>"7/15/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"District Council of Loxton Waikerie", "locationCouncil"=>"THE DC OF LOXTON WAIKERIE", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1105131, "applicationId"=>26011906, "contactName"=>"Elaine Kratopoulos ", "address"=>"C/- Cameron Lock Surveying, PO Box 289, Mount Gambier 5290"}]} Found 107 applications that were already in the database, and added 0 new applications. Added 20.87 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 4 Adelaide Hills Council 3 Alexandrina Council 2 Barunga West Council 1 City of Adelaide 4 City of Burnside 10 City of Charles Sturt 5 City of Marion 7 City of Mitcham 3 City of Mt Gambier 7 City of Norwood, Payneham and St. Peters 8 City of Onkaparinga 2 City of Playford 4 City of Port Adelaide Enfield 1 City of Prospect 1 City of Salisbury 2 City of Tea Tree Gully 6 City of Unley 2 City of West Torrens 1 City of Whyalla 1 Copper Coast Council 3 District Council of Elliston 2 District Council of Franklin Harbour 1 District Council of Grant 1 District Council of Kingston 1 District Council of Robe 1 Kangaroo Island Council 1 Light Regional Council 2 Lower Eyre Council 1 Mid Murray Council 2 Mount Barker District Council 1 Regional Council of Goyder 3 Rural City of Murray Bridge 2 State Planning Commission 6 The Barossa Council 1 The Berri Barmera Council 1 The Coorong District Council 2 Town of Gawler 1 Wattle Range Council 1 Wudinna District Council

Data

Downloaded 4827 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn DevAppProject softgrow qs4v8thvrq-boop 538digital odnagroup ianheggie-oaf Jedwards157 MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26 MB) Use the API

rows 10 / 74691

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.1 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    107 records added, 107 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    119 records added, 119 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    119 records added, 95 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    108 records added, 108 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    108 records added, 95 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb