planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 18.67s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 76 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26004631 Saving record 26004631, 1A HERBERT ST NORMANVILLE SA 5204 Reusing comment email and authority from existing record: 26004625 Saving record 26004625, 20 JOSLIN ST WAYVILLE SA 5034 Reusing comment email and authority from existing record: 25024151 Saving record 25024151, 18 ROSS ST TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 25040508 Saving record 25040508, 42 GLEBE DR LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26001779 Saving record 26001779, 14 SMITH AV HOVE SA 5048 Reusing comment email and authority from existing record: 25034908 Saving record 25034908, LOT 60 ROTHALLS RD CAPE JAFFA SA 5275 Reusing comment email and authority from existing record: 26004901 Saving record 26004901, 353 HULL RD LITTLE DOUGLAS SA 5607 Reusing comment email and authority from existing record: 25030340 Saving record 25030340, 20 ARABRIE AV EDWARDSTOWN SA 5039 Reusing comment email and authority from existing record: 26002549 Saving record 26002549, 107 PIRIE BLOCKS RD BUNGAMA SA 5540 Reusing comment email and authority from existing record: 25037987 Saving record 25037987, 114 MILLS TCE NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25040770 Saving record 25040770, 404 GRAND JUNCTION RD CLEARVIEW SA 5085 Reusing comment email and authority from existing record: 26002359 Saving record 26002359, 2 KING WILLIAM RD WAYVILLE SA 5034 Reusing comment email and authority from existing record: 26004843 Saving record 26004843, LOT 200 SUNSET STRP ATHELSTONE SA 5076 Reusing comment email and authority from existing record: 24034539 Saving record 24034539, 57 CHARLES STURT AV GRANGE SA 5022 Reusing comment email and authority from existing record: 25036080 Saving record 25036080, 7 STEPHEN TCE ST PETERS SA 5069 Reusing comment email and authority from existing record: 26002771 Saving record 26002771, LOT 282 DENSLEY RD KEITH SA 5267 Reusing comment email and authority from existing record: 25037703 Saving record 25037703, 47 EDMUND AV UNLEY SA 5061 Reusing comment email and authority from existing record: 26004779 Saving record 26004779, 11 EHRET ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25031879 Saving record 25031879, 355 RANGE RD N UPPER HERMITAGE SA 5131 Reusing comment email and authority from existing record: 24036224 Saving record 24036224, 8 COWELL CR PASADENA SA 5042 Reusing comment email and authority from existing record: 26002152 Saving record 26002152, 50 JOLLYTOWN RD LYNDOCH SA 5351 Reusing comment email and authority from existing record: 26005318 Saving record 26005318, 925 -963 PORT WAKEFIELD RD PARALOWIE SA 5108 Reusing comment email and authority from existing record: 25040577 Saving record 25040577, 6 VOHR ST JAMESTOWN SA 5491 Reusing comment email and authority from existing record: 25037337 Saving record 25037337, LOT 42 RESERVE TCE ALDGATE SA 5154 Reusing comment email and authority from existing record: 26005585 Saving record 26005585, 18 HEREFORD AV TRINITY GARDENS SA 5068 Reusing comment email and authority from existing record: 25030719 Saving record 25030719, 13 HINDMARSH RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 25027980 Saving record 25027980, 71 ALBERT ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 25037300 Saving record 25037300, 409 KING RD VIRGINIA SA 5120 Reusing comment email and authority from existing record: 25011833 Saving record 25011833, 68 WOODLAND WAY TERINGIE SA 5072 Reusing comment email and authority from existing record: 26005004 Saving record 26005004, 249 COMMERCIAL ST W MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26002653 Saving record 26002653, 113 RUNDLE ST KENT TOWN SA 5067 Reusing comment email and authority from existing record: 25025021 Saving record 25025021, 115 CHALK HILL RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 26000658 Saving record 26000658, 41 MCINTYRE RD WHYALLA BARSON SA 5601 Reusing comment email and authority from existing record: 25034661 Saving record 25034661, 57 ALABAMA AV PROSPECT SA 5082 Reusing comment email and authority from existing record: 25040652 Saving record 25040652, 329 BRIGHTON RD NORTH BRIGHTON SA 5048 Reusing comment email and authority from existing record: 24023472 Saving record 24023472, LOT 101 FULFORD TCE LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25031464 Saving record 25031464, 23 LITTLE PAXTON ST WILLASTON SA 5118 Reusing comment email and authority from existing record: 26003581 Saving record 26003581, 2 TONGALLA ST SEAFORD SA 5169 Reusing comment email and authority from existing record: 26006139 Saving record 26006139, 56 WEMBLEY AV BRIDGEWATER SA 5155 Reusing comment email and authority from existing record: 25037332 Saving record 25037332, 29 MATHESON AV FINDON SA 5023 Reusing comment email and authority from existing record: 25037283 Saving record 25037283, 188 ESPLANADE PORT NOARLUNGA SOUTH SA 5167 Reusing comment email and authority from existing record: 25009447 Saving record 25009447, 18 BENNETT ST MAYLANDS SA 5069 Reusing comment email and authority from existing record: 25035754 Saving record 25035754, 25 LAURA ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 25035661 Saving record 25035661, 14 NUNN CT GOLDEN GROVE SA 5125 Reusing comment email and authority from existing record: 25040620 Saving record 25040620, 14 HANSON AV HEATHPOOL SA 5068 Reusing comment email and authority from existing record: 26001159 Saving record 26001159, 79 ARUMPO ST RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 25033392 Saving record 25033392, 15 WOODLAND WAY TERINGIE SA 5072 Reusing comment email and authority from existing record: 26002661 Saving record 26002661, 183 LONGWOOD RD HEATHFIELD SA 5153 Reusing comment email and authority from existing record: 26002577 Saving record 26002577, 2 CARALUE RD MARINO SA 5049 Reusing comment email and authority from existing record: 26000479 Saving record 26000479, 44 GLEBE DR LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25030363 Saving record 25030363, UNIT 1 5 COOINDA CT SALISBURY HEIGHTS SA 5109 Reusing comment email and authority from existing record: 26004747 Saving record 26004747, 4 ALLANDALE AV GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 25033631 Saving record 25033631, 95A FISHER ST FULLARTON SA 5063 Reusing comment email and authority from existing record: 26000750 Saving record 26000750, 29 PRINCES HWY LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25039579 Saving record 25039579, 10 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26004823 Saving record 26004823, 17 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25040934 Saving record 25040934, 145 MOUNT BARKER RD HAHNDORF SA 5245 Reusing comment email and authority from existing record: 25028542 Saving record 25028542, 73 LOVICK RD CLARENDON SA 5157 Reusing comment email and authority from existing record: 24040700 Saving record 24040700, 14 TEMPLE CT OTTOWAY SA 5013 Reusing comment email and authority from existing record: 26003352 Saving record 26003352, 135 GREENHILL RD UNLEY SA 5061 Reusing comment email and authority from existing record: 25038853 Saving record 25038853, 40 -44 WATERFALL GULLY RD BURNSIDE SA 5066 Reusing comment email and authority from existing record: 25037762 Saving record 25037762, 82 MARYVALE RD ATHELSTONE SA 5076 Reusing comment email and authority from existing record: 26000491 Saving record 26000491, 480 HEYSEN BVD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 25026598 Saving record 25026598, 100 GLYNBURN RD HECTORVILLE SA 5073 Reusing comment email and authority from existing record: 24040054 Saving record 24040054, 26 ADELAIDE RD TUNGKILLO SA 5236 Reusing comment email and authority from existing record: 25034717 Saving record 25034717, LOT 379 STOCK ROUTE RD POINT PASS SA 5374 Reusing comment email and authority from existing record: 24040450 Saving record 24040450, 11647 GOYDER HWY MARKARANKA SA 5330 Reusing comment email and authority from existing record: 24042493 Saving record 24042493, LOT 22 GREEN ST COORABIE SA 5690 Reusing comment email and authority from existing record: 25040629 Saving record 25040629, 94 FIRST AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 26004581 Saving record 26004581, LOT 21 CHARTERIS ST PORT ELLIOT SA 5212 Reusing comment email and authority from existing record: 25008932 Saving record 25008932, LOT 71 GULLY RD CAREY GULLY SA 5144 Reusing comment email and authority from existing record: 26001618 Saving record 26001618, 14 LEITCH RD ROSEWORTHY SA 5371 Reusing comment email and authority from existing record: 26000652 Saving record 26000652, 38 BEADNALL TCE GLENGOWRIE SA 5044 Reusing comment email and authority from existing record: 26000709 Saving record 26000709, 27 VENABLES ST MACCLESFIELD SA 5153 Reusing comment email and authority from existing record: 26003636 Saving record 26003636, LOT 460 ELIZA ST SOUTHEND SA 5280 Reusing comment email and authority from existing record: 25036265 Saving record 25036265, 22 ARACHNE DR HALLETT COVE SA 5158 First Application data retrieved: {"publicNotificationID"=>12834, "applicationID"=>26005318, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"925 -963 PORT WAKEFIELD RD PARALOWIE SA 5108", "developmentDescription"=>"Community Facility and Indoor Recreation facility (clubhouse) in association with the Aspen Lifestyle Paralowie lifestyle village.", "closingDate"=>"4/2/2026 12:00:00 AM", "decisionAuthority"=>"City of Salisbury", "relevantAuthority"=>"City of Salisbury", "locationCouncil"=>"CITY OF SALISBURY", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1071817, "applicationId"=>26005318, "contactName"=>"Aspen Group ", "address"=>"Suite 21, 285A Crown Street Surry Hills 2010"}]} Found 76 applications that were already in the database, and added 0 new applications. Added 18.67 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 6 Adelaide Hills Council 1 Alexandrina Council 1 City of Adelaide 2 City of Burnside 3 City of Campbelltown 2 City of Charles Sturt 2 City of Holdfast Bay 4 City of Marion 1 City of Mitcham 2 City of Mt Gambier 7 City of Norwood, Payneham and St. Peters 4 City of Onkaparinga 1 City of Playford 2 City of Port Adelaide Enfield 2 City of Prospect 2 City of Salisbury 1 City of Tea Tree Gully 4 City of Unley 1 City of West Torrens 1 City of Whyalla 1 District Council of Kingston 1 District Council of Loxton Waikerie 1 District Council of Yankalilla 1 Light Regional Council 1 Lower Eyre Council 1 Mid Murray Council 9 Mount Barker District Council 1 Northern Areas Council 1 Port Pirie Regional Council 1 Regional Council of Goyder 1 Rural City of Murray Bridge 4 State Planning Commission 1 Tatiara District Council 1 The Barossa Council 1 Town of Gawler 1 Wattle Range Council

Data

Downloaded 4538 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke DevAppProject softgrow odnagroup ianheggie-oaf eucodepy seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.7 MB) Use the API

rows 10 / 74211

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 25.7 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    76 records added, 76 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    80 records added, 80 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    80 records added, 72 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    84 records added, 80 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    88 records added, 77 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb