planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 24.77s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 97 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 25038858 Saving record 25038858, 13 STUCKEY ST MILLICENT SA 5280 Reusing comment email and authority from existing record: 25037837 Saving record 25037837, 119B THORPE RD CLAYTON BAY SA 5256 Reusing comment email and authority from existing record: 25031903 Saving record 25031903, 45D CLANCY RD GAWLER BELT SA 5118 Reusing comment email and authority from existing record: 25029167 Saving record 25029167, 68 KINGSFORD RD KINGSFORD SA 5118 Reusing comment email and authority from existing record: 25040373 Saving record 25040373, 95 PARK TCE SALISBURY SA 5108 Reusing comment email and authority from existing record: 25040445 Saving record 25040445, 2 HAWKE WAY ANGLE VALE SA 5117 Reusing comment email and authority from existing record: 25039879 Saving record 25039879, 120 WATTLE ST FULLARTON SA 5063 Reusing comment email and authority from existing record: 25029782 Saving record 25029782, 46 GRANT AV ROSE PARK SA 5067 Reusing comment email and authority from existing record: 25035854 Saving record 25035854, 135 LOCHSIDE DR WEST LAKES SA 5021 Reusing comment email and authority from existing record: 25001485 Saving record 25001485, 1 BAGOT ST GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 25032916 Saving record 25032916, 597 BOXER RD WISANGER SA 5223 Reusing comment email and authority from existing record: 25038577 Saving record 25038577, 6 DEEBLE ST EAST MOONTA SA 5558 Reusing comment email and authority from existing record: 25035603 Saving record 25035603, 49 ALFRED ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25037793 Saving record 25037793, 259 TAPLEYS HILL RD SEATON SA 5023 Reusing comment email and authority from existing record: 25037900 Saving record 25037900, LOT 103 OLD PORT WAKEFIELD RD TWO WELLS SA 5501 Reusing comment email and authority from existing record: 25032416 Saving record 25032416, 659A SPRING GULLY RD SPRING GULLY SA 5453 Reusing comment email and authority from existing record: 25037859 Saving record 25037859, LOT 1 DUNSTAN RD WAIKERIE SA 5330 Reusing comment email and authority from existing record: 25037523 Saving record 25037523, LOT 2 BAYVIEW RD WISANGER SA 5223 Reusing comment email and authority from existing record: 25013426 Saving record 25013426, 1488 KEYNETON RD KEYNETON SA 5353 Reusing comment email and authority from existing record: 25040505 Saving record 25040505, 1 CRAIGWOOD DR BELAIR SA 5052 Reusing comment email and authority from existing record: 25021907 Saving record 25021907, UNIT 1-2 195 MAIN NORTH RD NAILSWORTH SA 5083 Reusing comment email and authority from existing record: 25036966 Saving record 25036966, 155 KIRKLANDS RD FOX SA 5272 Reusing comment email and authority from existing record: 25010273 Saving record 25010273, 32 WHEATON RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 25036495 Saving record 25036495, 8871 PORT WAKEFIELD HWY PORT WAKEFIELD SA 5550 Reusing comment email and authority from existing record: 25037619 Saving record 25037619, 1270 OLD PORT RD WEST LAKES SA 5021 Reusing comment email and authority from existing record: 25030325 Saving record 25030325, LOT 329 HINZE LANE PENOLA SA 5277 Reusing comment email and authority from existing record: 25023116 Saving record 25023116, UNIT 8 7B PEACHEY RD EDINBURGH NORTH SA 5113 Reusing comment email and authority from existing record: 25038671 Saving record 25038671, LOT 31 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25040302 Saving record 25040302, LOT 5 DARANDA TCE MILANG SA 5256 Reusing comment email and authority from existing record: 25039414 Saving record 25039414, LOT 52 LARNE DR MOUNT WEDGE SA 5670 Reusing comment email and authority from existing record: 25037668 Saving record 25037668, 47 HAY RD LINDEN PARK SA 5065 Reusing comment email and authority from existing record: 25025016 Saving record 25025016, LOT 11 MOUNT CRAWFORD RD WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 25030893 Saving record 25030893, 68 KINGSFORD RD KINGSFORD SA 5118 Reusing comment email and authority from existing record: 24040054 Saving record 24040054, 26 ADELAIDE RD TUNGKILLO SA 5236 Reusing comment email and authority from existing record: 25032294 Saving record 25032294, UNIT 3 4 WALLACE ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25030840 Saving record 25030840, 9 MANOAH DR UPPER STURT SA 5156 Reusing comment email and authority from existing record: 25038703 Saving record 25038703, -31.890139 138.423361 Reusing comment email and authority from existing record: 25036810 Saving record 25036810, 263 -277 PAYNEHAM RD ROYSTON PARK SA 5070 Reusing comment email and authority from existing record: 25040520 Saving record 25040520, LOT 2 GROVE RD BRAMFIELD SA 5670 Reusing comment email and authority from existing record: 25029487 Saving record 25029487, 8 -10 BRAY AV TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 25033387 Saving record 25033387, 63 PIGEON FLAT RD BORDERTOWN SA 5268 Reusing comment email and authority from existing record: 25011401 Saving record 25011401, 81 OSMOND TCE NORWOOD SA 5067 Reusing comment email and authority from existing record: 25038411 Saving record 25038411, 178 STURT ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 25036272 Saving record 25036272, 8 HAYWARD ST MCCRACKEN SA 5211 Reusing comment email and authority from existing record: 25032528 Saving record 25032528, LOT 666 HEWARD RD MONASH SA 5342 Reusing comment email and authority from existing record: 25035061 Saving record 25035061, 9 SEAVIEW RD MOUNT OSMOND SA 5064 Reusing comment email and authority from existing record: 25040023 Saving record 25040023, 178 EAST TCE ADELAIDE SA 5000 Reusing comment email and authority from existing record: 25029577 Saving record 25029577, 111 CHELTENHAM ST MALVERN SA 5061 Reusing comment email and authority from existing record: 25027414 Saving record 25027414, 102 CORNISHMANS HILL RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 25026151 Saving record 25026151, 13 COMMERCIAL RD HYDE PARK SA 5061 Reusing comment email and authority from existing record: 25040334 Saving record 25040334, 4 GOOLWA TCE GOOLWA SA 5214 Reusing comment email and authority from existing record: 25029083 Saving record 25029083, 49 HEATH RD CRAFERS WEST SA 5152 Reusing comment email and authority from existing record: 25035499 Saving record 25035499, LOT 32 CASHEL ST PASADENA SA 5042 Reusing comment email and authority from existing record: 25028569 Saving record 25028569, 17 SPENCER ST MACDONALD PARK SA 5121 Reusing comment email and authority from existing record: 25030445 Saving record 25030445, LOT 1 JENNER RD GILLENTOWN SA 5453 Reusing comment email and authority from existing record: 25017721 Saving record 25017721, 97 SHERRIFF RD MASLIN BEACH SA 5170 Reusing comment email and authority from existing record: 25033080 Saving record 25033080, 12 PARANA ST FLINDERS PARK SA 5025 Reusing comment email and authority from existing record: 25034267 Saving record 25034267, 30 ONKAPARINGA VALLEY RD VERDUN SA 5245 Reusing comment email and authority from existing record: 25035383 Saving record 25035383, 46 EAST TCE KINGSTON SE SA 5275 Reusing comment email and authority from existing record: 25037655 Saving record 25037655, 9 CHARLES ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 25038140 Saving record 25038140, 4 STORER LANE ENCOUNTER BAY SA 5211 Reusing comment email and authority from existing record: 25040986 Saving record 25040986, 15 CHELMSFORD AV MILLSWOOD SA 5034 Reusing comment email and authority from existing record: 25019037 Saving record 25019037, 11 SCHOLZ AV NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 25040002 Saving record 25040002, 1A CUDMORE TCE WHYALLA SA 5600 Reusing comment email and authority from existing record: 25037950 Saving record 25037950, 85 SYDNEY RD NAIRNE SA 5252 Reusing comment email and authority from existing record: 25040507 Saving record 25040507, 3 NOBLE ST OVINGHAM SA 5082 Reusing comment email and authority from existing record: 25039492 Saving record 25039492, 3 MERINO AV CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 25027918 Saving record 25027918, 2A MARLBOROUGH ST COLLEGE PARK SA 5069 Reusing comment email and authority from existing record: 25027118 Saving record 25027118, LOT 2 VICTORIA TCE GAWLER SA 5118 Reusing comment email and authority from existing record: 25037271 Saving record 25037271, 36 NANTHEA TCE N UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 25009925 Saving record 25009925, 18 OAKWOOD RD OAKBANK SA 5243 Reusing comment email and authority from existing record: 25022247 Saving record 25022247, 149 THIRD AV ROYSTON PARK SA 5070 Reusing comment email and authority from existing record: 25040548 Saving record 25040548, 5 ALBERT ST DULWICH SA 5065 Reusing comment email and authority from existing record: 25035684 Saving record 25035684, 14 MYER CT BEVERLEY SA 5009 Reusing comment email and authority from existing record: 25036900 Saving record 25036900, 1 KERR GR WEST LAKES SA 5021 Reusing comment email and authority from existing record: 26000081 Saving record 26000081, 466 BRIGHTON RD BRIGHTON SA 5048 Reusing comment email and authority from existing record: 25040368 Saving record 25040368, 6 BALLARA ST MILE END SA 5031 Reusing comment email and authority from existing record: 25021279 Saving record 25021279, 83 BURTON RD BIRDWOOD SA 5234 Reusing comment email and authority from existing record: 25037693 Saving record 25037693, 54 BATSON PDE HINDMARSH ISLAND SA 5214 Reusing comment email and authority from existing record: 25031711 Saving record 25031711, 4 CADELL ST GOOLWA SA 5214 Reusing comment email and authority from existing record: 25033164 Saving record 25033164, 20 ULINGA ST GLENELG NORTH SA 5045 Reusing comment email and authority from existing record: 25036683 Saving record 25036683, LOT 11 DAPHNE ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 25032681 Saving record 25032681, 23 SANDON AV MILLICENT SA 5280 Reusing comment email and authority from existing record: 25035618 Saving record 25035618, 31 ROSA ST GOODWOOD SA 5034 Reusing comment email and authority from existing record: 25038696 Saving record 25038696, 141 FULLARTON RD ROSE PARK SA 5067 Reusing comment email and authority from existing record: 25006320 Saving record 25006320, 261 EDINBURGH RD EDINBURGH SA 5111 Reusing comment email and authority from existing record: 25033619 Saving record 25033619, UNIT 1 G 16 BAGOT ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 22039949 Saving record 22039949, 8 KEITH ST WHYALLA PLAYFORD SA 5600 Reusing comment email and authority from existing record: 24032324 Saving record 24032324, LOT 16 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25036663 Saving record 25036663, 16 PINE AV NOVAR GARDENS SA 5040 Reusing comment email and authority from existing record: 25040467 Saving record 25040467, UNIT 1-2 LOT 251 PELICAN POINT RD OUTER HARBOR SA 5018 Reusing comment email and authority from existing record: 25040375 Saving record 25040375, 7 COOK ST PARNDANA SA 5220 Reusing comment email and authority from existing record: 25040303 Saving record 25040303, 17 WARWICK AV TOORAK GARDENS SA 5065 Reusing comment email and authority from existing record: 25037398 Saving record 25037398, 4 HEWETT CR MYPONGA BEACH SA 5202 Reusing comment email and authority from existing record: 25034209 Saving record 25034209, LOT 20 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26000275 Saving record 26000275, LOT 273NE MELROSE RD PEKINA SA 5431 Reusing comment email and authority from existing record: 25035013 Saving record 25035013, 325 TORRENS RD WEST CROYDON SA 5008 First Application data retrieved: {"publicNotificationID"=>12548, "applicationID"=>25037523, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"LOT 2 BAYVIEW RD WISANGER SA 5223", "developmentDescription"=>"The proposal is a variation application to DA 22021239 to alter the layout and design of the approved dwelling and tourist accommodation, as well as introducing the construction of an outbuilding for the purpose of vehicles storage.", "closingDate"=>"2/17/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"Kangaroo Island Council", "locationCouncil"=>"KANGAROO ISLAND COUNCIL", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1027219, "applicationId"=>25037523, "contactName"=>"PEBE-EMS Pty Ltd (as trustee for The PEBE-EMS Family Trust) ", "address"=>"39 BURNELL DRIVE BELAIR 5052"}]} Found 97 applications that were already in the database, and added 0 new applications. Added 24.77 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 4 Adelaide Hills Council 1 Adelaide Plains Council 5 Alexandrina Council 2 City of Adelaide 6 City of Burnside 8 City of Charles Sturt 1 City of Holdfast Bay 2 City of Mitcham 1 City of Mt Gambier 5 City of Norwood, Payneham and St. Peters 2 City of Onkaparinga 4 City of Playford 1 City of Port Adelaide Enfield 2 City of Prospect 2 City of Salisbury 7 City of Unley 2 City of Victor Harbor 4 City of West Torrens 2 City of Whyalla 2 Clare and Gilbert Valleys Council 1 Copper Coast Council 2 District Council of Elliston 1 District Council of Kingston 1 District Council of Loxton Waikerie 1 District Council of Orroroo Carrieton 2 District Council of Yankalilla 1 Flinders Ranges Council 2 Kangaroo Island Council 2 Light Regional Council 1 Mid Murray Council 4 Mount Barker District Council 1 Naracoorte Lucindale Council 6 State Planning Commission 1 Tatiara District Council 2 The Barossa Council 1 The Berri Barmera Council 1 Town of Gawler 1 Wakefield Regional Council 3 Wattle Range Council

Data

Downloaded 4281 times by openaustralia mlandauer dcalde jesse-a-reilly repose-lecture tkrikke DevAppProject softgrow odnagroup ianheggie-oaf eucodepy seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.5 MB) Use the API

rows 10 / 74012

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 25.6 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    97 records added, 97 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    97 records added, 91 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    99 records added, 83 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    96 records added, 90 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    95 records added, 95 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb