planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 23.65s to avoid 429 Too Many Requests errors Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 102 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26022285 Saving record 26022285, 510 REGENCY RD ENFIELD SA 5085 Reusing comment email and authority from existing record: 26022765 Saving record 26022765, 51 STEPHEN TCE ST PETERS SA 5069 Reusing comment email and authority from existing record: 26024831 Saving record 26024831, 51 -61 RAILWAY STATION RD STIRLING NORTH SA 5710 Reusing comment email and authority from existing record: 26025956 Saving record 26025956, 35 HAWTHORNDENE DR GLENALTA SA 5052 Reusing comment email and authority from existing record: 26020193 Saving record 26020193, 1 ELIZABETH ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26014812 Saving record 26014812, LOT 11 ADORE PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26024782 Saving record 26024782, 19 WILLIAM ST ALBERTON SA 5014 Reusing comment email and authority from existing record: 26022248 Saving record 26022248, 5 MAJORS RD O'HALLORAN HILL SA 5158 Reusing comment email and authority from existing record: 26019289 Saving record 26019289, 56 HILL ST CRAFERS WEST SA 5152 Reusing comment email and authority from existing record: 26017424 Saving record 26017424, 82 NICOLAI RD ROCKY GULLY SA 5254 Reusing comment email and authority from existing record: 25008904 Saving record 25008904, 59 -61 GRANGE RD WELLAND SA 5007 Reusing comment email and authority from existing record: 26025500 Saving record 26025500, 7 SENNA RD WINGFIELD SA 5013 Reusing comment email and authority from existing record: 26024773 Saving record 26024773, 29 REGENT ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26019703 Saving record 26019703, 3 BONVIEW AV PANORAMA SA 5041 Reusing comment email and authority from existing record: 26011235 Saving record 26011235, 85 ALABAMA AV PROSPECT SA 5082 Reusing comment email and authority from existing record: 25034248 Saving record 25034248, UNIT 5 29 STURT LANE ONKAPARINGA HEIGHTS SA 5163 Reusing comment email and authority from existing record: 26026843 Saving record 26026843, 877 CLARKES LANE GREEN PATCH SA 5607 Reusing comment email and authority from existing record: 26024540 Saving record 26024540, 18 ST ANDREWS ST WALKERVILLE SA 5081 Reusing comment email and authority from existing record: 26015207 Saving record 26015207, 23 VICTORIA ST HAHNDORF SA 5245 Reusing comment email and authority from existing record: 26025409 Saving record 26025409, 36 FASHODA ST HYDE PARK SA 5061 Reusing comment email and authority from existing record: 26012842 Saving record 26012842, 15 VICTORIA ST MILE END SA 5031 Reusing comment email and authority from existing record: 26022811 Saving record 26022811, UNIT 7 24 COMMERCIAL ST MARLESTON SA 5033 Reusing comment email and authority from existing record: 26024104 Saving record 26024104, 15 WRIGHT ST HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26022254 Saving record 26022254, 9 GORDON RD PROSPECT SA 5082 Reusing comment email and authority from existing record: 26025544 Saving record 26025544, 28 BILYARA RD TANUNDA SA 5352 Reusing comment email and authority from existing record: 26022747 Saving record 26022747, 83 MINTARO RD MINTARO SA 5415 Reusing comment email and authority from existing record: 26018819 Saving record 26018819, 233 HANSON RD ATHOL PARK SA 5012 Reusing comment email and authority from existing record: 25029360 Saving record 25029360, LOT 1044 SALT CREEK RD YANKALILLA SA 5203 Reusing comment email and authority from existing record: 26015690 Saving record 26015690, LOT 121 PORTLAND ST PENOLA SA 5277 Reusing comment email and authority from existing record: 26021132 Saving record 26021132, 2A PORTRUSH RD PAYNEHAM SA 5070 Reusing comment email and authority from existing record: 26023898 Saving record 26023898, 7 BLUFFVIEW RD MCCRACKEN SA 5211 Reusing comment email and authority from existing record: 26016370 Saving record 26016370, 52 FLINDERS DR STREAKY BAY SA 5680 Reusing comment email and authority from existing record: 26017464 Saving record 26017464, 44 PEAKE TCE WAIKERIE SA 5330 Reusing comment email and authority from existing record: 26022629 Saving record 26022629, 205 NORTH EAST RD HAMPSTEAD GARDENS SA 5086 Reusing comment email and authority from existing record: 26024205 Saving record 26024205, 6 RAMROD AV HALLETT COVE SA 5158 Reusing comment email and authority from existing record: 26026537 Saving record 26026537, 7 ELEANOR ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26022786 Saving record 26022786, 3 HILLCREST DR EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 24039867 Saving record 24039867, 414 THREE BRIDGES RD DEEP CREEK SA 5204 Reusing comment email and authority from existing record: 26013992 Saving record 26013992, 1 FISHER ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26016391 Saving record 26016391, LOT 1 SOUTHERN CLIFFS RD PELICAN LAGOON SA 5222 Reusing comment email and authority from existing record: 25006946 Saving record 25006946, 2 WATTLE AV ROYAL PARK SA 5014 Reusing comment email and authority from existing record: 26026631 Saving record 26026631, LOT 9200 LEGOE RD RIVERLEA PARK SA 5120 Reusing comment email and authority from existing record: 26021768 Saving record 26021768, LOT 701 DAWKINS RD TWO WELLS SA 5501 Reusing comment email and authority from existing record: 25033682 Saving record 25033682, 384 MARTINS RD GREEN FIELDS SA 5107 Reusing comment email and authority from existing record: 26015404 Saving record 26015404, LOT 1 WOMMA RD EDINBURGH NORTH SA 5113 Reusing comment email and authority from existing record: 26017839 Saving record 26017839, 103 SYDENHAM RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26026255 Saving record 26026255, 12 PLEASANT AV GLANDORE SA 5037 Reusing comment email and authority from existing record: 26021226 Saving record 26021226, 233 POLISH HILL RIVER RD POLISH HILL RIVER SA 5453 Reusing comment email and authority from existing record: 26022728 Saving record 26022728, LOT 585 STURT HWY KINGSTON ON MURRAY SA 5331 Reusing comment email and authority from existing record: 26020376 Saving record 26020376, 1273 NORTH EAST RD RIDGEHAVEN SA 5097 Reusing comment email and authority from existing record: 26001633 Saving record 26001633, LOT 409 ALDINGA RD WILLUNGA SA 5172 Reusing comment email and authority from existing record: 26015374 Saving record 26015374, 31 SMITH ST THEBARTON SA 5031 Reusing comment email and authority from existing record: 26017026 Saving record 26017026, 4 CARIGNANE ST WYNN VALE SA 5127 Reusing comment email and authority from existing record: 26019370 Saving record 26019370, 3 WILLSMORE PL URAIDLA SA 5142 Reusing comment email and authority from existing record: 26026919 Saving record 26026919, 11 ROEBUCK ST MILE END SA 5031 Reusing comment email and authority from existing record: 26024850 Saving record 26024850, 52 SIEGERSDORF RD TANUNDA SA 5352 Reusing comment email and authority from existing record: 26026046 Saving record 26026046, 114 KESSELL RD GOOLWA SA 5214 Reusing comment email and authority from existing record: 26022369 Saving record 26022369, 22 MEMORY GR LOWER INMAN VALLEY SA 5211 Reusing comment email and authority from existing record: 26014814 Saving record 26014814, LOT 12 ADORE PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26025240 Saving record 26025240, 193 WALKERVILLE TCE WALKERVILLE SA 5081 Reusing comment email and authority from existing record: 26024271 Saving record 26024271, 34 EUSTON TCE CROYDON SA 5008 Reusing comment email and authority from existing record: 26019301 Saving record 26019301, 2 YOEY CT MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26024551 Saving record 26024551, 199 BELLMORE RD WISANGER SA 5223 Reusing comment email and authority from existing record: 24032470 Saving record 24032470, 9 LAMBERT RD JOSLIN SA 5070 Reusing comment email and authority from existing record: 26023378 Saving record 26023378, 19A EMILY ST MILLICENT SA 5280 Reusing comment email and authority from existing record: 26007083 Saving record 26007083, 9 WOODHURST AV HYDE PARK SA 5061 Reusing comment email and authority from existing record: 25028711 Saving record 25028711, 31 HIGH ST SEACLIFF PARK SA 5049 Reusing comment email and authority from existing record: 26012087 Saving record 26012087, 3 ARAGON ST FULLARTON SA 5063 Reusing comment email and authority from existing record: 26023483 Saving record 26023483, 94 WOODEND RD TROTT PARK SA 5158 Reusing comment email and authority from existing record: 26022375 Saving record 26022375, 3 FULLER CT WALKERVILLE SA 5081 Reusing comment email and authority from existing record: 26025151 Saving record 26025151, 20 BUTTON RD ALDINGA BEACH SA 5173 Reusing comment email and authority from existing record: 26017546 Saving record 26017546, 11 WEST THEBARTON RD THEBARTON SA 5031 Reusing comment email and authority from existing record: 26019658 Saving record 26019658, 62 AYTON AV FULHAM SA 5024 Reusing comment email and authority from existing record: 26021484 Saving record 26021484, 40 LIGHTHOUSE DR HALLETT COVE SA 5158 Reusing comment email and authority from existing record: 26023907 Saving record 26023907, 29 LIGHT CR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 25030854 Saving record 25030854, 212 PIPELINE RD NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 26027659 Saving record 26027659, 26 AVEY RD MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 24001098 Saving record 24001098, 1711 JERVOIS RD WOODS POINT SA 5253 Reusing comment email and authority from existing record: 26003803 Saving record 26003803, 28 HUXTABLE RD WATERLOO CORNER SA 5110 Reusing comment email and authority from existing record: 25035339 Saving record 25035339, 63A PARK TCE OVINGHAM SA 5082 Reusing comment email and authority from existing record: 26021614 Saving record 26021614, 3A DEANS RD CAMPBELLTOWN SA 5074 Reusing comment email and authority from existing record: 26013609 Saving record 26013609, 403 BRIDGE RD PARA HILLS SA 5096 Reusing comment email and authority from existing record: 26014818 Saving record 26014818, LOT 10 ADORE PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26025345 Saving record 26025345, UNIT 8 108 GLENROY ST PENNINGTON SA 5013 Reusing comment email and authority from existing record: 26005796 Saving record 26005796, 401 PAYNEHAM RD MARDEN SA 5070 Reusing comment email and authority from existing record: 26017001 Saving record 26017001, 17 -19 CAMPBELL ST KINGSCOTE SA 5223 Reusing comment email and authority from existing record: 26023007 Saving record 26023007, LOT 19 KAPUNDA ST EUDUNDA SA 5374 Reusing comment email and authority from existing record: 26019008 Saving record 26019008, 18 BRIAR AV MEDINDIE SA 5081 Reusing comment email and authority from existing record: 26024673 Saving record 26024673, 85 KENILWORTH RD PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26023358 Saving record 26023358, 515 MAGILL RD TRANMERE SA 5073 Reusing comment email and authority from existing record: 26025303 Saving record 26025303, 561A ESPLANADE GRANGE SA 5022 Reusing comment email and authority from existing record: 26025781 Saving record 26025781, LOT 385 WARNERTOWN RD BUNGAMA SA 5540 Reusing comment email and authority from existing record: 26008150 Saving record 26008150, 59 ARCHER ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26023343 Saving record 26023343, 39 HERO AV MIDDLETON SA 5213 Reusing comment email and authority from existing record: 26017522 Saving record 26017522, UNIT 1 4 TRIMMER RD ELIZABETH SOUTH SA 5112 Reusing comment email and authority from existing record: 26020624 Saving record 26020624, 152 MAURICE RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 26015050 Saving record 26015050, 15 ARABRIE AV EDWARDSTOWN SA 5039 Reusing comment email and authority from existing record: 26014625 Saving record 26014625, 1 GILES ST TOORAK GARDENS SA 5065 Reusing comment email and authority from existing record: 25037233 Saving record 25037233, 39 SHIELL RD BERRI SA 5343 Reusing comment email and authority from existing record: 26005732 Saving record 26005732, 26 KINGS AV BURNSIDE SA 5066 Reusing comment email and authority from existing record: 26021683 Saving record 26021683, 28 ADELAIDE TCE ST MARYS SA 5042 Reusing comment email and authority from existing record: 26023254 Saving record 26023254, 105 NORTH ST HENLEY BEACH SA 5022 First Application data retrieved: {"publicNotificationID"=>13847, "applicationID"=>26025781, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"LOT 385 WARNERTOWN RD BUNGAMA SA 5540, LOT 400 WARNERTOWN RD BUNGAMA SA 5540", "developmentDescription"=>"Change the existing use to a place of worship, construction of associated hall, and building alterations to the existing clubrooms (toilet facilities) and associated parking, landscaping and fencing ", "closingDate"=>"9/17/2026 12:00:00 AM", "decisionAuthority"=>"Upper Spencer Gulf Regional Assessment Panel", "relevantAuthority"=>"Port Pirie Regional Council", "locationCouncil"=>"Port Pirie", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1175590, "applicationId"=>26025781, "contactName"=>"Bella Homes Pty Ltd c/- Future Urban ", "address"=>"74 PIRIE STREET ADELAIDE 5000"}]} Found 102 applications that were already in the database, and added 0 new applications. Added 23.65 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 2 Adelaide Hills Council 1 Adelaide Plains Council 2 Alexandrina Council 1 City of Adelaide 2 City of Burnside 2 City of Campbelltown 9 City of Charles Sturt 6 City of Marion 4 City of Mitcham 3 City of Mt Gambier 7 City of Norwood, Payneham and St. Peters 3 City of Onkaparinga 4 City of Playford 4 City of Port Adelaide Enfield 1 City of Port Augusta 2 City of Prospect 2 City of Salisbury 2 City of Tea Tree Gully 5 City of Unley 2 City of Victor Harbor 6 City of West Torrens 2 Clare and Gilbert Valleys Council 1 District Council of Loxton Waikerie 1 District Council of Streaky Bay 2 District Council of Yankalilla 3 Kangaroo Island Council 1 Light Regional Council 1 Lower Eyre Council 5 Mount Barker District Council 1 Port Pirie Regional Council 1 Regional Council of Goyder 3 Rural City of Murray Bridge 2 State Planning Commission 2 The Barossa Council 1 The Berri Barmera Council 4 The Corporation of the Town of Walkerville 2 Wattle Range Council

Data

Downloaded 4998 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn qs4v8thvrq-boop DevAppProject softgrow odnagroup ianheggie-oaf 538digital eucodepy seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.2 MB) Use the API

rows 10 / 75015

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.3 MB

History

  • Auto ran revision da42deb1 and completed successfully .
    102 records added, 102 records removed, 1 record updated in the database
  • Auto ran revision da42deb1 and completed successfully .
    102 records added, 95 records removed, 1 record updated in the database
  • Auto ran revision da42deb1 and completed successfully .
    105 records added, 105 records removed, 1 record updated in the database
  • Auto ran revision da42deb1 and completed successfully .
    105 records added, 90 records removed, 1 record updated in the database
  • Auto ran revision da42deb1 and completed successfully .
    105 records added, 105 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb