planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 16.23s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 92 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26016999 Saving record 26016999, 15 SEAFIELD AV KINGSWOOD SA 5062 Reusing comment email and authority from existing record: 26015551 Saving record 26015551, 110 SQUARE MILE RD SQUARE MILE SA 5291 Reusing comment email and authority from existing record: 26021816 Saving record 26021816, 78 SWANPORT RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 26011995 Saving record 26011995, 24 TRAMINER WAY AULDANA SA 5072 Reusing comment email and authority from existing record: 26012853 Saving record 26012853, LOT 53 BAKERS GULLY RD KANGARILLA SA 5157 Reusing comment email and authority from existing record: 26022262 Saving record 26022262, 1 IAN CT PARADISE SA 5075 Reusing comment email and authority from existing record: 26013997 Saving record 26013997, 1A HEXHAM AV MYRTLE BANK SA 5064 Reusing comment email and authority from existing record: 26021188 Saving record 26021188, 14 BIRKDALE GR WEST LAKES SA 5021 Reusing comment email and authority from existing record: 26019702 Saving record 26019702, LOT 2 STURT ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26009103 Saving record 26009103, 137 KENSINGTON RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26018307 Saving record 26018307, 5 ELMGLADE RD SPRINGFIELD SA 5062 Reusing comment email and authority from existing record: 25034514 Saving record 25034514, LOT 1 SMITH HILL RD CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 26022529 Saving record 26022529, 3 COLLEGE ST PORT ADELAIDE SA 5015 Reusing comment email and authority from existing record: 26006755 Saving record 26006755, 29 DOHLE RD YAHL SA 5291 Reusing comment email and authority from existing record: 26022094 Saving record 26022094, LOT 501 NORTH TCE MANNUM SA 5238 Reusing comment email and authority from existing record: 25038398 Saving record 25038398, 185 -199 ARCHER ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25040600 Saving record 25040600, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26018820 Saving record 26018820, 7 -9 GAYNOR AV KEITH SA 5267 Reusing comment email and authority from existing record: 26019185 Saving record 26019185, 11 -17 HINDMARSH RD MCCRACKEN SA 5211 Reusing comment email and authority from existing record: 26010679 Saving record 26010679, 9 STELLA ST DARLINGTON SA 5047 Reusing comment email and authority from existing record: 26019314 Saving record 26019314, 49 GEORGE ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25001262 Saving record 25001262, 279 SAMPSON RD MYPONGA BEACH SA 5202 Reusing comment email and authority from existing record: 26006236 Saving record 26006236, 7 INVERNESS WAY WALLAROO SA 5556 Reusing comment email and authority from existing record: 26018637 Saving record 26018637, 158 COWRA ST RENMARK SA 5341 Reusing comment email and authority from existing record: 26023377 Saving record 26023377, 377 ESPLANADE SEMAPHORE PARK SA 5019 Reusing comment email and authority from existing record: 26014751 Saving record 26014751, 5 KALEV CT HAPPY VALLEY SA 5159 Reusing comment email and authority from existing record: 24035616 Saving record 24035616, 53 GOODWOOD RD WAYVILLE SA 5034 Reusing comment email and authority from existing record: 25040452 Saving record 25040452, 254 MELBOURNE ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25024043 Saving record 25024043, 77 SOUTH TCE ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26022616 Saving record 26022616, 74 -74A MELBOURNE ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25015965 Saving record 25015965, LOT 51 DYSON RD LONSDALE SA 5160 Reusing comment email and authority from existing record: 26011456 Saving record 26011456, 20 LEWIS RD CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 26014345 Saving record 26014345, 87 -89 OLD SWANPORT RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 26021409 Saving record 26021409, 4 OWEN ST TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26021790 Saving record 26021790, 29 FRANKLIN PDE ENCOUNTER BAY SA 5211 Reusing comment email and authority from existing record: 26010288 Saving record 26010288, 50A LONGWOOD RD STIRLING SA 5152 Reusing comment email and authority from existing record: 26012018 Saving record 26012018, 15 FOURTH AV EVERARD PARK SA 5035 Reusing comment email and authority from existing record: 26020663 Saving record 26020663, 2B BAKEWELL ST TUSMORE SA 5065 Reusing comment email and authority from existing record: 26014103 Saving record 26014103, 20 SMITH-DORRIEN ST NETHERBY SA 5062 Reusing comment email and authority from existing record: 26018287 Saving record 26018287, 11 GLEN ROWAN RD WOODVILLE SOUTH SA 5011 Reusing comment email and authority from existing record: 26007870 Saving record 26007870, 310 -314 DIAGONAL RD OAKLANDS PARK SA 5046 Reusing comment email and authority from existing record: 24042219 Saving record 24042219, 150 TATACHILLA RD MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 26022975 Saving record 26022975, 39 -41 FULLARTON RD KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26021929 Saving record 26021929, LOT 61 WELLS ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26021756 Saving record 26021756, 41 WELLS ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26021920 Saving record 26021920, 174 WARE RD NETHERTON SA 5301 Reusing comment email and authority from existing record: 26017965 Saving record 26017965, 1132 MONTACUTE RD MONTACUTE SA 5134 Reusing comment email and authority from existing record: 26018019 Saving record 26018019, 126 AUGUSTA ST GLENELG EAST SA 5045 Reusing comment email and authority from existing record: 25040132 Saving record 25040132, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26021717 Saving record 26021717, 2 -3 AROHA TCE FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26018986 Saving record 26018986, 43 GLENEAGLES RD MOUNT OSMOND SA 5064 Reusing comment email and authority from existing record: 26008393 Saving record 26008393, 14 HILLTOP DR UPPER STURT SA 5156 Reusing comment email and authority from existing record: 25040599 Saving record 25040599, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26018607 Saving record 26018607, 248 CLIFF VIEW DR WALKER FLAT SA 5238 Reusing comment email and authority from existing record: 26011452 Saving record 26011452, 229 ALEXANDER AV BIBARINGA SA 5118 Reusing comment email and authority from existing record: 26015043 Saving record 26015043, 7 BOULDER CT MORPHETT VALE SA 5162 Reusing comment email and authority from existing record: 26018979 Saving record 26018979, LOT 1 SNAPPER HILL RD WANGARY SA 5607 Reusing comment email and authority from existing record: 25040601 Saving record 25040601, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26021128 Saving record 26021128, 26 PARADISE DR WIRRINA COVE SA 5204 Reusing comment email and authority from existing record: 26022046 Saving record 26022046, 1080 OLD STURT HWY BERRI SA 5343 Reusing comment email and authority from existing record: 26016021 Saving record 26016021, 15 DEW ST MILE END SA 5031 Reusing comment email and authority from existing record: 25028168 Saving record 25028168, 3029 RIDDOCH HWY WILLALOOKA SA 5267 Reusing comment email and authority from existing record: 26021735 Saving record 26021735, UNIT 1 54 COTTAGE LANE HACKHAM SA 5163 Reusing comment email and authority from existing record: 26001399 Saving record 26001399, 41 -47 GLENROY ST ATHOL PARK SA 5012 Reusing comment email and authority from existing record: 26009745 Saving record 26009745, 165 MCVITTIES RD BIRDWOOD SA 5234 Reusing comment email and authority from existing record: 26013315 Saving record 26013315, 38 TENNYSON DR BEAUMONT SA 5066 Reusing comment email and authority from existing record: 25040602 Saving record 25040602, LOT 8000 MONTGOMERY DR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26011307 Saving record 26011307, 19A PARHAM RD EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 26011398 Saving record 26011398, 3 PETERS AV FULHAM GARDENS SA 5024 Reusing comment email and authority from existing record: 25038776 Saving record 25038776, 17 O'HALLORAN TCE MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26008941 Saving record 26008941, 1 ADELE AV KIDMAN PARK SA 5025 Reusing comment email and authority from existing record: 26021552 Saving record 26021552, LOT 3 WATERHOUSE ST EAST MOONTA SA 5558 Reusing comment email and authority from existing record: 26023142 Saving record 26023142, 13 FRANK ST ST MORRIS SA 5068 Reusing comment email and authority from existing record: 26005970 Saving record 26005970, 27 BRANDRETH ST TUSMORE SA 5065 Reusing comment email and authority from existing record: 26021220 Saving record 26021220, 8 ALAWA AV MODBURY NORTH SA 5092 Reusing comment email and authority from existing record: 26009650 Saving record 26009650, 10 FOURTH ST WINGFIELD SA 5013 Reusing comment email and authority from existing record: 26022061 Saving record 26022061, 64 MORCOMBE RD MOONTA MINES SA 5558 Reusing comment email and authority from existing record: 26023196 Saving record 26023196, 4 SANCTUARY AV KIDMAN PARK SA 5025 Reusing comment email and authority from existing record: 26021855 Saving record 26021855, 63 WOODFORDE DR NORTH BEACH SA 5556 Reusing comment email and authority from existing record: 25018172 Saving record 25018172, 1905 DENIAL BAY RD NADIA SA 5690 Reusing comment email and authority from existing record: 25032103 Saving record 25032103, LOT 1 DE MANNU RD MUNNO PARA DOWNS SA 5115 Reusing comment email and authority from existing record: 26023799 Saving record 26023799, UNIT 2 27A TOLMIE ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26017401 Saving record 26017401, 53 REDWARD AV GREENACRES SA 5086 Reusing comment email and authority from existing record: 26016411 Saving record 26016411, LOT 1001 PARK LAKE BVD BLAKEVIEW SA 5114 Reusing comment email and authority from existing record: 25035601 Saving record 25035601, 28 KLIPPEL AV TROTT PARK SA 5158 Reusing comment email and authority from existing record: 26020860 Saving record 26020860, 2 MAXWELL TCE EMU BAY SA 5223 Reusing comment email and authority from existing record: 26016803 Saving record 26016803, 35A PADDLESTEAMER DR MILANG SA 5256 Reusing comment email and authority from existing record: 26019642 Saving record 26019642, 39 MACFARLANE ST GLENELG NORTH SA 5045 Reusing comment email and authority from existing record: 26020780 Saving record 26020780, 9 MANOAH DR UPPER STURT SA 5156 Reusing comment email and authority from existing record: 26018696 Saving record 26018696, 291 HAMILTONS RD SPRINGTON SA 5235 Reusing comment email and authority from existing record: 26020836 Saving record 26020836, 9 ELIZABETH CR CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 26019543 Saving record 26019543, LOT 11 MEMFORD WAY FLAGSTAFF HILL SA 5159 First Application data retrieved: {"publicNotificationID"=>13683, "applicationID"=>26011456, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"20 LEWIS RD CARRICKALINGA SA 5204", "developmentDescription"=>"dwelling additions including a second floor level with balconies, a garage and a carport", "closingDate"=>"8/20/2026 12:00:00 AM", "decisionAuthority"=>"Fleurieu Regional Assessment Panel", "relevantAuthority"=>"District Council of Yankalilla", "locationCouncil"=>"THE DC OF YANKALILLA", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1102893, "applicationId"=>26011456, "contactName"=>"Samalex Pty Ltd ", "address"=>"216 MOUNT BARKER ROAD ALDGATE 5154"}]} Found 92 applications that were already in the database, and added 0 new applications. Added 16.23 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 4 Adelaide Hills Council 1 City of Adelaide 5 City of Burnside 1 City of Campbelltown 7 City of Charles Sturt 2 City of Holdfast Bay 2 City of Marion 6 City of Mitcham 3 City of Mt Gambier 5 City of Norwood, Payneham and St. Peters 7 City of Onkaparinga 3 City of Playford 3 City of Port Adelaide Enfield 1 City of Tea Tree Gully 5 City of Unley 2 City of Victor Harbor 1 City of West Torrens 4 Copper Coast Council 2 District Council of Grant 5 District Council of Yankalilla 1 Kangaroo Island Council 1 Lower Eyre Council 2 Mid Murray Council 5 Mount Barker District Council 1 Renmark Paringa Council 1 Rural City of Murray Bridge 7 State Planning Commission 2 Tatiara District Council 1 The Barossa Council 1 The Berri Barmera Council 1 The Coorong District Council

Data

Downloaded 4933 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn qs4v8thvrq-boop DevAppProject softgrow odnagroup ianheggie-oaf 538digital eucodepy seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.1 MB) Use the API

rows 10 / 74878

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.2 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    92 records added, 92 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    94 records added, 84 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    90 records added, 84 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    92 records added, 85 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    87 records added, 77 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb