planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 17.03s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 97 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26004697 Saving record 26004697, 48 ELIZABETH ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26006956 Saving record 26006956, 3A BRANDWOOD ST ROYAL PARK SA 5014 Reusing comment email and authority from existing record: 25037761 Saving record 25037761, 71 WOODLAND WAY TERINGIE SA 5072 Reusing comment email and authority from existing record: 26005254 Saving record 26005254, 228 -230 ADELAIDE RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 25038845 Saving record 25038845, 35 UNITY DR SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 26005208 Saving record 26005208, 966A DAWKINS RD GAWLER RIVER SA 5118 Reusing comment email and authority from existing record: 26006608 Saving record 26006608, 29 VALLEY VIEW DR MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 25028155 Saving record 25028155, 25 THIRD AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25036530 Saving record 25036530, 20 LURLINE ST MILE END SA 5031 Reusing comment email and authority from existing record: 26003462 Saving record 26003462, 21 -31 SHEFFIELD ST WOODVILLE NORTH SA 5012 Reusing comment email and authority from existing record: 25029021 Saving record 25029021, 98 SPRINGBANK RD CLAPHAM SA 5062 Reusing comment email and authority from existing record: 26004280 Saving record 26004280, LOT 3 JOHNSON RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 25032646 Saving record 25032646, UNIT 1 317 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26006316 Saving record 26006316, 445 OLD COACH RD ALDINGA SA 5173 Reusing comment email and authority from existing record: 26007781 Saving record 26007781, LOT 2 SOUTH TCE SALISBURY SA 5108 Reusing comment email and authority from existing record: 26003714 Saving record 26003714, LOT 204 SQUARE MILE RD STANLEY FLAT SA 5453 Reusing comment email and authority from existing record: 26006782 Saving record 26006782, 10 ALBERT LANE CUMMINS SA 5631 Reusing comment email and authority from existing record: 26005528 Saving record 26005528, 58 CARLTON PDE TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 25032351 Saving record 25032351, Lot 100 441 GLYNBURN RD Reusing comment email and authority from existing record: 26000364 Saving record 26000364, 469 RIVERVIEW DR BERRI SA 5343 Reusing comment email and authority from existing record: 26002510 Saving record 26002510, 13 SUMMIT FTRK MOUNT BARKER SUMMIT SA 5251 Reusing comment email and authority from existing record: 25028962 Saving record 25028962, UNIT 3 22 PAYNEHAM RD STEPNEY SA 5069 Reusing comment email and authority from existing record: 26005012 Saving record 26005012, 24 HERBERT ST CHELTENHAM SA 5014 Reusing comment email and authority from existing record: 25039151 Saving record 25039151, 30 MALURUS AV LOCKLEYS SA 5032 Reusing comment email and authority from existing record: 25035111 Saving record 25035111, 347 RIVERVIEW DR BERRI SA 5343 Reusing comment email and authority from existing record: 25032983 Saving record 25032983, 26 FOURTH AV MOANA SA 5169 Reusing comment email and authority from existing record: 24034783 Saving record 24034783, 325 UPPER PENNEYS HILL RD ONKAPARINGA HILLS SA 5163 Reusing comment email and authority from existing record: 26003478 Saving record 26003478, 100 ESPLANADE COFFIN BAY SA 5607 Reusing comment email and authority from existing record: 25033828 Saving record 25033828, 32 PETHICK RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26007001 Saving record 26007001, 846 GRAND JUNCTION RD GILLES PLAINS SA 5086 Reusing comment email and authority from existing record: 26002211 Saving record 26002211, 596 TORRENS RD WOODVILLE NORTH SA 5012 Reusing comment email and authority from existing record: 25038620 Saving record 25038620, 11 -21 SECKER RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26007887 Saving record 26007887, 13 BLOOMSBURY ST GOODWOOD SA 5034 Reusing comment email and authority from existing record: 25034557 Saving record 25034557, 20 PEREGRINE WAY GREENWITH SA 5125 Reusing comment email and authority from existing record: 26003810 Saving record 26003810, UNIT 1 60 PORTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25016520 Saving record 25016520, 18 GRACE HARWAR DR PORT BROUGHTON SA 5522 Reusing comment email and authority from existing record: 25036549 Saving record 25036549, 2 WELLINGTON TCE FULLARTON SA 5063 Reusing comment email and authority from existing record: 26005795 Saving record 26005795, 38 LEWIS RD GLYNDE SA 5070 Reusing comment email and authority from existing record: 25030527 Saving record 25030527, 221 CLANCY RD GAWLER BELT SA 5118 Reusing comment email and authority from existing record: 25019356 Saving record 25019356, 19 QUARRY RD WILLUNGA SOUTH SA 5172 Reusing comment email and authority from existing record: 26003767 Saving record 26003767, 115 HEASLIP RD ANGLE VALE SA 5117 Reusing comment email and authority from existing record: 26005482 Saving record 26005482, 48 SIXTH AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25037002 Saving record 25037002, 54 FARROW CCT SEAFORD SA 5169 Reusing comment email and authority from existing record: 26000921 Saving record 26000921, 338 ORLAND RD TAILEM BEND SA 5260 Reusing comment email and authority from existing record: 26005025 Saving record 26005025, LOT 3 JOHNSON RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 25029444 Saving record 25029444, LOT 692 BUTE RD KADINA SA 5554 Reusing comment email and authority from existing record: 26003100 Saving record 26003100, 25 FOSTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26005334 Saving record 26005334, 1 MONMOUTH RD WESTBOURNE PARK SA 5041 Reusing comment email and authority from existing record: 26005771 Saving record 26005771, 309 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26002546 Saving record 26002546, 22 LAVINIA ST ATHOL PARK SA 5012 Reusing comment email and authority from existing record: 26005664 Saving record 26005664, 1 ALLEN GR UNLEY SA 5061 Reusing comment email and authority from existing record: 26002235 Saving record 26002235, 153 TOZER RD WATERLOO CORNER SA 5110 Reusing comment email and authority from existing record: 25035081 Saving record 25035081, 34 COKE ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 25030115 Saving record 25030115, LOT 84 BLOCKS RD RIVERTON SA 5412 Reusing comment email and authority from existing record: 25038192 Saving record 25038192, 44 TRUMARA RD MARINO SA 5049 Reusing comment email and authority from existing record: 26005764 Saving record 26005764, 18 BRIAR AV MEDINDIE SA 5081 Reusing comment email and authority from existing record: 26002654 Saving record 26002654, 39 RIDGE RD LOBETHAL SA 5241 Reusing comment email and authority from existing record: 26004866 Saving record 26004866, 3A ROSELLA AV GLENALTA SA 5052 Reusing comment email and authority from existing record: 26004110 Saving record 26004110, 25 LLOYD ST HECTORVILLE SA 5073 Reusing comment email and authority from existing record: 26000097 Saving record 26000097, 32 DUNREATH RD STRATHALBYN SA 5255 Reusing comment email and authority from existing record: 26003728 Saving record 26003728, 25 THE ANNIE WATT CCT WEST LAKES SHORE SA 5020 Reusing comment email and authority from existing record: 25039700 Saving record 25039700, 26 OXFORD TCE UNLEY SA 5061 Reusing comment email and authority from existing record: 23034304 Saving record 23034304, East Front Road Reusing comment email and authority from existing record: 26001512 Saving record 26001512, 58 DALMORE DR STRATHALBYN SA 5255 Reusing comment email and authority from existing record: 26000750 Saving record 26000750, 29 PRINCES HWY LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26002759 Saving record 26002759, 36 BATH ST GLENELG SOUTH SA 5045 Reusing comment email and authority from existing record: 26006613 Saving record 26006613, 7 TORRENS ST GILBERTON SA 5081 Reusing comment email and authority from existing record: 25013523 Saving record 25013523, 535 REGENCY RD SEFTON PARK SA 5083 Reusing comment email and authority from existing record: 26002853 Saving record 26002853, 1 JANE ST SMITHFIELD SA 5114 Reusing comment email and authority from existing record: 26001849 Saving record 26001849, 61 SPRIGG RD CRAFERS SA 5152 Reusing comment email and authority from existing record: 26005109 Saving record 26005109, 18 ADELAIDE ST MAGILL SA 5072 Reusing comment email and authority from existing record: 25038256 Saving record 25038256, 9 WOODSIDE RD NAIRNE SA 5252 Reusing comment email and authority from existing record: 26005724 Saving record 26005724, UNIT 4 50 FARROW CCT SEAFORD SA 5169 Reusing comment email and authority from existing record: 25003084 Saving record 25003084, SHOP 1-8 1 -3 KINGFISHER DR HEWETT SA 5118 Reusing comment email and authority from existing record: 26006738 Saving record 26006738, LOT 5 RAILWAY PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 25028003 Saving record 25028003, 54 MEYER ST TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 26006431 Saving record 26006431, 12 RICHARDS AV WUDINNA SA 5652 Reusing comment email and authority from existing record: 26001481 Saving record 26001481, 32 SALISBURY CR COLONEL LIGHT GARDENS SA 5041 Reusing comment email and authority from existing record: 25037907 Saving record 25037907, 15 MATHEWS CCT WOODLANE SA 5254 Reusing comment email and authority from existing record: 26006871 Saving record 26006871, 25 WHEATON RD STEPNEY SA 5069 Reusing comment email and authority from existing record: 26002742 Saving record 26002742, 54 MURRAY ST ALBERT PARK SA 5014 Reusing comment email and authority from existing record: 26006511 Saving record 26006511, 191 -195 TORRENS RD RIDLEYTON SA 5008 Reusing comment email and authority from existing record: 25035121 Saving record 25035121, 76 FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 26007143 Saving record 26007143, 104 FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 26002947 Saving record 26002947, 12 DELBRIDGE CT BEAUMONT SA 5066 Reusing comment email and authority from existing record: 25040465 Saving record 25040465, 1 CLUBHOUSE RD SEACLIFF SA 5049 Reusing comment email and authority from existing record: 25040508 Saving record 25040508, 42 GLEBE DR LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26004828 Saving record 26004828, 2 WAKEFIELD RD LEASINGHAM SA 5452 Reusing comment email and authority from existing record: 25038270 Saving record 25038270, 647 GRAND JUNCTION RD GEPPS CROSS SA 5094 Reusing comment email and authority from existing record: 25034982 Saving record 25034982, 39 MARINER DR SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 26007072 Saving record 26007072, 18 -20 SECKER RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26000307 Saving record 26000307, 212 MILNE RD MODBURY HEIGHTS SA 5092 Reusing comment email and authority from existing record: 26005401 Saving record 26005401, 37 BARULA RD MARINO SA 5049 Reusing comment email and authority from existing record: 26002307 Saving record 26002307, 111 WOMMA WEST RD VIRGINIA SA 5120 Reusing comment email and authority from existing record: 26001682 Saving record 26001682, 483 HICKEYS DR COOBOWIE SA 5583 Reusing comment email and authority from existing record: 26004641 Saving record 26004641, 17 NANKERI CT INGLE FARM SA 5098 Reusing comment email and authority from existing record: 26004532 Saving record 26004532, 47 FULLARTON RD KENT TOWN SA 5067 First Application data retrieved: {"publicNotificationID"=>12893, "applicationID"=>24034783, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"325 UPPER PENNEYS HILL RD ONKAPARINGA HILLS SA 5163", "developmentDescription"=>"Extension to residence creating a second attached dwelling. \n\nAssociated works include carports, verandahs, decks and a water tank", "closingDate"=>"4/24/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"City of Onkaparinga", "locationCouncil"=>"CITY OF ONKAPARINGA", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>796176, "applicationId"=>24034783, "contactName"=>"Maurice Hood ", "address"=>"60 SIR JAMES HARDY WAY WOODCROFT 5162"}]} Found 97 applications that were already in the database, and added 0 new applications. Added 17.03 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 3 Adelaide Hills Council 2 Alexandrina Council 1 Barunga West Council 3 City of Burnside 1 City of Campbelltown 12 City of Charles Sturt 1 City of Holdfast Bay 5 City of Marion 4 City of Mitcham 7 City of Norwood, Payneham and St. Peters 7 City of Onkaparinga 6 City of Playford 2 City of Port Adelaide Enfield 2 City of Salisbury 3 City of Tea Tree Gully 6 City of Unley 4 City of West Torrens 3 Clare and Gilbert Valleys Council 1 Copper Coast Council 3 Light Regional Council 2 Lower Eyre Council 1 Mid Murray Council 7 Mount Barker District Council 2 Rural City of Murray Bridge 2 State Planning Commission 1 The Barossa Council 1 The Berri Barmera Council 1 The Coorong District Council 2 The Corporation of the Town of Walkerville 1 Wudinna District Council 1 Yorke Peninsula Council

Data

Downloaded 4590 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke DevAppProject softgrow odnagroup ianheggie-oaf Jedwards157 MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.7 MB) Use the API

rows 10 / 74303

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 25.8 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    97 records added, 97 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    97 records added, 97 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    100 records added, 91 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    95 records added, 95 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    95 records added, 80 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb