planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 20.72s to avoid 429 Too Many Requests errors Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 99 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26027305 Saving record 26027305, 54 GLENWOOD DR BELLEVUE HEIGHTS SA 5050 Reusing comment email and authority from existing record: 26033131 Saving record 26033131, 16 EDMUND ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26028961 Saving record 26028961, LOT 1 FARM BEACH RD COULTA SA 5607 Reusing comment email and authority from existing record: 26011733 Saving record 26011733, 360 OLD NORTON SUMMIT RD HORSNELL GULLY SA 5141 Reusing comment email and authority from existing record: 26014236 Saving record 26014236, 29 GALWAY AV SEACOMBE HEIGHTS SA 5047 Reusing comment email and authority from existing record: 26007018 Saving record 26007018, 23 WEHL ST S MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26028206 Saving record 26028206, 30830A PRINCES HWY MILLICENT SA 5280 Reusing comment email and authority from existing record: 26029262 Saving record 26029262, 22 FLOUR MILL RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26029188 Saving record 26029188, 37 WILLIAM ST HAWTHORN SA 5062 Reusing comment email and authority from existing record: 26026900 Saving record 26026900, 113 NORTH EAST RD COLLINSWOOD SA 5081 Reusing comment email and authority from existing record: 26030236 Saving record 26030236, 8 CEDAR AV UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 26031546 Saving record 26031546, LOT 13 COPPER COAST HWY SOUTH HUMMOCKS SA 5550 Reusing comment email and authority from existing record: 26018268 Saving record 26018268, 8 PINKS BEACH RD PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 26014319 Saving record 26014319, 7 YALANDA ST EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 25014614 Saving record 25014614, 804 MOUNT BARKER RD VERDUN SA 5245 Reusing comment email and authority from existing record: 26026409 Saving record 26026409, 32 ARTHUR ST SEACLIFF PARK SA 5049 Reusing comment email and authority from existing record: 26029799 Saving record 26029799, 42 HOLLY RISE HACKHAM WEST SA 5163 Reusing comment email and authority from existing record: 26012596 Saving record 26012596, 285 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26028689 Saving record 26028689, 14 ANNESLEY AV TRINITY GARDENS SA 5068 Reusing comment email and authority from existing record: 26030379 Saving record 26030379, 74 HILL ST MITCHAM SA 5062 Reusing comment email and authority from existing record: 26028767 Saving record 26028767, 77 LEICESTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26026834 Saving record 26026834, 21 LASCELLES AV BEAUMONT SA 5066 Reusing comment email and authority from existing record: 26022695 Saving record 26022695, 23 PONY RIDGE RD BELAIR SA 5052 Reusing comment email and authority from existing record: 26030365 Saving record 26030365, 20 CHARLICK RD CRAFERS WEST SA 5152 Reusing comment email and authority from existing record: 26021040 Saving record 26021040, 116 OLD PORT WAKEFIELD RD TWO WELLS SA 5501 Reusing comment email and authority from existing record: 26031311 Saving record 26031311, LOT 500 NORTH WEST TCE BEACHPORT SA 5280 Reusing comment email and authority from existing record: 26006485 Saving record 26006485, UNIT 1-2 266 -268 GLEN OSMOND RD FULLARTON SA 5063 Reusing comment email and authority from existing record: 26023687 Saving record 26023687, 39 JACOBSEN CR HOLDEN HILL SA 5088 Reusing comment email and authority from existing record: 26021242 Saving record 26021242, 84 MYRTLE RD SEACLIFF SA 5049 Reusing comment email and authority from existing record: 26030816 Saving record 26030816, LOT 100 RICHARDSON PL ROXBY DOWNS SA 5725 Reusing comment email and authority from existing record: 26027642 Saving record 26027642, 54A CUMING ST MILE END SA 5031 Reusing comment email and authority from existing record: 25002250 Saving record 25002250, 383 ALDINGA RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26027899 Saving record 26027899, 21 GREENFIELDS DR GREEN FIELDS SA 5107 Reusing comment email and authority from existing record: 26028267 Saving record 26028267, 21 TRIMMER TCE UNLEY SA 5061 Reusing comment email and authority from existing record: 26020675 Saving record 26020675, 4 -6 PARHAM ST PORT PIRIE SOUTH SA 5540 Reusing comment email and authority from existing record: 26029932 Saving record 26029932, 33 MUIRKIRK ST JAMESTOWN SA 5491 Reusing comment email and authority from existing record: 26028449 Saving record 26028449, 115 BOSANQUET BVD CEDUNA WATERS SA 5690 Reusing comment email and authority from existing record: 26030501 Saving record 26030501, UNIT 1 40 PARNKALLA AV PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26030467 Saving record 26030467, 2 -10 SURREY FARM DR GOLDEN GROVE SA 5125 Reusing comment email and authority from existing record: 26006368 Saving record 26006368, 409 HENLEY BEACH RD BROOKLYN PARK SA 5032 Reusing comment email and authority from existing record: 26031988 Saving record 26031988, 10 CLARK ST WAYVILLE SA 5034 Reusing comment email and authority from existing record: 26029999 Saving record 26029999, 118 THOMAS RD MASLIN BEACH SA 5170 Reusing comment email and authority from existing record: 26029295 Saving record 26029295, 8 STOTT PL STIRLING SA 5152 Reusing comment email and authority from existing record: 25036469 Saving record 25036469, 63 MONMOUTH RD WESTBOURNE PARK SA 5041 Reusing comment email and authority from existing record: 26028140 Saving record 26028140, 88 MORTLOCK TCE PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26019612 Saving record 26019612, 97 PRESSER RD TANUNDA SA 5352 Reusing comment email and authority from existing record: 26027497 Saving record 26027497, 36 NEPEAN ESP NEPEAN BAY SA 5223 Reusing comment email and authority from existing record: 23026239 Saving record 23026239, 63 ONTARIO ST RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 26029876 Saving record 26029876, 15 BEASLEY ST MARDEN SA 5070 Reusing comment email and authority from existing record: 26028259 Saving record 26028259, 11 CLARKE RD OB FLAT SA 5291 Reusing comment email and authority from existing record: 26027348 Saving record 26027348, 18 KRAUSE DR GAWLER BELT SA 5118 Reusing comment email and authority from existing record: 26023536 Saving record 26023536, LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26028876 Saving record 26028876, 1 OSBORNE RD NORTH HAVEN SA 5018 Reusing comment email and authority from existing record: 26027789 Saving record 26027789, 67 DAVENPORT ST ROBE SA 5276 Reusing comment email and authority from existing record: 25035297 Saving record 25035297, LOT 101 NORTH COAST RD WISANGER SA 5223 Reusing comment email and authority from existing record: 26025773 Saving record 26025773, 77 PALMER PL NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26013047 Saving record 26013047, LOT 128 CASSINI RD CASSINI SA 5223 Reusing comment email and authority from existing record: 26009829 Saving record 26009829, 4 ANTHONY ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25031450 Saving record 25031450, LOT 23 HEYSEN BVD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26024894 Saving record 26024894, 3680 OLD PRINCES HWY MONARTO SOUTH SA 5254 Reusing comment email and authority from existing record: 26020069 Saving record 26020069, 231 MURRAY ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26026709 Saving record 26026709, 478 USHER RD GIFFORD HILL SA 5253 Reusing comment email and authority from existing record: 26028061 Saving record 26028061, 2A CHAPMAN CR GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 26030966 Saving record 26030966, LOT 180 WILKIN RD MURRAY BRIDGE NORTH SA 5253 Reusing comment email and authority from existing record: 26018036 Saving record 26018036, 236 PROSPECT RD PROSPECT SA 5082 Reusing comment email and authority from existing record: 26028362 Saving record 26028362, LOT 1 YARROO RD KULPARA SA 5552 Reusing comment email and authority from existing record: 26026807 Saving record 26026807, LOT 514 PENRICE RD NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 26000032 Saving record 26000032, 398 MOUNT BARKER RD BRIDGEWATER SA 5155 Reusing comment email and authority from existing record: 26034029 Saving record 26034029, 74A FIFTH AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 26024862 Saving record 26024862, 730 -732 PORT WAKEFIELD RD PARAFIELD GARDENS SA 5107 Reusing comment email and authority from existing record: 26031405 Saving record 26031405, 16 SIDDALL RD ELIZABETH VALE SA 5112 Reusing comment email and authority from existing record: 26029247 Saving record 26029247, 35A FERRERS ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26021406 Saving record 26021406, 11 RUSHWORTH AV BROOKLYN PARK SA 5032 Reusing comment email and authority from existing record: 26028627 Saving record 26028627, 21 JENNIFER AV RIDGEHAVEN SA 5097 Reusing comment email and authority from existing record: 26011184 Saving record 26011184, 234 PORT RD ALBERTON SA 5014 Reusing comment email and authority from existing record: 26014550 Saving record 26014550, LOT 2 UNION CR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26027740 Saving record 26027740, 2 GEORGE ST CEDUNA SA 5690 Reusing comment email and authority from existing record: 26031560 Saving record 26031560, 134 -144 NELSON RD PARA VISTA SA 5093 Reusing comment email and authority from existing record: 23028686 Saving record 23028686, 7 GREENWOOD CR GLENALTA SA 5052 Reusing comment email and authority from existing record: 26021114 Saving record 26021114, 149 MUNETTA RD PAGES FLAT SA 5172 Reusing comment email and authority from existing record: 26025565 Saving record 26025565, 46 GELTWOOD DR BEACHPORT SA 5280 Reusing comment email and authority from existing record: 26028377 Saving record 26028377, 14 WEST TCE COWELL SA 5602 Reusing comment email and authority from existing record: 26033370 Saving record 26033370, 6 GRANDVIEW AV URRBRAE SA 5064 Reusing comment email and authority from existing record: 26016582 Saving record 26016582, 10 FRY LANE FOREST RANGE SA 5139 Reusing comment email and authority from existing record: 26027966 Saving record 26027966, 17 ALBERT ST DULWICH SA 5065 Reusing comment email and authority from existing record: 26033608 Saving record 26033608, 106 BOTTING ST ALBERT PARK SA 5014 Reusing comment email and authority from existing record: 26027610 Saving record 26027610, 2 MANRESA CT ATHELSTONE SA 5076 Reusing comment email and authority from existing record: 26012167 Saving record 26012167, 15 PENNEYS HILL RD HACKHAM SA 5163 Reusing comment email and authority from existing record: 26001790 Saving record 26001790, 967 SECTUS TANKS RD BARNA SA 5641 Reusing comment email and authority from existing record: 26028184 Saving record 26028184, 29 MAYFLOWER CR HALLETT COVE SA 5158 Reusing comment email and authority from existing record: 26031116 Saving record 26031116, 20 -21 DARANDA TCE MILANG SA 5256 Reusing comment email and authority from existing record: 26005269 Saving record 26005269, 277 SPRINGHEAD RD MOUNT TORRENS SA 5244 Reusing comment email and authority from existing record: 26025614 Saving record 26025614, 14 DULWICH AV DULWICH SA 5065 Reusing comment email and authority from existing record: 26007796 Saving record 26007796, 7 ACACIA CT STONYFELL SA 5066 Reusing comment email and authority from existing record: 26033067 Saving record 26033067, LOT 702 BRISTOW ST LAURA SA 5480 Reusing comment email and authority from existing record: 26027443 Saving record 26027443, LOT 200 HANCOCK RD KAPUNDA SA 5373 Reusing comment email and authority from existing record: 26025455 Saving record 26025455, 38 FLINDERS ST KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26029014 Saving record 26029014, 100 CHURCHETT RD PARACOMBE SA 5132 Reusing comment email and authority from existing record: 26033064 Saving record 26033064, 126 HEWITT AV TOORAK GARDENS SA 5065 First Application data retrieved: {"publicNotificationID"=>14162, "applicationID"=>23026239, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"63 ONTARIO ST RENMARK WEST SA 5341", "developmentDescription"=>"Land Division (1-into-30 residential allotments and associated road and infrastructure).", "closingDate"=>"11/12/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"Renmark Paringa Council", "locationCouncil"=>"Renmark Paringa", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>558908, "applicationId"=>23026239, "contactName"=>"Craig Patty ", "address"=>"63 ONTARIO STREET RENMARK WEST 5341"}]} Found 99 applications that were already in the database, and added 0 new applications. Added 20.72 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 7 Adelaide Hills Council 1 Adelaide Plains Council 2 Alexandrina Council 2 Barunga West Council 1 City of Adelaide 6 City of Burnside 1 City of Campbelltown 2 City of Charles Sturt 2 City of Holdfast Bay 2 City of Marion 8 City of Mitcham 3 City of Mt Gambier 5 City of Norwood, Payneham and St. Peters 5 City of Onkaparinga 1 City of Playford 2 City of Port Adelaide Enfield 2 City of Port Lincoln 2 City of Prospect 3 City of Salisbury 4 City of Tea Tree Gully 5 City of Unley 3 City of West Torrens 2 District Council of Ceduna 1 District Council of Franklin Harbour 1 District Council of Kimba 1 District Council of Robe 2 Kangaroo Island Council 3 Light Regional Council 2 Mount Barker District Council 1 Municipal Council of Roxby Downs 2 Northern Areas Council 1 Port Pirie Regional Council 3 Rural City of Murray Bridge 1 Southern Limestone Coast Council 5 State Planning Commission 2 The Barossa Council 3 Wattle Range Council

Data

Downloaded 5093 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn qs4v8thvrq-boop DevAppProject softgrow odnagroup ianheggie-oaf 538digital eucodepy seegolovemee tobiasoberrauch Jedwards157 MichaelBone 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.4 MB) Use the API

rows 10 / 75304

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.5 MB

History

  • Auto ran revision 4d080013 and completed successfully .
    99 records added, 99 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and completed successfully .
    99 records added, 99 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and completed successfully .
    104 records added, 92 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and failed .
    nothing changed in the database
  • Auto ran revision 4d080013 and completed successfully .
    110 records added, 98 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb