planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 22.49s to avoid 429 Too Many Requests errors Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 93 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26004167 Saving record 26004167, 203 UPPER STURT RD UPPER STURT SA 5156 Reusing comment email and authority from existing record: 26031631 Saving record 26031631, 72 KINGSTON RD KINGSTON ON MURRAY SA 5331 Reusing comment email and authority from existing record: 26034029 Saving record 26034029, 74A FIFTH AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 26033872 Saving record 26033872, UNIT 2 14 APPELBEE CR NORWOOD SA 5067 Reusing comment email and authority from existing record: 26032259 Saving record 26032259, 21 SEAVIEW AV WIRRINA COVE SA 5204 Reusing comment email and authority from existing record: 26031116 Saving record 26031116, 20 -21 DARANDA TCE MILANG SA 5256 Reusing comment email and authority from existing record: 26030697 Saving record 26030697, 9 QUEBEC AV CLAPHAM SA 5062 Reusing comment email and authority from existing record: 26026593 Saving record 26026593, 62 ETON ST MALVERN SA 5061 Reusing comment email and authority from existing record: 26021114 Saving record 26021114, 149 MUNETTA RD PAGES FLAT SA 5172 Reusing comment email and authority from existing record: 26029273 Saving record 26029273, 8 DUTTON RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26028540 Saving record 26028540, LOT 4006 SHANES RD POINT BOSTON SA 5607 Reusing comment email and authority from existing record: 26028449 Saving record 26028449, 115 BOSANQUET BVD CEDUNA WATERS SA 5690 Reusing comment email and authority from existing record: 26021040 Saving record 26021040, 116 OLD PORT WAKEFIELD RD TWO WELLS SA 5501 Reusing comment email and authority from existing record: 26031154 Saving record 26031154, 28 LUCK ST MACCLESFIELD SA 5153 Reusing comment email and authority from existing record: 26006320 Saving record 26006320, 27 GRANT AV ROSE PARK SA 5067 Reusing comment email and authority from existing record: 26025472 Saving record 26025472, 104 BUXTON ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26031082 Saving record 26031082, LOT 102 DASHWOOD RD BEAUMONT SA 5066 Reusing comment email and authority from existing record: 26031194 Saving record 26031194, 185 ESPLANADE COFFIN BAY SA 5607 Reusing comment email and authority from existing record: 26033821 Saving record 26033821, 100 DAVOREN RD ANDREWS FARM SA 5114 Reusing comment email and authority from existing record: 26033446 Saving record 26033446, 17 ADELAIDE RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26030309 Saving record 26030309, 24 QUEEN ST WILLIAMSTOWN SA 5351 Reusing comment email and authority from existing record: 26031830 Saving record 26031830, 103 KENSINGTON RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26031439 Saving record 26031439, 93 PORTRUSH RD EVANDALE SA 5069 Reusing comment email and authority from existing record: 26034952 Saving record 26034952, 391 GRIBBLE RD BAROOTA SA 5495 Reusing comment email and authority from existing record: 26031697 Saving record 26031697, LOT 1 DOCKETT RD ELIZABETH DOWNS SA 5113 Reusing comment email and authority from existing record: 26030769 Saving record 26030769, 33A FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 26033855 Saving record 26033855, 134 CASHEL ST ST MARYS SA 5042 Reusing comment email and authority from existing record: 26021242 Saving record 26021242, 84 MYRTLE RD SEACLIFF SA 5049 Reusing comment email and authority from existing record: 25035297 Saving record 25035297, LOT 101 NORTH COAST RD WISANGER SA 5223 Reusing comment email and authority from existing record: 26027870 Saving record 26027870, 204 MARINE PDE PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 26033067 Saving record 26033067, LOT 702 BRISTOW ST LAURA SA 5480 Reusing comment email and authority from existing record: 26021406 Saving record 26021406, 11 RUSHWORTH AV BROOKLYN PARK SA 5032 Reusing comment email and authority from existing record: 26015551 Saving record 26015551, 110 SQUARE MILE RD SQUARE MILE SA 5291 Reusing comment email and authority from existing record: 26030953 Saving record 26030953, 12 TOWNSHIP RD MARION SA 5043 Reusing comment email and authority from existing record: 26025948 Saving record 26025948, 10 SECKER RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26024937 Saving record 26024937, 9 EYRE ST SEAVIEW DOWNS SA 5049 Reusing comment email and authority from existing record: 26026900 Saving record 26026900, 113 NORTH EAST RD COLLINSWOOD SA 5081 Reusing comment email and authority from existing record: 26027642 Saving record 26027642, 54A CUMING ST MILE END SA 5031 Reusing comment email and authority from existing record: 26012562 Saving record 26012562, LOT 2 RIVER RD PORT NOARLUNGA SA 5167 Reusing comment email and authority from existing record: 26029242 Saving record 26029242, 19 WRATTONBULLY RD ROBE SA 5276 Reusing comment email and authority from existing record: 26023687 Saving record 26023687, 39 JACOBSEN CR HOLDEN HILL SA 5088 Reusing comment email and authority from existing record: 26031890 Saving record 26031890, 556 HAMMONDS RD TUMBY BAY SA 5605 Reusing comment email and authority from existing record: 26034275 Saving record 26034275, 3 EGMONT TCE ERINDALE SA 5066 Reusing comment email and authority from existing record: 26028614 Saving record 26028614, 66 ALEXANDRA ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 26029123 Saving record 26029123, 2 STURT ST ROBE SA 5276 Reusing comment email and authority from existing record: 26027899 Saving record 26027899, 21 GREENFIELDS DR GREEN FIELDS SA 5107 Reusing comment email and authority from existing record: 26006368 Saving record 26006368, 409 HENLEY BEACH RD BROOKLYN PARK SA 5032 Reusing comment email and authority from existing record: 26029848 Saving record 26029848, 14 OMAR PL UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 25010704 Saving record 25010704, 365 GRANGE RD FINDON SA 5023 Reusing comment email and authority from existing record: 26011322 Saving record 26011322, 54 NORTHUMBERLAND ST TUSMORE SA 5065 Reusing comment email and authority from existing record: 26013848 Saving record 26013848, UNIT 1-5 243 MAIN RD BLACKWOOD SA 5051 Reusing comment email and authority from existing record: 26032436 Saving record 26032436, 33 MAWSON RD MEADOWS SA 5201 Reusing comment email and authority from existing record: 26008592 Saving record 26008592, 22A RIVERGUM CL WALKLEY HEIGHTS SA 5098 Reusing comment email and authority from existing record: 26030332 Saving record 26030332, 36 ILFORD ST VALE PARK SA 5081 Reusing comment email and authority from existing record: 26029262 Saving record 26029262, 22 FLOUR MILL RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26014550 Saving record 26014550, LOT 2 UNION CR MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26027172 Saving record 26027172, 925 -963 PORT WAKEFIELD RD PARALOWIE SA 5108 Reusing comment email and authority from existing record: 26018265 Saving record 26018265, 38 THOMPSON ST WALLAROO SA 5556 Reusing comment email and authority from existing record: 26028767 Saving record 26028767, 77 LEICESTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26027957 Saving record 26027957, 52 HILLIER RD HILLIER SA 5116 Reusing comment email and authority from existing record: 26033370 Saving record 26033370, 6 GRANDVIEW AV URRBRAE SA 5064 Reusing comment email and authority from existing record: 26018036 Saving record 26018036, 236 PROSPECT RD PROSPECT SA 5082 Reusing comment email and authority from existing record: 26024288 Saving record 26024288, 79 MAWSON RD MEADOWS SA 5201 Reusing comment email and authority from existing record: 26007796 Saving record 26007796, 7 ACACIA CT STONYFELL SA 5066 Reusing comment email and authority from existing record: 26028106 Saving record 26028106, 18 LIBERATOR WAY WALLAROO SA 5556 Reusing comment email and authority from existing record: 26006485 Saving record 26006485, UNIT 1-2 266 -268 GLEN OSMOND RD FULLARTON SA 5063 Reusing comment email and authority from existing record: 26022725 Saving record 26022725, 10 WARATAH CL BELAIR SA 5052 Reusing comment email and authority from existing record: 26027755 Saving record 26027755, 76 HAWKERS RD MEDINDIE SA 5081 Reusing comment email and authority from existing record: 26031502 Saving record 26031502, 26 FAIRLIE DR FLAGSTAFF HILL SA 5159 Reusing comment email and authority from existing record: 26019572 Saving record 26019572, 16 WONOKA ST EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 26031539 Saving record 26031539, LOT 1000 ETHEL ST FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 26032197 Saving record 26032197, 23 GOODENIA ST MUNNO PARA SA 5115 Reusing comment email and authority from existing record: 26031792 Saving record 26031792, 18 -20 O'HALLORAN ST ROBE SA 5276 Reusing comment email and authority from existing record: 26031605 Saving record 26031605, 78 GOODWOOD RD WAYVILLE SA 5034 Reusing comment email and authority from existing record: 26028962 Saving record 26028962, 45 PROSPECT RD PROSPECT SA 5082 Reusing comment email and authority from existing record: 26033699 Saving record 26033699, 12 HEPBURN ST BROADVIEW SA 5083 Reusing comment email and authority from existing record: 26018135 Saving record 26018135, 242 CALIFORNIA RD TATACHILLA SA 5171 Reusing comment email and authority from existing record: 26034355 Saving record 26034355, LOT 336 JARVIS RD HAWKER SA 5434 Reusing comment email and authority from existing record: 26028206 Saving record 26028206, 30830A PRINCES HWY MILLICENT SA 5280 Reusing comment email and authority from existing record: 26012167 Saving record 26012167, 15 PENNEYS HILL RD HACKHAM SA 5163 Reusing comment email and authority from existing record: 26035550 Saving record 26035550, UNIT 2 11B CLAPTON RD MARRYATVILLE SA 5068 Reusing comment email and authority from existing record: 26033315 Saving record 26033315, 14 CRADOCK RD HAWKER SA 5434 Reusing comment email and authority from existing record: 26011967 Saving record 26011967, 33 YELTANA AV WATTLE PARK SA 5066 Reusing comment email and authority from existing record: 26033579 Saving record 26033579, TNCY 2 1 GOLF DR WEST BEACH SA 5024 Reusing comment email and authority from existing record: 26029134 Saving record 26029134, 16 BARBARA AV MORPHETT VALE SA 5162 Reusing comment email and authority from existing record: 26025468 Saving record 26025468, 221 -223 HANSON RD ATHOL PARK SA 5012 Reusing comment email and authority from existing record: 26023855 Saving record 26023855, LOT 42 NORTH EAST RD COLLINSWOOD SA 5081 Reusing comment email and authority from existing record: 26034436 Saving record 26034436, 2 KNOX ST FREWVILLE SA 5063 Reusing comment email and authority from existing record: 26027443 Saving record 26027443, LOT 200 HANCOCK RD KAPUNDA SA 5373 Reusing comment email and authority from existing record: 26017541 Saving record 26017541, 224 BALD HILLS RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26028140 Saving record 26028140, 88 MORTLOCK TCE PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26022757 Saving record 26022757, 57 REPTON RD NORTH BRIGHTON SA 5048 Reusing comment email and authority from existing record: 26028362 Saving record 26028362, LOT 1 YARROO RD KULPARA SA 5552 First Application data retrieved: {"publicNotificationID"=>14272, "applicationID"=>26030332, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"36 ILFORD ST VALE PARK SA 5081", "developmentDescription"=>"Construction of two (2) double storey detached dwellings and associated tree-damaging activity", "closingDate"=>"11/26/2026 12:00:00 AM", "decisionAuthority"=>"The Corporation of the Town of Walkerville", "relevantAuthority"=>"The Corporation of the Town of Walkerville", "locationCouncil"=>"Walkerville", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1199152, "applicationId"=>26030332, "contactName"=>"ThreeSixFive Studio ", "address"=>"53 THE PARADE NORWOOD 5067"}]} Found 93 applications that were already in the database, and added 0 new applications. Added 22.49 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 1 Adelaide Plains Council 2 Alexandrina Council 1 Barunga West Council 1 City of Adelaide 7 City of Burnside 3 City of Charles Sturt 2 City of Holdfast Bay 2 City of Marion 7 City of Mitcham 5 City of Norwood, Payneham and St. Peters 5 City of Onkaparinga 3 City of Playford 1 City of Port Lincoln 5 City of Prospect 3 City of Salisbury 1 City of Tea Tree Gully 6 City of Unley 3 City of West Torrens 2 Copper Coast Council 1 District Council of Ceduna 1 District Council of Grant 1 District Council of Kingston 1 District Council of Loxton Waikerie 1 District Council of Mount Remarkable 3 District Council of Robe 1 District Council of Tumby Bay 1 District Council of Yankalilla 2 Flinders Ranges Council 1 Kangaroo Island Council 1 Light Regional Council 2 Lower Eyre Council 7 Mount Barker District Council 1 Northern Areas Council 4 State Planning Commission 1 The Barossa Council 2 The Corporation of the Town of Walkerville 1 Town of Gawler 1 Wattle Range Council

Data

Downloaded 5111 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn qs4v8thvrq-boop DevAppProject softgrow 538digital odnagroup ianheggie-oaf tobiasoberrauch Jedwards157 MichaelBone 93399339 eucodepy seegolovemee

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.4 MB) Use the API

rows 10 / 75368

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.5 MB

History

  • Auto ran revision 4d080013 and completed successfully .
    93 records added, 93 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and completed successfully .
    93 records added, 93 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and completed successfully .
    98 records added, 92 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and completed successfully .
    99 records added, 91 records removed, 1 record updated in the database
  • Auto ran revision 4d080013 and completed successfully .
    100 records added, 92 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb