planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal


South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 22.07s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 118 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26003901 Saving record 26003901, 488 HENLEY BEACH RD FULHAM SA 5024 Reusing comment email and authority from existing record: 26004110 Saving record 26004110, 25 LLOYD ST HECTORVILLE SA 5073 Reusing comment email and authority from existing record: 25036530 Saving record 25036530, 20 LURLINE ST MILE END SA 5031 Reusing comment email and authority from existing record: 26009153 Saving record 26009153, 66 PEKINA ST EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 25033828 Saving record 25033828, 32 PETHICK RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26008567 Saving record 26008567, 772 BROOKMAN RD KUITPO SA 5201 Reusing comment email and authority from existing record: 26004020 Saving record 26004020, 43 CONDADA AV PARK HOLME SA 5043 Reusing comment email and authority from existing record: 25008263 Saving record 25008263, 153 MURRAY ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26005571 Saving record 26005571, SHOP 1-2 10 ADELAIDE RD HAYBOROUGH SA 5211 Reusing comment email and authority from existing record: 26006323 Saving record 26006323, 18 QUEEN ST SMITHFIELD SA 5114 Reusing comment email and authority from existing record: 26007155 Saving record 26007155, 78 PYM ST DUDLEY PARK SA 5008 Reusing comment email and authority from existing record: 26007000 Saving record 26007000, 95 FIFTH AV JOSLIN SA 5070 Reusing comment email and authority from existing record: 25016398 Saving record 25016398, 1 JANSEN CT TORRENS PARK SA 5062 Reusing comment email and authority from existing record: 26005491 Saving record 26005491, LOT 2 JAGGER RD WAITPINGA SA 5211 Reusing comment email and authority from existing record: 25000819 Saving record 25000819, 110 -112 TOLLEY RD ST AGNES SA 5097 Reusing comment email and authority from existing record: 26000206 Saving record 26000206, 21 HEXTALL AV TRANMERE SA 5073 Reusing comment email and authority from existing record: 26005025 Saving record 26005025, LOT 3 JOHNSON RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 25025038 Saving record 25025038, 72 INGOLDBY RD MCLAREN FLAT SA 5171 Reusing comment email and authority from existing record: 26004695 Saving record 26004695, UNIT 5 19 SOUTH POINT DR PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26002599 Saving record 26002599, 28 DEW ST THEBARTON SA 5031 Reusing comment email and authority from existing record: 25018301 Saving record 25018301, 431 RIVER RD MYLOR SA 5153 Reusing comment email and authority from existing record: 25032983 Saving record 25032983, 26 FOURTH AV MOANA SA 5169 Reusing comment email and authority from existing record: 25028155 Saving record 25028155, 25 THIRD AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25035111 Saving record 25035111, 347 RIVERVIEW DR BERRI SA 5343 Reusing comment email and authority from existing record: 25040161 Saving record 25040161, 135 -155 RIDLEY RD ELIZABETH SA 5112 Reusing comment email and authority from existing record: 26006938 Saving record 26006938, 354 MOORES RD MONTACUTE SA 5134 Reusing comment email and authority from existing record: 26006738 Saving record 26006738, LOT 5 RAILWAY PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26001945 Saving record 26001945, 83 EUSTON TCE WEST CROYDON SA 5008 Reusing comment email and authority from existing record: 26000750 Saving record 26000750, 29 PRINCES HWY LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25033740 Saving record 25033740, 112 BROWN TCE SALISBURY SA 5108 Reusing comment email and authority from existing record: 24030806 Saving record 24030806, 3 THAMES AV KLEMZIG SA 5087 Reusing comment email and authority from existing record: 25027079 Saving record 25027079, 6 MORNING STAR RD WISTOW SA 5251 Reusing comment email and authority from existing record: 26008118 Saving record 26008118, 2 FORSTER ST RIDLEYTON SA 5008 Reusing comment email and authority from existing record: 26009211 Saving record 26009211, 220 YOUNG ST UNLEY SA 5061 Reusing comment email and authority from existing record: 26009908 Saving record 26009908, 44 PINERY RD OWEN SA 5460 Reusing comment email and authority from existing record: 26001066 Saving record 26001066, 49 -51 ASHWIN PDE TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 26003628 Saving record 26003628, 3 JAN ST NEWTON SA 5074 Reusing comment email and authority from existing record: 25038632 Saving record 25038632, 16 MOUNT VIEW RD CHARLESTON SA 5244 Reusing comment email and authority from existing record: 26004280 Saving record 26004280, LOT 3 JOHNSON RD ONE TREE HILL SA 5114 Reusing comment email and authority from existing record: 26001481 Saving record 26001481, 32 SALISBURY CR COLONEL LIGHT GARDENS SA 5041 Reusing comment email and authority from existing record: 26003887 Saving record 26003887, 297A GILLES ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 25038620 Saving record 25038620, 11 -21 SECKER RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26006956 Saving record 26006956, 3A BRANDWOOD ST ROYAL PARK SA 5014 Reusing comment email and authority from existing record: 26009970 Saving record 26009970, 13 SUTTON AV MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25035471 Saving record 25035471, 13 ARDROSSAN AV BELAIR SA 5052 Reusing comment email and authority from existing record: 26002947 Saving record 26002947, 12 DELBRIDGE CT BEAUMONT SA 5066 Reusing comment email and authority from existing record: 25035895 Saving record 25035895, 5 RALDON GR MYRTLE BANK SA 5064 Reusing comment email and authority from existing record: 26000294 Saving record 26000294, 15 ST ANDREWS AV MOUNT OSMOND SA 5064 Reusing comment email and authority from existing record: 26005401 Saving record 26005401, 37 BARULA RD MARINO SA 5049 Reusing comment email and authority from existing record: 25031879 Saving record 25031879, 355 RANGE RD N UPPER HERMITAGE SA 5131 Reusing comment email and authority from existing record: 25037686 Saving record 25037686, 3 OLD COACH RD ALDINGA SA 5173 Reusing comment email and authority from existing record: 24039423 Saving record 24039423, LOT 22 GREEN ST COORABIE SA 5690 Reusing comment email and authority from existing record: 26005934 Saving record 26005934, 42 HIGHBURY ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 25037761 Saving record 25037761, 71 WOODLAND WAY TERINGIE SA 5072 Reusing comment email and authority from existing record: 25024966 Saving record 25024966, 56 DARBY RD ECHUNGA SA 5153 Reusing comment email and authority from existing record: 25040450 Saving record 25040450, 54 -60 SYDENHAM RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26009655 Saving record 26009655, 12 CONCANNON RD ECHUNGA SA 5153 Reusing comment email and authority from existing record: 26008244 Saving record 26008244, 8 KENDALL TCE MORPHETTVILLE SA 5043 Reusing comment email and authority from existing record: 26008818 Saving record 26008818, UNIT 1-2 51 WELLER ST GOODWOOD SA 5034 Reusing comment email and authority from existing record: 26008892 Saving record 26008892, UNIT 1-3 272 -274 NORTH EAST RD KLEMZIG SA 5087 Reusing comment email and authority from existing record: 26004471 Saving record 26004471, 70 HAMPSTEAD RD BROADVIEW SA 5083 Reusing comment email and authority from existing record: 26004699 Saving record 26004699, UNIT 3 19 SOUTH POINT DR PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26006413 Saving record 26006413, 308 THE PARADE KENSINGTON SA 5068 Reusing comment email and authority from existing record: 26007143 Saving record 26007143, 104 FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 25039810 Saving record 25039810, 201 WOODS HILL RD ASHTON SA 5137 Reusing comment email and authority from existing record: 25030468 Saving record 25030468, 1 -23 ALISON AV MARION SA 5043 Reusing comment email and authority from existing record: 25040431 Saving record 25040431, 4 GOULD RD MOUNT BARKER SPRINGS SA 5251 Reusing comment email and authority from existing record: 25037768 Saving record 25037768, 4A CONWAY CT ROSTREVOR SA 5073 Reusing comment email and authority from existing record: 26010185 Saving record 26010185, 3957 VICTOR HARBOR RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26003944 Saving record 26003944, 15 ORCHESTRA PL SALISBURY HEIGHTS SA 5109 Reusing comment email and authority from existing record: 26004697 Saving record 26004697, 48 ELIZABETH ST TANUNDA SA 5352 Reusing comment email and authority from existing record: 26007028 Saving record 26007028, 61 PINE AV GLENELG NORTH SA 5045 Reusing comment email and authority from existing record: 26006730 Saving record 26006730, 54 WINZOR RD HILLIER SA 5116 Reusing comment email and authority from existing record: 25023722 Saving record 25023722, 16 SLAPES GULLY RD BURNSIDE SA 5066 Reusing comment email and authority from existing record: 26008908 Saving record 26008908, 1C NETHERBY AV NETHERBY SA 5062 Reusing comment email and authority from existing record: 26007168 Saving record 26007168, 41 BOLLEN RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 25040465 Saving record 25040465, 1 CLUBHOUSE RD SEACLIFF SA 5049 Reusing comment email and authority from existing record: 25036256 Saving record 25036256, 168 PAYNEHAM RD EVANDALE SA 5069 Reusing comment email and authority from existing record: 25016642 Saving record 25016642, LOT 10 JERVOIS RD WHITE SANDS SA 5253 Reusing comment email and authority from existing record: 26005795 Saving record 26005795, 38 LEWIS RD GLYNDE SA 5070 Reusing comment email and authority from existing record: 26010265 Saving record 26010265, 9 FULLER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25030621 Saving record 25030621, 10 POPE ST BEVERLEY SA 5009 Reusing comment email and authority from existing record: 26004641 Saving record 26004641, 17 NANKERI CT INGLE FARM SA 5098 Reusing comment email and authority from existing record: 25029021 Saving record 25029021, 98 SPRINGBANK RD CLAPHAM SA 5062 Reusing comment email and authority from existing record: 25030984 Saving record 25030984, 960 LIGHT PASS RD VINE VALE SA 5352 Reusing comment email and authority from existing record: 26009804 Saving record 26009804, LOT 2 RAILWAY PL MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26008334 Saving record 26008334, 115 DEVONPORT TCE PROSPECT SA 5082 Reusing comment email and authority from existing record: 26008697 Saving record 26008697, 15 -19 NELSON ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26002172 Saving record 26002172, 16 NORTHGATE ST UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 25038270 Saving record 25038270, 647 GRAND JUNCTION RD GEPPS CROSS SA 5094 Reusing comment email and authority from existing record: 26001682 Saving record 26001682, 483 HICKEYS DR COOBOWIE SA 5583 Reusing comment email and authority from existing record: 25033384 Saving record 25033384, 16 -18 PICKERING ST BROMPTON SA 5007 Reusing comment email and authority from existing record: 26009072 Saving record 26009072, 119 BEULAH RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26003555 Saving record 26003555, 9 THEEN AV WILLASTON SA 5118 Reusing comment email and authority from existing record: 26009107 Saving record 26009107, 104B SYDENHAM RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 26007633 Saving record 26007633, LOT 662 BOWLING CLUB RD BOOBOROWIE SA 5417 Reusing comment email and authority from existing record: 26003049 Saving record 26003049, UNIT 1 470 CHURCHILL RD KILBURN SA 5084 Reusing comment email and authority from existing record: 26001885 Saving record 26001885, 78 MCKENZIE ST CEDUNA SA 5690 Reusing comment email and authority from existing record: 26003714 Saving record 26003714, LOT 204 SQUARE MILE RD STANLEY FLAT SA 5453 Reusing comment email and authority from existing record: 26008833 Saving record 26008833, 44 SEAGULL AV CHITON SA 5211 Reusing comment email and authority from existing record: 26003377 Saving record 26003377, 3 HARPER ST BROADVIEW SA 5083 Reusing comment email and authority from existing record: 26008767 Saving record 26008767, 1 PARINGA ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26009640 Saving record 26009640, 56 -94 BURGOYNE ST ROXBY DOWNS SA 5725 Reusing comment email and authority from existing record: 25013523 Saving record 25013523, 535 REGENCY RD SEFTON PARK SA 5083 Reusing comment email and authority from existing record: 24034783 Saving record 24034783, 325 UPPER PENNEYS HILL RD ONKAPARINGA HILLS SA 5163 Reusing comment email and authority from existing record: 26000800 Saving record 26000800, 6 CAROLINE AV BELAIR SA 5052 Reusing comment email and authority from existing record: 25039865 Saving record 25039865, 16 GLEBE DR LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25040009 Saving record 25040009, 646 MARION RD PARK HOLME SA 5043 Reusing comment email and authority from existing record: 25037441 Saving record 25037441, 19 WEEMALA DR MITCHAM SA 5062 Reusing comment email and authority from existing record: 26001556 Saving record 26001556, 39 BUTTERICK ST PORT PIRIE SOUTH SA 5540 Reusing comment email and authority from existing record: 26000047 Saving record 26000047, 115 CAMBRIDGE TCE MALVERN SA 5061 Reusing comment email and authority from existing record: 26006456 Saving record 26006456, 38 TUCKER ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26005208 Saving record 26005208, 966A DAWKINS RD GAWLER RIVER SA 5118 Reusing comment email and authority from existing record: 26007887 Saving record 26007887, 13 BLOOMSBURY ST GOODWOOD SA 5034 Reusing comment email and authority from existing record: 26004496 Saving record 26004496, 7 BISHOP ST SKYE SA 5072 Reusing comment email and authority from existing record: 26005079 Saving record 26005079, 538 DEVLINS POUND RD POOGINOOK SA 5330 Reusing comment email and authority from existing record: 26003603 Saving record 26003603, 21 BURT AV HILTON SA 5033 Reusing comment email and authority from existing record: 25030780 Saving record 25030780, 36 FIFE AV TORRENS PARK SA 5062 First Application data retrieved: {"publicNotificationID"=>13021, "applicationID"=>25016642, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"LOT 10 JERVOIS RD WHITE SANDS SA 5253", "developmentDescription"=>"Land Division 1 into 6 (Community Title) ", "closingDate"=>"5/12/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"Rural City of Murray Bridge", "locationCouncil"=>"THE RURAL CITY OF MURRAY BRIDGE", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>921320, "applicationId"=>25016642, "contactName"=>"Morgans Earthmoving Pty Ltd ", "address"=>"23 SYDENHAM ROAD NORWOOD 5067"}]} Found 118 applications that were already in the database, and added 0 new applications. Added 22.07 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 4 Adelaide Hills Council 2 Alexandrina Council 2 City of Adelaide 4 City of Burnside 4 City of Campbelltown 6 City of Charles Sturt 6 City of Marion 9 City of Mitcham 1 City of Mt Gambier 9 City of Norwood, Payneham and St. Peters 4 City of Onkaparinga 4 City of Playford 6 City of Port Adelaide Enfield 2 City of Port Lincoln 2 City of Prospect 3 City of Salisbury 1 City of Tea Tree Gully 8 City of Unley 3 City of Victor Harbor 6 City of West Torrens 1 Clare and Gilbert Valleys Council 1 District Council of Ceduna 1 District Council of Loxton Waikerie 1 Light Regional Council 11 Mount Barker District Council 1 Municipal Council of Roxby Downs 1 Port Pirie Regional Council 1 Regional Council of Goyder 7 State Planning Commission 3 The Barossa Council 2 Town of Gawler 1 Wakefield Regional Council 1 Yorke Peninsula Council

Data

Downloaded 4646 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke DevAppProject softgrow odnagroup ianheggie-oaf MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.8 MB) Use the API

rows 10 / 74393

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 25.9 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    118 records added, 118 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    118 records added, 115 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    128 records added, 108 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    115 records added, 115 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    115 records added, 115 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb