planningalerts-scrapers / yorke_peninsula_council_sa_development_applications

Yorke Peninsula Council (South Australia) Development Applications

README.md

This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Yorke Peninsula Council web site.

Contributors

Last run completed successfully 2020-09-27.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Node.js app detected [1G [1G-----> Creating runtime environment [1G [1G NPM_CONFIG_LOGLEVEL=error [1G NPM_CONFIG_PRODUCTION=true [1G NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt [1G NODE_VERBOSE=false [1G NODE_ENV=production [1G NODE_TLS_REJECT_UNAUTHORIZED=0 [1G NODE_MODULES_CACHE=true [1G [1G-----> Installing binaries [1G engines.node (package.json): 10.6.0 [1G engines.npm (package.json): unspecified (use default) [1G [1G Resolving node version 10.6.0... [1G Downloading and installing node 10.6.0... [1G Using default npm version: 6.1.0 [1G [1G-----> Restoring cache [1G Skipping cache restore (not-found) [1G [1G-----> Building dependencies [1G Installing node modules (package.json) [1G [1G > sqlite3@4.2.0 install /tmp/build/node_modules/sqlite3 [1G > node-pre-gyp install --fallback-to-build [1G [1G [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote [1G added 146 packages from 117 contributors and audited 147 packages in 6.769s [1G found 0 vulnerabilities [1G [1G [1G-----> Caching build [1G Clearing previous node cache [1G Saving 2 cacheDirectories (default): [1G - node_modules [1G - bower_components (nothing to cache) [1G [1G-----> Build succeeded! [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Retrieving development applications from 2020-08-27 to 2020-09-27. Retrieving page 1: https://yorke.sa.gov.au/development/development-information/development-register/?pagenum=1&gv_search=&filter_1=&filter_3=&gv_start=27%2F08%2F2020&gv_end=27%2F09%2F2020&filter_7=&mode=all Reached the last page of the paged search results. Retrieving development applications from 2008-11-27 to 2008-12-27. Retrieving page 1: https://yorke.sa.gov.au/development/development-information/development-register/?pagenum=1&gv_search=&filter_1=&filter_3=&gv_start=27%2F11%2F2008&gv_end=27%2F12%2F2008&filter_7=&mode=all Saved: application "544.2008.00002362.001" with address "46-48 Main Coast Road, PINE POINT SA 5571", description "Caravan Annexe & Porch" and received date "2008-12-24" into the database. Saved: application "544.2008.00000048.001" with address "105 Parsons Beach Road, PARSONS BEACH SA 5575", description "Land Division" and received date "2008-12-23" into the database. Saved: application "544.2008.00000049.001" with address "1473 Port Victoria Road, SOUTH KILKERRAN SA 5573", description "Land Division" and received date "2008-12-23" into the database. Saved: application "544.2008.00001432.001" with address "21 Seaview Road, CORNY POINT SA 5575", description "Front & Rear Deck" and received date "2008-12-23" into the database. Saved: application "544.2008.00001433.001" with address "64 Warooka Road, YORKETOWN SA 5576", description "Pergola and Demolition of Existing Shed" and received date "2008-12-23" into the database. Saved: application "544.2008.00000048.001" with address "107-109 Parsons Beach Road, PARSONS BEACH SA 5575", description "Land Division" and received date "2008-12-23" into the database. The state and post code will not be added because the address ends with a hundred name: HD MELVILLE Saved: application "544.2008.00000047.001" with address "HD MELVILLE", description "Land Division" and received date "2008-12-23" into the database. Saved: application "544.2008.00000047.001" with address "1486 Goldsmith Beach Road, HONITON SA 5576", description "Land Division" and received date "2008-12-23" into the database. Saved: application "544.2008.00000049.001" with address "Barley Stacks Road, SOUTH KILKERRAN SA 5573", description "Land Division" and received date "2008-12-23" into the database. Saved: application "544.2008.00000049.001" with address "Port Victoria Road, SOUTH KILKERRAN SA 5573", description "Land Division" and received date "2008-12-23" into the database. Saved: application "544.2008.00001430.001" with address "7 Seaview Court, STANSBURY SA 5582", description "Verandah" and received date "2008-12-22" into the database. Saved: application "544.2008.00002361.001" with address "21 Bowman Road, ARDROSSAN SA 5571", description "Garage" and received date "2008-12-22" into the database. Saved: application "544.2008.00001431.001" with address "18 McIntyre Place, STANSBURY SA 5582", description "Dwelling Addition" and received date "2008-12-22" into the database. Saved: application "544.2008.00001429.001" with address "11 Oyster Point Drive, STANSBURY SA 5582", description "Carport" and received date "2008-12-22" into the database. Saved: application "544.2008.00002360.001" with address "16 Chester Avenue, PORT VINCENT SA 5581", description "Demolition of Garage" and received date "2008-12-19" into the database. Saved: application "544.2008.00000046.001" with address "18 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "1 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "12 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "18 Berno Crescent, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "11 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "9 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "16 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "14 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "10 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "10 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Retrieving page 2: https://yorke.sa.gov.au/development/development-information/development-register/?pagenum=2&gv_search=&filter_1=&filter_3=&gv_start=27%2F11%2F2008&gv_end=27%2F12%2F2008&filter_7=&mode=all Saved: application "544.2008.00000045.001" with address "1/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "6/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "2 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "20 Berno Crescent, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "9 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "4 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "3/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "3 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "5/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "1 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "4 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "10 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "10 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "8/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "14 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00001428.001" with address "3 The Loop, HARDWICKE BAY SA 5575", description "Garage" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "11 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "11 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "4/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "5 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000045.001" with address "7/25 O'Halloran Parade, EDITHBURGH SA 5583", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "12 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "3 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "13 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Retrieving page 3: https://yorke.sa.gov.au/development/development-information/development-register/?pagenum=3&gv_search=&filter_1=&filter_3=&gv_start=27%2F11%2F2008&gv_end=27%2F12%2F2008&filter_7=&mode=all Saved: application "544.2008.00000046.001" with address "9 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "12 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "17 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "13 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "16 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "7 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "14 Tickera Court, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00000046.001" with address "15 Wellington Drive, PORT JULIA SA 5575", description "Land Division" and received date "2008-12-16" into the database. Saved: application "544.2008.00002358.001" with address "42 Main Street, BALGOWAN SA 5573", description "Garage" and received date "2008-12-15" into the database. Saved: application "544.2008.00002357.001" with address "47 Clinton Road, MAITLAND SA 5573", description "Retaining Wall" and received date "2008-12-15" into the database. Saved: application "544.2008.00001425.001" with address "482 Beegoodye Wells Road, MINLATON SA 5575", description "Garage" and received date "2008-12-15" into the database. Saved: application "544.2008.00001426.001" with address "482 Beegoodye Wells Road, MINLATON SA 5575", description "Dwelling addition and Pergola" and received date "2008-12-15" into the database. Saved: application "544.2008.00001427.001" with address "2 Fourth Street, WAROOKA SA 5577", description "Carport" and received date "2008-12-15" into the database. Saved: application "544.2008.00002354.001" with address "11 Kooringa Street, PORT VINCENT SA 5581", description "Deck & Pergola" and received date "2008-12-12" into the database. Saved: application "544.2008.00001424.001" with address "119 Moores Drive, HARDWICKE BAY SA 5575", description "Sunroom and Lean-to" and received date "2008-12-12" into the database. Saved: application "544.2008.00002355.001" with address "17 Kulpara Street, PORT CLINTON SA 5555", description "Dwelling, Verandah & Deck" and received date "2008-12-12" into the database. Saved: application "544.2008.00002356.001" with address "6 Beach Road, PINE POINT SA 5571", description "Dwelling and Verandah" and received date "2008-12-12" into the database. Saved: application "544.2008.00001422.001" with address "Fielding Street, EDITHBURGH SA 5583", description "Garage" and received date "2008-12-11" into the database. The state and post code will not be added because the address ends with a hundred name: HD WARRENBEN Saved: application "544.2008.00001423.001" with address "HD WARRENBEN", description "Water Tower" and received date "2008-12-11" into the database. Saved: application "544.2008.00002351.001" with address "1-7 Dinham Drive, ARDROSSAN SA 5571", description "Advisory Sign" and received date "2008-12-11" into the database. Saved: application "544.2008.00001421.001" with address "9 Seaview Court, STANSBURY SA 5582", description "Two Storey Dwelling" and received date "2008-12-11" into the database. Saved: application "544.2008.00002352.001" with address "1225 Dump Road, PORT VINCENT SA 5581", description "Garage" and received date "2008-12-11" into the database. Saved: application "544.2008.00002353.001" with address "34 East Terrace, ARDROSSAN SA 5571", description "Garage" and received date "2008-12-11" into the database. Saved: application "544.2008.00002350.001" with address "144 Bayview Road, POINT TURTON SA 5575", description "Dredging of Boat Ramp" and received date "2008-12-11" into the database. Saved: application "544.2008.00002349.001" with address "11-15 Arthurton Road, ARDROSSAN SA 5571", description "Verandah" and received date "2008-12-11" into the database. Retrieving page 4: https://yorke.sa.gov.au/development/development-information/development-register/?pagenum=4&gv_search=&filter_1=&filter_3=&gv_start=27%2F11%2F2008&gv_end=27%2F12%2F2008&filter_7=&mode=all Saved: application "544.2008.00001420.001" with address "13 Scenic Drive, POINT TURTON SA 5575", description "Dwelling" and received date "2008-12-08" into the database. Saved: application "544.2008.00001419.001" with address "37 Stansbury Road, YORKETOWN SA 5576", description "Shade Sails x 2" and received date "2008-12-08" into the database. Saved: application "544.2008.00002347.001" with address "76 Hosking Road, TIDDY WIDDY BEACH SA 5571", description "Dwelling" and received date "2008-12-05" into the database. Saved: application "544.2008.00002348.001" with address "547 Maitland Road, MAITLAND SA 5573", description "Hay Shed" and received date "2008-12-05" into the database. Saved: application "544.2008.00001418.001" with address "4 Hardwicke Close, POINT TURTON SA 5575", description "Pergola" and received date "2008-12-04" into the database. Saved: application "544.2008.00002343.001" with address "37 Edwardes Terrace, PORT VICTORIA SA 5573", description "2x2 Storey Dwellings&4 Single Storey Dwellings,Carports,Porches,Balcon" and received date "2008-12-04" into the database. Saved: application "544.2008.00002345.001" with address "11 Marina Drive, PORT VINCENT SA 5581", description "2 Storey Dwelling, Garage & Balcony" and received date "2008-12-04" into the database. Saved: application "544.2008.00002344.001" with address "49 Marina Drive, PORT VINCENT SA 5581", description "2 Storey Dwelling, Garage & Balcony" and received date "2008-12-04" into the database. Saved: application "544.2008.00001415.001" with address "39 Marine Parade, PORT MOOROWIE SA 5576", description "Verandah" and received date "2008-12-03" into the database. Saved: application "544.2008.00002342.001" with address "100 Hosking Road, TIDDY WIDDY BEACH SA 5571", description "Garage" and received date "2008-12-02" into the database. Saved: application "544.2008.00001416.001" with address "5-17 Yorketown Road, MINLATON SA 5575", description "Verandah" and received date "2008-12-02" into the database. Saved: application "544.2008.00002340.001" with address "12 Lime Kiln Road, PORT VINCENT SA 5581", description "Carport" and received date "2008-12-02" into the database. Saved: application "544.2008.00002339.001" with address "137 Breona Road, SOUTH KILKERRAN SA 5573", description "Relocate Dwelling" and received date "2008-12-02" into the database. Saved: application "544.2008.00002341.001" with address "2 Viking Street, PORT VICTORIA SA 5573", description "Garage" and received date "2008-12-02" into the database. Saved: application "544.2008.00002338.001" with address "1 Davey Road, ROGUES POINT SA 5571", description "Temporary Sand Bag Retaining Wall" and received date "2008-12-01" into the database. Saved: application "544.2008.00002337.001" with address "114 Breona Road, SOUTH KILKERRAN SA 5573", description "Farm Building - Implement Shed" and received date "2008-12-01" into the database. Saved: application "544.2008.00002336.001" with address "1 Parade, PORT CLINTON SA 5555", description "Caravan Annexe & Porch" and received date "2008-11-27" into the database. Saved: application "544.2008.00002335.001" with address "Black Point Drive, BLACK POINT SA 5571", description "Lean-to" and received date "2008-11-27" into the database. Reached the last page of the paged search results. Complete.

Data

Downloaded 670 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (5.09 MB) Use the API

rows 10 / 11802

council_reference	address	description	info_url	comment_url	date_scraped	date_received
544.2010.00001093.001	30 Anzac Parade, STANSBURY SA 5582	Verandah	https://yorke.sa.gov.au/development/development-information/development-register/entry/7312237/?pagenum=1	mailto:admin@yorke.sa.gov.au	2018-12-04	2010-04-01
544.2010.00002079.001	7 First Street, CURRAMULKA SA 5580	Garage (6.2m x 7.7m x 2.7m wall height)	https://yorke.sa.gov.au/development/development-information/development-register/?gv_search=&filter_1=544.2010.00002079.001&filter_3=&gv_start=&gv_end=&filter_7=&mode=all	mailto:admin@yorke.sa.gov.au	2018-12-04	2010-03-11
544.2001.00002099.001	98 Hosking Road, TIDDY WIDDY BEACH SA 5571	Dwelling	https://yorke.sa.gov.au/development/development-information/development-register/entry/7332524/?pagenum=2	mailto:admin@yorke.sa.gov.au	2018-12-05	2001-04-05
544.2001.00002100.001	61 Edwardes Terrace, PORT VICTORIA SA 5573	Pergola,Verandah etc (Alts & Adds)	https://yorke.sa.gov.au/development/development-information/development-register/entry/7330355/?pagenum=2	mailto:admin@yorke.sa.gov.au	2018-12-05	2001-04-05
544.2005.00001059.001	571 Pentonvale Road, YORKETOWN SA 5576	Farm Building - Implement Shed	https://yorke.sa.gov.au/development/development-information/development-register/?gv_search=&filter_1=544.2005.00001059.001&filter_3=&gv_start=&gv_end=&filter_7=&mode=all	mailto:admin@yorke.sa.gov.au	2018-12-06	2005-03-02
544.2009.00002263.001	6 Crampton Crescent, PORT VICTORIA SA 5573	Garage 9.1m x 6.0 m x 3.0 m	https://yorke.sa.gov.au/development/development-information/development-register/entry/7372962/?pagenum=1	mailto:admin@yorke.sa.gov.au	2018-12-08	2009-10-08
544.2009.00002261.001	28 Davey Road, ROGUES POINT SA 5571	Demolition of Dwelling	https://yorke.sa.gov.au/development/development-information/development-register/entry/7368848/?pagenum=1	mailto:admin@yorke.sa.gov.au	2018-12-08	2009-10-08
544.2009.00002262.001	7 Passat Street, PORT VICTORIA SA 5573	Garage 6.0 m x 5.5 m x 3.0 m	https://yorke.sa.gov.au/development/development-information/development-register/entry/7373991/?pagenum=1	mailto:admin@yorke.sa.gov.au	2018-12-08	2009-10-08
544.2009.00002259.001	45 Edwardes Terrace, PORT VICTORIA SA 5573	Carport	https://yorke.sa.gov.au/development/development-information/development-register/entry/7371689/?pagenum=1	mailto:admin@yorke.sa.gov.au	2018-12-08	2009-10-08
544.2009.00002260.001	1 Park Terrace, ARDROSSAN SA 5571	Caravan Annexe Renovation - Bathroom & Water Closet	https://yorke.sa.gov.au/development/development-information/development-register/entry/7362763/?pagenum=1	mailto:admin@yorke.sa.gov.au	2018-12-08	2009-10-08

Statistics

Average successful run time: 5 minutes

Total run time: 2 days

Total cpu time used: about 1 hour

Total disk space used: 5.21 MB

History

Auto ran revision e1fd3fa0 and completed successfully 2020-09-27.

run time 11 minutes

49 records added, 49 records removed in the database
Auto ran revision e1fd3fa0 and completed successfully 2020-09-26.

run time 2 minutes

22 records added, 22 records removed in the database
Auto ran revision e1fd3fa0 and completed successfully 2020-09-25.

run time 6 minutes

5 records added, 5 records removed in the database
Auto ran revision e1fd3fa0 and completed successfully 2020-09-24.

run time 11 minutes

65 records added, 38 records removed in the database
Auto ran revision e1fd3fa0 and completed successfully 2020-09-23.

run time 5 minutes

60 records added, 59 records removed in the database
...
Created on morph.io 2018-12-03

Show complete history

Scraper code

Node.js

yorke_peninsula_council_sa_development_applications / scraper.js

git clone URL