planningalerts-scrapers / city_of_whyalla_sa_development_applications

City of Whyalla (South Australia) Development Applications

README.md

This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian City of Whyalla web site.

Contributors MichaelBone

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.4 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 160 packages from 125 contributors and audited 299 packages in 7.982s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.whyalla.sa.gov.au/page.aspx?u=1081 Parsing document: https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20November%202018.pdf Parsed 25 development application(s) from document: https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20November%202018.pdf Skipped: application "850/200/18" with address "36 LOCKWOOD CRESCENT, WHYALLA STUART SA 5608" and description "INTERNAL ALTERATIONS TO EXISTING DWELLING AND GARAGE" because it was already present in the database. Skipped: application "850/201/18" with address "LOT 13 STONY POINT, WHYALLA PLAYFORD SA 5600" and description "2MW SOLAR PANELS" because it was already present in the database. Skipped: application "850/202/18" with address "225 NICOLSON AVENUE, WHYALLA STUART SA 5608" and description "CARPORT" because it was already present in the database. Skipped: application "850/203/18" with address "22 GOODMAN STREET, WHYALLA SA 5600" and description "FRONT VERANDAH" because it was already present in the database. Skipped: application "850/204/18" with address "24 GOODMAN STREET, WHYALLA SA 5600" and description "FRONT VERANDAH" because it was already present in the database. Skipped: application "850/205/18" with address "16 BARTER STREET, WHYALLA PLAYFORD SA 5600" and description "DOMESTIC GARAGE" because it was already present in the database. Skipped: application "850/206/18" with address "6 PICKHAVER STREET, WHYALLA STUART SA 5608" and description "DOMESTIC GARAGE" because it was already present in the database. Skipped: application "850/207/18" with address "126 JENKINS AVENUE, WHYALLA NORRIE SA 5608" and description "DOMESTIC GARGE" because it was already present in the database. Skipped: application "850/208/18" with address "19 NOBLE STREET, WHYALLA STUART SA 5608" and description "REAR VERANDAH" because it was already present in the database. Skipped: application "850/209/18" with address "10 KLEEMAN STREET, WHYALLA SA 5600" and description "SWIMMING POOL" because it was already present in the database. Skipped: application "850/210/18" with address "14 WALLS STREET, WHYALLA SA 5600" and description "SHED" because it was already present in the database. Skipped: application "850/211/18" with address "60 RUDALL AVENUE, WHYALLA PLAYFORD SA 5600" and description "DOMESTIC GARAGE WITH ATTACHED CARPORT" because it was already present in the database. Skipped: application "850/212/18" with address "5 HINCKS AVENUE, WHYALLA NORRIE SA 5608" and description "REAR VERANDAH" because it was already present in the database. Skipped: application "850/213/18" with address "93 LACEY STREET, WHYALLA PLAYFORD SA 5600" and description "CARPORT" because it was already present in the database. Skipped: application "850/214/18" with address "23 LAUGHT STREET, WHYALLA STUART SA 5608" and description "CARPORT AND REAR VERANDAH" because it was already present in the database. Skipped: application "850/215/18" with address "201 LACEY STREET, WHYALLA PLAYFORD SA 5600" and description "VERANDAH" because it was already present in the database. Skipped: application "850/216/18" with address "2 HINCKS AVENUE, WHYALLA NORRIE SA 5608" and description "VERANDAH" because it was already present in the database. Skipped: application "850/217/18" with address "12 WARNES AVENUE, WHYALLA JENKINS SA 5609" and description "REAR VERANDAH" because it was already present in the database. Skipped: application "850/218/18" with address "97 NEWTON STREET, WHYALLA SA 5600" and description "REAR VERANDAH" because it was already present in the database. Skipped: application "850/219/18" with address "18B ELLIOTT STREET, WHYALLA SA 5600" and description "PERGOLA" because it was already present in the database. Skipped: application "850/220/18" with address "18A ELLIOTT STREET, WHYALLA SA 5600" and description "PERGOLA" because it was already present in the database. Skipped: application "850/221/18" with address "6 ROBINSON STREET, WHYALLA JENKINS SA 5609" and description "VERANDAH" because it was already present in the database. Skipped: application "850/222/18" with address "23 HEATH STREET, WHYALLA NORRIE SA 5608" and description "VERANDAH" because it was already present in the database. Skipped: application "850/D006/18" with address "169-173 169-173 NICOLSON NICOLSON AVENUE AVENU, WHYALLA NORRIE SA 5608" and description "CONVENTIONAL LAND DIVISION" because it was already present in the database. Skipped: application "850/S007/18" with address "153 NICOLSON AVENUE, WHYALLA NORRIE SA 5608" and description "STRATA DIVISION" because it was already present in the database. Parsing document: https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20April%202018.pdf Parsed 19 development application(s) from document: https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20April%202018.pdf Skipped: application "850/060/18" with address "10 RAMSAY STREET, WHYALLA STUART SA 5608" and description "CARPORT" because it was already present in the database. Skipped: application "850/061/18" with address "3 WILSONIA DRIVE, POINT LOWLY SA 5601" and description "DWELLING WITH FRONT VERANDAH AND REAR DECKING" because it was already present in the database. Skipped: application "850/062/18" with address "24 BREALEY STREET, WHYALLA PLAYFORD SA 5600" and description "CARPORT" because it was already present in the database. Skipped: application "850/063/18" with address "16 HERBERT STREET, WHYALLA SA 5600" and description "DOMESTIC GARAGE" because it was already present in the database. Skipped: application "850/064/18" with address "16 HERBERT STREET, WHYALLA SA 5600" and description "CARPORT" because it was already present in the database. Skipped: application "850/065/18" with address "16 HERBERT STREET, WHYALLA SA 5600" and description "REAR VERANDAH" because it was already present in the database. Skipped: application "850/066/18" with address "24 HERBERT STREET, WHYALLA SA 5600" and description "DECKING UNDER REAR VERANDAH" because it was already present in the database. Skipped: application "850/067/18" with address "LOT 3171 NICOLSON AVENUE, WHYALLA NORRIE SA 5608" and description "STAGED APPLICATION - STAGE 1 REPLACEMENT OF EXISTING TOILETS WITH NEW TOILETS AND CHANGEROOM STAGE 2 - REPLACEMENT OF EXISTING CLUBROOM" because it was already present in the database. Skipped: application "850/068/18" with address "101 JENKINS AVENUE, WHYALLA NORRIE SA 5608" and description "VERANDAH" because it was already present in the database. Skipped: application "850/069/18" with address "31 JAMIESON STREET, WHYALLA SA 5600" and description "VERANDAH" because it was already present in the database. Skipped: application "850/070/18" with address "34 MILSOM STREET, WHYALLA STUART SA 5608" and description "PREFABRICATED SLEEPOUT REAR YARD" because it was already present in the database. Skipped: application "850/071/18" with address "4 SHOAL COURT, WHYALLA SA 5600" and description "TWO STOREY DWELLING WITH GARAGE UMR AND REAR ALFRESCO AREA" because it was already present in the database. Skipped: application "850/073/18" with address "28 MCEWIN STREET, WHYALLA PLAYFORD SA 5600" and description "CARPORT" because it was already present in the database. Skipped: application "850/074/18" with address "3 HUTCHENS STREET, WHYALLA STUART SA 5608" and description "14 & 6 BED ADDITION GARAGE AND REFURBISHMENT OF EXISTING COPPERHOUSE COURT AGE CARE FACILITY" because it was already present in the database. Skipped: application "850/075/18" with address "10 NEWTON STREET, WHYALLA SA 5600" and description "EXTENSION TO EXISTING DWELLING WITH REAR AND SIDE VERANDAHS" because it was already present in the database. Skipped: application "850/076/18" with address "52-54 LEWTHWAITE STREET, WHYALLA NORRIE SA 5608" and description "DOMESTIC GARAGE" because it was already present in the database. Skipped: application "850/077/18" with address "1A MCEWIN STREET, WHYALLA PLAYFORD SA 5600" and description "REAR VERANDAH" because it was already present in the database. Skipped: application "850/084/18" with address "27-29 JESSOP STREET, WHYALLA PLAYFORD SA 5600" and description "VEHIVLE REPAIRS VEHICLE STORAGE TOWING & WRECKING" because it was already present in the database. Skipped: application "850/C001/18" with address "24 GOODMAN STREET, WHYALLA SA 5600" and description "COMMUNITY DIVISION" because it was already present in the database. Complete.

Data

Downloaded 81 times by openaustralia MichaelBone LoveMyData

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (108 KB) Use the API

rows 10 / 292

council_reference address description info_url comment_url date_scraped date_received
850/001/18
18 WALLS STREET, WHYALLA SA 5600
FREESTANDING VERANDAH
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-09
850/002/18
19 HOBBS STREET, WHYALLA NORRIE SA 5608
VERANDAH EXTENSION
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-12
850/003/18
86 BILLING STREET, WHYALLA PLAYFORD SA 5600
SIDE AND REAR VERANDAH
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-12
850/004/18
2 SEA-HEATH VIEW, DOUGLAS POINT SA 5061
VERANDAH
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-11
850/005/18
42 WARD STREET, WHYALLA SA 5600
DOMESTIC COLORBOND GARAGE
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-15
850/006/18
6 FIELD STREET, WHYALLA PLAYFORD SA 5600
GARAGE
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-16
850/007/18
2 FLAVEL STREET, WHYALLA NORRIE SA 5608
INTERNAL ALTERATIONS - REMOVE WALLS TO CREATE OPEN PLAN LIVING AREA
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-16
850/008/18
144 ELLIOTT STREET, WHYALLA PLAYFORD SA 5600
REAR VERANDAH
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-19
850/009/18
44 BOETTCHER STREET, WHYALLA STUART SA 5608
SLEEP OUT
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-23
850/010/18
17 ROSEMARY STREET, WHYALLA NORRIE SA 5608
CARPORT
https://www.whyalla.sa.gov.au/webdata/resources/files/development%20register%20January%202018.pdf
mailto:customer.service@whyalla.sa.gov.au
2018-09-02
2018-01-24

Statistics

Average successful run time: 3 minutes

Total run time: about 5 hours

Total cpu time used: 4 minutes

Total disk space used: 406 KB

History

  • Auto ran revision f4472a1a and completed successfully .
    nothing changed in the database
  • Auto ran revision f4472a1a and completed successfully .
    nothing changed in the database
  • Auto ran revision f4472a1a and completed successfully .
    nothing changed in the database
  • Auto ran revision f4472a1a and completed successfully .
    25 records added in the database
  • Auto ran revision f4472a1a and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history