MichaelBone / burnside

City of Burnside Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian City of Burnside web site.

Contributors CloCkWeRX henare LoveMyData MichaelBone

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.2 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 158 packages from 125 contributors and audited 296 packages in 10.996s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.burnside.sa.gov.au/Planning-Business/Planning-Development/New-Planning-Applications-Register Parsing document: https://www.burnside.sa.gov.au/files/assets/public/planning-amp-business/planning-amp-development/new-planning-applications-register/2018/august-2018.pdf Retrieving page: https://www.burnside.sa.gov.au/Planning-Business/Planning-Development/New-Planning-Applications-Register Parsing document: https://www.burnside.sa.gov.au/files/assets/public/planning-amp-business/planning-amp-development/new-planning-applications-register/2018/august-2018.pdf Retrieving page: https://www.burnside.sa.gov.au/Planning-Business/Planning-Development/New-Planning-Applications-Register Parsing document: https://www.burnside.sa.gov.au/files/assets/public/planning-amp-business/planning-amp-development/new-planning-applications-register/2018/august-2018.pdf { RequestError: Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281 at new RequestError (/app/node_modules/request-promise-core/lib/errors.js:14:15) at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:87:29) at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31) at self.callback (/app/node_modules/request/request.js:185:22) at Request.emit (events.js:182:13) at Request.onRequestError (/app/node_modules/request/request.js:881:8) at ClientRequest.emit (events.js:182:13) at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:179:21) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) name: 'RequestError', message: 'Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281', cause: { Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281 at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:177:17) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }, error: { Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281 at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:177:17) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }, options: { url: 'https://www.burnside.sa.gov.au/files/assets/public/planning-amp-business/planning-amp-development/new-planning-applications-register/2018/august-2018.pdf', encoding: null, proxy: 'http://118.127.99.93:53281', callback: [Function: RP$callback], transform: undefined, simple: true, resolveWithFullResponse: false, transform2xxOnly: false }, response: undefined }

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (76 KB) Use the API

rows 10 / 192

date_scraped description info_url council_reference address on_notice_to comment_url
2018-08-18
Two -storey semi-detached dwellings including garages, verandahs, balconies, masonry front fence, retaining walls and fencing
180\0354\18
19 Woodcroft Avenue ST GEORGES SA 5064
mailto:burnside@burnside.sa.gov.au
2018-08-18
Removal of significant Eucalyptus due to close vicinity to house causing damage
180\0534\18
23 Morland Avenue STONYFELL SA 5066
mailto:burnside@burnside.sa.gov.au
2018-08-18
Maintenance work on the church and hall, such as repainting, re-pointing, new roof, preventing water penetration
180\0589\18
46 Prescott Terrace TOORAK GARDENS SA 5065
mailto:burnside@burnside.sa.gov.au
2018-08-18
Detached outbuilding & associated deck
180\0595\18
41 Yeronga Avenue KENSINGTON PARK SA 5068
mailto:burnside@burnside.sa.gov.au
2018-08-18
Colorbond roof to replace existing tiled roof
180\0603\18
516 Glynburn Road BURNSIDE SA 5066
mailto:burnside@burnside.sa.gov.au
2018-08-18
Two (x2) pairs of single-storey semi-detached dwellings, including garages, porches and rear verandahs
180\0607\18
5 Sturdee Street LINDEN PARK SA 5065
mailto:burnside@burnside.sa.gov.au
2018-08-18
Land Division - Creating two (2) allotments from one (1) existing.
180\0613\18
110 Sydney Street GLENUNGA SA 5064
mailto:burnside@burnside.sa.gov.au
2018-08-18
Demolition of existing dwelling, retention of existing shed and construction of new single-storey detached dwelling, including garage and alfresco
180\0622\18
7 John Cleland Drive BEAUMONT SA 5066
mailto:burnside@burnside.sa.gov.au
2018-08-18
Carport
180\0624\18
53A Sydney Street GLENSIDE SA 5065
mailto:burnside@burnside.sa.gov.au
2018-08-18
** Duplication ** ALTERATIONS & CAR PORT ADDITIONS.
180\0626\18
6A Hazelwood Avenue HAZELWOOD PARK SA 5066
mailto:burnside@burnside.sa.gov.au

Statistics

Average successful run time: 2 minutes

Total run time: 15 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 209 KB

History

  • Manually ran revision 4cd75178 and completed successfully .
    nothing changed in the database
  • Manually ran revision 319c059a and completed successfully .
    192 records added in the database
  • Manually ran revision 319c059a and completed successfully .
    nothing changed in the database
  • Manually ran revision d3a69db3 and completed successfully .
    195 records added in the database
  • Manually ran revision d3a69db3 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Node.js

burnside / scraper.js