planningalerts-scrapers / town_of_gawler_sa_development_applications

Town of Gawler (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Town of Gawler web site.

Contributors MichaelBone mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.9 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 143 packages from 115 contributors and audited 274 packages in 7.22s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://eservices.gawler.sa.gov.au/eservice/daEnquiryInit.do?doc_typ=4&nodeNum=3228 Retrieving page: https://eservices.gawler.sa.gov.au/eservice/daEnquiryInit.do?doc_typ=4&nodeNum=3228 Retrieving page: https://eservices.gawler.sa.gov.au/eservice/daEnquiryInit.do?doc_typ=4&nodeNum=3228 { RequestError: Error: tunneling socket could not be established, cause=connect ETIMEDOUT 202.124.38.230:8080 at new RequestError (/app/node_modules/request-promise-core/lib/errors.js:14:15) at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:87:29) at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31) at self.callback (/app/node_modules/request/request.js:185:22) at Request.emit (events.js:182:13) at Request.onRequestError (/app/node_modules/request/request.js:881:8) at ClientRequest.emit (events.js:182:13) at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:179:21) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) name: 'RequestError', message: 'Error: tunneling socket could not be established, cause=connect ETIMEDOUT 202.124.38.230:8080', cause: { Error: tunneling socket could not be established, cause=connect ETIMEDOUT 202.124.38.230:8080 at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:177:17) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }, error: { Error: tunneling socket could not be established, cause=connect ETIMEDOUT 202.124.38.230:8080 at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:177:17) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }, options: { url: 'https://eservices.gawler.sa.gov.au/eservice/daEnquiryInit.do?doc_typ=4&nodeNum=3228', jar: RequestJar { _jar: [CookieJar] }, rejectUnauthorized: false, proxy: 'http://202.124.38.230:8080', callback: [Function: RP$callback], transform: undefined, simple: true, resolveWithFullResponse: false, transform2xxOnly: false }, response: undefined }

Data

Downloaded 316 times by openaustralia jesse-a-reilly Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (148 KB) Use the API

rows 10 / 545

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
361/2018
76 Adelaide Road GAWLER SOUTH SA 5118
Verandah (8.4m x 5m x 2.7m)
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-20
374/2018
16 Andreas Avenue EVANSTON GARDENS SA 5116
Verandah (8.3m x 3.2m x 2.6m)
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-27
348/2018
Balmoral Road GAWLER EAST SA 5118
Variation to Previous Application
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-10
376/2018
Balmoral Road GAWLER EAST SA 5118
Detached Dwelling
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-30
382/2018
Balmoral Road GAWLER EAST SA 5118
Detached Dwelling
mailto:council@gawler.sa.gov.au
2018-08-09
2018-08-01
383/2018
Balmoral Road GAWLER EAST SA 5118
Detached Dwelling
mailto:council@gawler.sa.gov.au
2018-08-09
2018-08-01
384/2018
Balmoral Road GAWLER EAST SA 5118
Detached Dwelling
mailto:council@gawler.sa.gov.au
2018-08-09
2018-08-01
362/2018
3 Bartel Court GAWLER EAST SA 5118
Dwelling Additions
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-23
364/2018
12 Blanch Street GAWLER EAST SA 5118
Fence (1.4 metres Max Height)
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-23
353/2018
17 Brown Street WILLASTON SA 5118
Carport (4.07m x 6.1m x 2.7m)
mailto:council@gawler.sa.gov.au
2018-08-09
2018-07-13

Statistics

Average successful run time: less than a minute

Total run time: about 4 hours

Total cpu time used: 7 minutes

Total disk space used: 233 KB

History

  • Auto ran revision e4cf17d2 and completed successfully .
    nothing changed in the database
  • Auto ran revision e4cf17d2 and completed successfully .
    nothing changed in the database
  • Auto ran revision e4cf17d2 and completed successfully .
    nothing changed in the database
  • Auto ran revision e4cf17d2 and completed successfully .
    nothing changed in the database
  • Auto ran revision e4cf17d2 and completed successfully .
    58 records added, 56 records removed in the database
  • ...
  • Created on morph.io

Show complete history