planningalerts-scrapers / wattle_range_council_sa_development_applications

Wattle Range Council (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Wattle Range Council web site.

Contributors MichaelBone

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.6 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 469 packages from 294 contributors and audited 4479 packages in 16.064s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.wattlerange.sa.gov.au/page.aspx?u=1158 Retrieving page: https://www.wattlerange.sa.gov.au/page.aspx?u=1158 Retrieving page: https://www.wattlerange.sa.gov.au/page.aspx?u=1158 { RequestError: Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281 at new RequestError (/app/node_modules/request-promise-core/lib/errors.js:14:15) at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:87:29) at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31) at self.callback (/app/node_modules/request/request.js:185:22) at Request.emit (events.js:182:13) at Request.onRequestError (/app/node_modules/request/request.js:881:8) at ClientRequest.emit (events.js:182:13) at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:179:21) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) name: 'RequestError', message: 'Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281', cause: { Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281 at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:177:17) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }, error: { Error: tunneling socket could not be established, cause=connect ETIMEDOUT 118.127.99.93:53281 at ClientRequest.onError (/app/node_modules/tunnel-agent/index.js:177:17) at Object.onceWrapper (events.js:273:13) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }, options: { url: 'https://www.wattlerange.sa.gov.au/page.aspx?u=1158', proxy: 'http://118.127.99.93:53281', callback: [Function: RP$callback], transform: undefined, simple: true, resolveWithFullResponse: false, transform2xxOnly: false }, response: undefined }

Data

Downloaded 126 times by openaustralia jesse-a-reilly Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (224 KB) Use the API

rows 10 / 831

council_reference address description info_url comment_url date_scraped
894/001/15
LOT 5, SECTION 2356, 85 LAKE EDWARD ROAD, GLENCOE SA 5291
EXTENSION TO EXISTING SHED
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/003/15
LOT 29, 29-35 ELLEN STREET, PENOLA SA 5277
ALTERATIONS TO EXISTING SHOWROOM/WAREHOUSE
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/004/15
LOT 138, 8 NINTH STREET, MILLICENT SA 5280
DOMESTIC SHED
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/005/15
LOT 20, SECTION P.534, KENTISH PLACE, MILLICENT SA 5280
CARPARKING RECONFIGURATION & EXTENSTION TO OUTDOOR GARDEN CENTRE
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/007/15
LOT 3, BURKS ISLAND ROAD, BEACHPORT SA 5280
DOMESTIC SHED
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/009/15
SECTION 738, 38 RACECOURSE ROAD, MILLICENT SA 5280
EXTEND EXISTING PERGOLA
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/164/14
LOT 2, SECTION CENTENARY , CORIGLIANO STREET, BEACHPORT SA 5280
SCULPTURE IN BEACHPORT LAGOON AREA
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/191/14
LOT 4, SECTION P.5, 5A RALSTON STREET, PENOLA SA 5277
REPLACE EXISTING SHED
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/227/14
LOT 2, SECTION PS356, 224 ROCKY CAMP RANGE ROAD, ROCKY CAMP SA 5280
DOMESTIC SHED
mailto:council@wattlerange.sa.gov.au
2018-12-04
894/232/14
LOT 101, SECTION 388, 44-50 RAILWAY TERRACE, BEACHPORT SA 5280
INSTAL ONE EXTERNAL DOOR
mailto:council@wattlerange.sa.gov.au
2018-12-04

Statistics

Average successful run time: 2 minutes

Total run time: about 4 hours

Total cpu time used: 4 minutes

Total disk space used: 626 KB

History

  • Auto ran revision 9b95ee38 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9b95ee38 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9b95ee38 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9b95ee38 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9b95ee38 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history