planningalerts-scrapers / alexandrina_council_sa_development_applications

Alexandrina Council (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Alexandrina Council web site.

Contributors MichaelBone

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.6 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 159 packages from 125 contributors and audited 300 packages in 8.195s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: http://www.alexandrina.sa.gov.au/page.aspx?u=2351 Retrieving page: http://www.alexandrina.sa.gov.au/page.aspx?u=2351 Retrieving page: http://www.alexandrina.sa.gov.au/page.aspx?u=2351 { RequestError: Error: connect ETIMEDOUT 118.127.99.93:53281 at new RequestError (/app/node_modules/request-promise-core/lib/errors.js:14:15) at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:87:29) at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31) at self.callback (/app/node_modules/request/request.js:185:22) at Request.emit (events.js:182:13) at Request.onRequestError (/app/node_modules/request/request.js:881:8) at ClientRequest.emit (events.js:182:13) at Socket.socketErrorListener (_http_client.js:382:9) at Socket.emit (events.js:182:13) at emitErrorNT (internal/streams/destroy.js:82:8) name: 'RequestError', message: 'Error: connect ETIMEDOUT 118.127.99.93:53281', cause: { Error: connect ETIMEDOUT 118.127.99.93:53281 at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1162:14) errno: 'ETIMEDOUT', code: 'ETIMEDOUT', syscall: 'connect', address: '118.127.99.93', port: 53281 }, error: { Error: connect ETIMEDOUT 118.127.99.93:53281 at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1162:14) errno: 'ETIMEDOUT', code: 'ETIMEDOUT', syscall: 'connect', address: '118.127.99.93', port: 53281 }, options: { url: 'http://www.alexandrina.sa.gov.au/page.aspx?u=2351', proxy: 'http://118.127.99.93:53281', callback: [Function: RP$callback], transform: undefined, simple: true, resolveWithFullResponse: false, transform2xxOnly: false }, response: undefined }

Data

Downloaded 155 times by openaustralia MichaelBone LoveMyData Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (572 KB) Use the API

rows 10 / 2301

council_reference address description info_url comment_url date_scraped date_received
455/542/17
11 PACKER STREET, GOOLWA BEACH SA 5214
CARPORT AND SCREEN
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-03
455/546/17
7 STRATHFORD WAY, STRATHALBYN SA 5255
SHED
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-04
455/555/17
492 BOETTCHER ROAD, GOOLWA SA 5214
AIRCRAFT HANGER - SITE 37
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-04
455/556/17
55 BATEMAN STREET, STRATHALBYN SA 5255
DWELLING - DETACHED SINGLE STOREY (RESIDENTIAL CODE)
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-04
455/557/17
844 CROWS NEST ROAD, MOUNT JAGGED SA 5211
DWELLING - DETACHED SINGLE STOREY
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-04
455/558/17
173 WENTWORTH PARADE, HINDMARSH ISLAND SA 5214
DWELLING - DETACHED SINGLE STOREY
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-04
455/559/17
454749 MARCHANT ROAD, STRATHALBYN SA 5255
FREESTANDING CARPORT
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-06
455/561/17
10 KNIGHT STREET, GOOLWA BEACH SA 5214
VERANDAH
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-14
455/567/17
7 GRANDVIEW DRIVE, CLAYTON BAY SA 5256
VERANDAH
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-03
455/571/17
40 RICHARDSON ROAD, WILLYAROO SA 5255
SHED - STORE (NON-COMPLYING)
mailto:alex@alexandrina.sa.gov.au
2018-08-23
2017-07-06

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 10 minutes

Total disk space used: 713 KB

History

  • Auto ran revision 1443b713 and completed successfully .
    nothing changed in the database
  • Auto ran revision 1443b713 and completed successfully .
    nothing changed in the database
  • Auto ran revision 1443b713 and completed successfully .
    nothing changed in the database
  • Auto ran revision 1443b713 and completed successfully .
    nothing changed in the database
  • Auto ran revision 1443b713 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history