planningalerts-scrapers / adelaide_hills_council_sa_development_applications

Adelaide Hills Council (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Adelaide Hills Council web site.

Contributors MichaelBone LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.1 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 151 packages from 120 contributors and audited 219 packages in 10.191s  found 4 vulnerabilities (2 low, 2 moderate)  run `npm audit fix` to fix them, or `npm audit` for details  -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.ahc.sa.gov.au/Resident/planning-and-building/development-applications/development-applications-register { StatusCodeError: 404 - "<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html;charset=utf-8\" /><meta name=\"SharePointError\" content=\"\"/>\n<meta name=\"Description\" content=\"\"/>\n<meta name=\"Keywords\" content=\"\"/>\n<meta name=\"Robots\" content=\"NOINDEX\"/>\n<script type=\"text/javascript\">\n<!--\nwindow.location.replace(\"https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fPages\\u002fPageNotFoundError.aspx?requestUrl=https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fResident\\u002fplanning-and-building\\u002fdevelopment-applications\\u002fdevelopment-applications-register\")\n-->\n</script>\n</head>\n<body>\n<!------------------------------------------------------------------------->\nFile Not Found\n<!------------------------------------------------------------------------->\n</body>\n</html>" at new StatusCodeError (/app/node_modules/request-promise-core/lib/errors.js:32:15) at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:104:33) at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31) at Request.self.callback (/app/node_modules/request/request.js:185:22) at Request.emit (events.js:182:13) at Request.<anonymous> (/app/node_modules/request/request.js:1157:10) at Request.emit (events.js:182:13) at IncomingMessage.<anonymous> (/app/node_modules/request/request.js:1079:12) at Object.onceWrapper (events.js:273:13) at IncomingMessage.emit (events.js:187:15) name: 'StatusCodeError', statusCode: 404, message: '404 - "<html>\\n<head>\\n<meta http-equiv=\\"Content-Type\\" content=\\"text/html;charset=utf-8\\" /><meta name=\\"SharePointError\\" content=\\"\\"/>\\n<meta name=\\"Description\\" content=\\"\\"/>\\n<meta name=\\"Keywords\\" content=\\"\\"/>\\n<meta name=\\"Robots\\" content=\\"NOINDEX\\"/>\\n<script type=\\"text/javascript\\">\\n<!--\\nwindow.location.replace(\\"https:\\\\u002f\\\\u002fwww.ahc.sa.gov.au\\\\u002fPages\\\\u002fPageNotFoundError.aspx?requestUrl=https:\\\\u002f\\\\u002fwww.ahc.sa.gov.au\\\\u002fResident\\\\u002fplanning-and-building\\\\u002fdevelopment-applications\\\\u002fdevelopment-applications-register\\")\\n-->\\n</script>\\n</head>\\n<body>\\n<!------------------------------------------------------------------------->\\nFile Not Found\\n<!------------------------------------------------------------------------->\\n</body>\\n</html>"', error: '<html>\n<head>\n<meta http-equiv="Content-Type" content="text/html;charset=utf-8" /><meta name="SharePointError" content=""/>\n<meta name="Description" content=""/>\n<meta name="Keywords" content=""/>\n<meta name="Robots" content="NOINDEX"/>\n<script type="text/javascript">\n<!--\nwindow.location.replace("https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fPages\\u002fPageNotFoundError.aspx?requestUrl=https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fResident\\u002fplanning-and-building\\u002fdevelopment-applications\\u002fdevelopment-applications-register")\n-->\n</script>\n</head>\n<body>\n<!------------------------------------------------------------------------->\nFile Not Found\n<!------------------------------------------------------------------------->\n</body>\n</html>', options: { uri: 'https://www.ahc.sa.gov.au/Resident/planning-and-building/development-applications/development-applications-register', callback: [Function: RP$callback], transform: undefined, simple: true, resolveWithFullResponse: false, transform2xxOnly: false }, response: IncomingMessage { _readableState: ReadableState { objectMode: false, highWaterMark: 16384, buffer: BufferList { length: 0 }, length: 0, pipes: null, pipesCount: 0, flowing: true, ended: true, endEmitted: true, reading: false, sync: false, needReadable: false, emittedReadable: false, readableListening: false, resumeScheduled: false, emitClose: true, destroyed: false, defaultEncoding: 'utf8', awaitDrain: 0, readingMore: false, decoder: null, encoding: null }, readable: false, _events: { end: [Array], close: [Array], data: [Function], error: [Function] }, _eventsCount: 4, _maxListeners: undefined, socket: TLSSocket { _tlsOptions: [Object], _secureEstablished: true, _securePending: false, _newSessionPending: false, _controlReleased: true, _SNICallback: null, servername: 'www.ahc.sa.gov.au', alpnProtocol: false, authorized: false, authorizationError: 'SELF_SIGNED_CERT_IN_CHAIN', encrypted: true, _events: [Object], _eventsCount: 8, connecting: false, _hadError: false, _handle: [TLSWrap], _parent: null, _host: 'www.ahc.sa.gov.au', _readableState: [ReadableState], readable: true, _maxListeners: undefined, _writableState: [WritableState], writable: false, allowHalfOpen: false, _sockname: null, _pendingData: null, _pendingEncoding: '', server: undefined, _server: null, ssl: [TLSWrap], _requestCert: true, _rejectUnauthorized: false, parser: null, _httpMessage: [ClientRequest], [Symbol(res)]: [TLSWrap], [Symbol(asyncId)]: 9, [Symbol(lastWriteQueueSize)]: 0, [Symbol(timeout)]: null, [Symbol(kBytesRead)]: 0, [Symbol(kBytesWritten)]: 0, [Symbol(connect-options)]: [Object] }, connection: TLSSocket { _tlsOptions: [Object], _secureEstablished: true, _securePending: false, _newSessionPending: false, _controlReleased: true, _SNICallback: null, servername: 'www.ahc.sa.gov.au', alpnProtocol: false, authorized: false, authorizationError: 'SELF_SIGNED_CERT_IN_CHAIN', encrypted: true, _events: [Object], _eventsCount: 8, connecting: false, _hadError: false, _handle: [TLSWrap], _parent: null, _host: 'www.ahc.sa.gov.au', _readableState: [ReadableState], readable: true, _maxListeners: undefined, _writableState: [WritableState], writable: false, allowHalfOpen: false, _sockname: null, _pendingData: null, _pendingEncoding: '', server: undefined, _server: null, ssl: [TLSWrap], _requestCert: true, _rejectUnauthorized: false, parser: null, _httpMessage: [ClientRequest], [Symbol(res)]: [TLSWrap], [Symbol(asyncId)]: 9, [Symbol(lastWriteQueueSize)]: 0, [Symbol(timeout)]: null, [Symbol(kBytesRead)]: 0, [Symbol(kBytesWritten)]: 0, [Symbol(connect-options)]: [Object] }, httpVersionMajor: 1, httpVersionMinor: 1, httpVersion: '1.1', complete: true, headers: { 'cache-control': 'private,max-age=0', 'content-length': '746', 'content-type': 'text/html', expires: 'Thu, 04 Apr 2019 10:18:38 GMT', server: 'Microsoft-IIS/8.0', 'x-sharepointhealthscore': '1', 'public-extension': 'http://schemas.microsoft.com/repl-2', sprequestguid: '7c74d49e-4d5a-0074-688e-5c299a3f5c36', 'request-id': '7c74d49e-4d5a-0074-688e-5c299a3f5c36', 'x-frame-options': 'SAMEORIGIN', sprequestduration: '20', spiislatency: '0', 'x-powered-by': 'ASP.NET', microsoftsharepointteamservices: '15.0.0.4945', 'x-content-type-options': 'nosniff', 'x-ms-invokeapp': '1; RequireReadOnly', date: 'Fri, 19 Apr 2019 10:18:38 GMT', connection: 'close' }, rawHeaders: [ 'Cache-Control', 'private,max-age=0', 'Content-Length', '746', 'Content-Type', 'text/html', 'Expires', 'Thu, 04 Apr 2019 10:18:38 GMT', 'Server', 'Microsoft-IIS/8.0', 'X-SharePointHealthScore', '1', 'Public-Extension', 'http://schemas.microsoft.com/repl-2', 'SPRequestGuid', '7c74d49e-4d5a-0074-688e-5c299a3f5c36', 'request-id', '7c74d49e-4d5a-0074-688e-5c299a3f5c36', 'X-FRAME-OPTIONS', 'SAMEORIGIN', 'SPRequestDuration', '20', 'SPIisLatency', '0', 'X-Powered-By', 'ASP.NET', 'MicrosoftSharePointTeamServices', '15.0.0.4945', 'X-Content-Type-Options', 'nosniff', 'X-MS-InvokeApp', '1; RequireReadOnly', 'Date', 'Fri, 19 Apr 2019 10:18:38 GMT', 'Connection', 'close' ], trailers: {}, rawTrailers: [], aborted: false, upgrade: false, url: '', method: null, statusCode: 404, statusMessage: 'NOT FOUND', client: TLSSocket { _tlsOptions: [Object], _secureEstablished: true, _securePending: false, _newSessionPending: false, _controlReleased: true, _SNICallback: null, servername: 'www.ahc.sa.gov.au', alpnProtocol: false, authorized: false, authorizationError: 'SELF_SIGNED_CERT_IN_CHAIN', encrypted: true, _events: [Object], _eventsCount: 8, connecting: false, _hadError: false, _handle: [TLSWrap], _parent: null, _host: 'www.ahc.sa.gov.au', _readableState: [ReadableState], readable: true, _maxListeners: undefined, _writableState: [WritableState], writable: false, allowHalfOpen: false, _sockname: null, _pendingData: null, _pendingEncoding: '', server: undefined, _server: null, ssl: [TLSWrap], _requestCert: true, _rejectUnauthorized: false, parser: null, _httpMessage: [ClientRequest], [Symbol(res)]: [TLSWrap], [Symbol(asyncId)]: 9, [Symbol(lastWriteQueueSize)]: 0, [Symbol(timeout)]: null, [Symbol(kBytesRead)]: 0, [Symbol(kBytesWritten)]: 0, [Symbol(connect-options)]: [Object] }, _consuming: true, _dumped: false, req: ClientRequest { _events: [Object], _eventsCount: 5, _maxListeners: undefined, output: [], outputEncodings: [], outputCallbacks: [], outputSize: 0, writable: true, _last: true, chunkedEncoding: false, shouldKeepAlive: false, useChunkedEncodingByDefault: false, sendDate: false, _removedConnection: false, _removedContLen: false, _removedTE: false, _contentLength: 0, _hasBody: true, _trailer: '', finished: true, _headerSent: true, socket: [TLSSocket], connection: [TLSSocket], _header: 'GET /Resident/planning-and-building/development-applications/development-applications-register HTTP/1.1\r\nhost: www.ahc.sa.gov.au\r\nConnection: close\r\n\r\n', _onPendingData: [Function: noopPendingOutput], agent: [Agent], socketPath: undefined, timeout: undefined, method: 'GET', path: '/Resident/planning-and-building/development-applications/development-applications-register', _ended: true, res: [Circular], aborted: undefined, timeoutCb: null, upgradeOrConnect: false, parser: null, maxHeadersCount: null, [Symbol(isCorked)]: false, [Symbol(outHeadersKey)]: [Object] }, request: Request { _events: [Object], _eventsCount: 5, _maxListeners: undefined, uri: [Url], readable: true, writable: true, _qs: [Querystring], _auth: [Auth], _oauth: [OAuth], _multipart: [Multipart], _redirect: [Redirect], _tunnel: [Tunnel], _rp_resolve: [Function], _rp_reject: [Function], _rp_promise: [Promise], _rp_callbackOrig: undefined, callback: [Function], _rp_options: [Object], headers: {}, setHeader: [Function], hasHeader: [Function], getHeader: [Function], removeHeader: [Function], method: 'GET', localAddress: undefined, pool: {}, dests: [], __isRequestRequest: true, _callback: [Function: RP$callback], proxy: null, tunnel: true, setHost: true, originalCookieHeader: undefined, _disableCookies: true, _jar: undefined, port: 443, host: 'www.ahc.sa.gov.au', path: '/Resident/planning-and-building/development-applications/development-applications-register', httpModule: [Object], agentClass: [Function], agent: [Agent], _started: true, href: 'https://www.ahc.sa.gov.au/Resident/planning-and-building/development-applications/development-applications-register', req: [ClientRequest], ntick: true, response: [Circular], originalHost: 'www.ahc.sa.gov.au', originalHostHeaderName: 'host', responseContent: [Circular], _destdata: true, _ended: true, _callbackCalled: true }, toJSON: [Function: responseToJSON], caseless: Caseless { dict: [Object] }, body: '<html>\n<head>\n<meta http-equiv="Content-Type" content="text/html;charset=utf-8" /><meta name="SharePointError" content=""/>\n<meta name="Description" content=""/>\n<meta name="Keywords" content=""/>\n<meta name="Robots" content="NOINDEX"/>\n<script type="text/javascript">\n<!--\nwindow.location.replace("https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fPages\\u002fPageNotFoundError.aspx?requestUrl=https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fResident\\u002fplanning-and-building\\u002fdevelopment-applications\\u002fdevelopment-applications-register")\n-->\n</script>\n</head>\n<body>\n<!------------------------------------------------------------------------->\nFile Not Found\n<!------------------------------------------------------------------------->\n</body>\n</html>' } }

Data

Downloaded 250 times by openaustralia jesse-a-reilly Jedwards157 MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (480 KB) Use the API

rows 10 / 1624

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
18/640 Application
PO BOX 153, ST AGNES, SA 5097
Verandah
mailto:mail@ahc.sa.gov.au
2018-08-09
2018-08-08
17/690
18 Cranes Road, Birdwood SA 5234
Change of use to include horticulture- market garden (5.5 hectares), including change of use of existing farm building to associated agricultural industry (processing of produce)
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-10
17/669
47 Glen Stuart Road, Woodforde SA 5072
Split level detached dwelling and associated earthworks
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-10
17/703
7 Cromer Road, Birdwood SA 5234
Dwelling, including retaining wall (maximum height 700mm) & associated earthworks
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-10
17/700
146 Downers Road, Oakbank SA 5243
Carport
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-10
17/705
28 Henry Street, Woodside SA 5244
Fire hydrant
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-11
17/674
150 Pfeiffer Road, Woodside SA 5244
Winery and horticultural building (tractor storage, barrel storage for wine maturation and office) in association with existing mixed use development (vineyards, winery, cellar door, restaurant and function facility) associated retaining walls (2m maximum height) and earthworks
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-11
17/691
2/37 Onkaparinga Valley Road, Balhannah SA 5242
Change of use from service trade premises to include light industry (micro-brewery) & associated shop (tasting area) within Tenancy 2E (Building 10), including outdoor seating area
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-11
17/701
2 Thomas Street, Mount Torrens SA 5244
Verandah addition to dwelling
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-11
17/699
85A Main Street, Lobethal SA 5241
Change in use from activity centre to dwelling including building alterations
mailto:mail@ahc.sa.gov.au
2018-08-21
2017-08-14

Statistics

Average successful run time: less than a minute

Total run time: about 4 hours

Total cpu time used: 25 minutes

Total disk space used: 553 KB

History

  • Auto ran revision 72ebbe55 and completed successfully .
    nothing changed in the database
  • Auto ran revision 72ebbe55 and completed successfully .
    nothing changed in the database
  • Auto ran revision 72ebbe55 and completed successfully .
    nothing changed in the database
  • Auto ran revision 72ebbe55 and completed successfully .
    nothing changed in the database
  • Auto ran revision 72ebbe55 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history