planningalerts-scrapers / adelaide_hills_council_sa_development_applications
Adelaide Hills Council (South Australia) Development Applications
This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Adelaide Hills Council web site.
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Node.js app detected
[1G
[1G-----> Creating runtime environment
[1G
[1G NPM_CONFIG_LOGLEVEL=error
[1G NPM_CONFIG_PRODUCTION=true
[1G NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt
[1G NODE_VERBOSE=false
[1G NODE_ENV=production
[1G NODE_TLS_REJECT_UNAUTHORIZED=0
[1G NODE_MODULES_CACHE=true
[1G
[1G-----> Installing binaries
[1G engines.node (package.json): 10.6.0
[1G engines.npm (package.json): unspecified (use default)
[1G
[1G Resolving node version 10.6.0...
[1G Downloading and installing node 10.6.0...
[1G Using default npm version: 6.1.0
[1G
[1G-----> Restoring cache
[1G Skipping cache restore (not-found)
[1G
[1G-----> Building dependencies
[1G Installing node modules (package.json)
[1G
[1G > sqlite3@4.0.1 install /tmp/build/node_modules/sqlite3
[1G > node-pre-gyp install --fallback-to-build
[1G
[1G [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote
[1G added 151 packages from 120 contributors and audited 219 packages in 10.191s
[1G found 4 vulnerabilities (2 low, 2 moderate)
[1G run `npm audit fix` to fix them, or `npm audit` for details
[1G
[1G-----> Caching build
[1G Clearing previous node cache
[1G Saving 2 cacheDirectories (default):
[1G - node_modules
[1G - bower_components (nothing to cache)
[1G
[1G-----> Build succeeded!
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Retrieving page: https://www.ahc.sa.gov.au/Resident/planning-and-building/development-applications/development-applications-register
{ StatusCodeError: 404 - "<html>\n<head>\n<meta http-equiv=\"Content-Type\" content=\"text/html;charset=utf-8\" /><meta name=\"SharePointError\" content=\"\"/>\n<meta name=\"Description\" content=\"\"/>\n<meta name=\"Keywords\" content=\"\"/>\n<meta name=\"Robots\" content=\"NOINDEX\"/>\n<script type=\"text/javascript\">\n<!--\nwindow.location.replace(\"https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fPages\\u002fPageNotFoundError.aspx?requestUrl=https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fResident\\u002fplanning-and-building\\u002fdevelopment-applications\\u002fdevelopment-applications-register\")\n-->\n</script>\n</head>\n<body>\n<!------------------------------------------------------------------------->\nFile Not Found\n<!------------------------------------------------------------------------->\n</body>\n</html>"
at new StatusCodeError (/app/node_modules/request-promise-core/lib/errors.js:32:15)
at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:104:33)
at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31)
at Request.self.callback (/app/node_modules/request/request.js:185:22)
at Request.emit (events.js:182:13)
at Request.<anonymous> (/app/node_modules/request/request.js:1157:10)
at Request.emit (events.js:182:13)
at IncomingMessage.<anonymous> (/app/node_modules/request/request.js:1079:12)
at Object.onceWrapper (events.js:273:13)
at IncomingMessage.emit (events.js:187:15)
name: 'StatusCodeError',
statusCode: 404,
message:
'404 - "<html>\\n<head>\\n<meta http-equiv=\\"Content-Type\\" content=\\"text/html;charset=utf-8\\" /><meta name=\\"SharePointError\\" content=\\"\\"/>\\n<meta name=\\"Description\\" content=\\"\\"/>\\n<meta name=\\"Keywords\\" content=\\"\\"/>\\n<meta name=\\"Robots\\" content=\\"NOINDEX\\"/>\\n<script type=\\"text/javascript\\">\\n<!--\\nwindow.location.replace(\\"https:\\\\u002f\\\\u002fwww.ahc.sa.gov.au\\\\u002fPages\\\\u002fPageNotFoundError.aspx?requestUrl=https:\\\\u002f\\\\u002fwww.ahc.sa.gov.au\\\\u002fResident\\\\u002fplanning-and-building\\\\u002fdevelopment-applications\\\\u002fdevelopment-applications-register\\")\\n-->\\n</script>\\n</head>\\n<body>\\n<!------------------------------------------------------------------------->\\nFile Not Found\\n<!------------------------------------------------------------------------->\\n</body>\\n</html>"',
error:
'<html>\n<head>\n<meta http-equiv="Content-Type" content="text/html;charset=utf-8" /><meta name="SharePointError" content=""/>\n<meta name="Description" content=""/>\n<meta name="Keywords" content=""/>\n<meta name="Robots" content="NOINDEX"/>\n<script type="text/javascript">\n<!--\nwindow.location.replace("https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fPages\\u002fPageNotFoundError.aspx?requestUrl=https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fResident\\u002fplanning-and-building\\u002fdevelopment-applications\\u002fdevelopment-applications-register")\n-->\n</script>\n</head>\n<body>\n<!------------------------------------------------------------------------->\nFile Not Found\n<!------------------------------------------------------------------------->\n</body>\n</html>',
options:
{ uri:
'https://www.ahc.sa.gov.au/Resident/planning-and-building/development-applications/development-applications-register',
callback: [Function: RP$callback],
transform: undefined,
simple: true,
resolveWithFullResponse: false,
transform2xxOnly: false },
response:
IncomingMessage {
_readableState:
ReadableState {
objectMode: false,
highWaterMark: 16384,
buffer: BufferList { length: 0 },
length: 0,
pipes: null,
pipesCount: 0,
flowing: true,
ended: true,
endEmitted: true,
reading: false,
sync: false,
needReadable: false,
emittedReadable: false,
readableListening: false,
resumeScheduled: false,
emitClose: true,
destroyed: false,
defaultEncoding: 'utf8',
awaitDrain: 0,
readingMore: false,
decoder: null,
encoding: null },
readable: false,
_events:
{ end: [Array],
close: [Array],
data: [Function],
error: [Function] },
_eventsCount: 4,
_maxListeners: undefined,
socket:
TLSSocket {
_tlsOptions: [Object],
_secureEstablished: true,
_securePending: false,
_newSessionPending: false,
_controlReleased: true,
_SNICallback: null,
servername: 'www.ahc.sa.gov.au',
alpnProtocol: false,
authorized: false,
authorizationError: 'SELF_SIGNED_CERT_IN_CHAIN',
encrypted: true,
_events: [Object],
_eventsCount: 8,
connecting: false,
_hadError: false,
_handle: [TLSWrap],
_parent: null,
_host: 'www.ahc.sa.gov.au',
_readableState: [ReadableState],
readable: true,
_maxListeners: undefined,
_writableState: [WritableState],
writable: false,
allowHalfOpen: false,
_sockname: null,
_pendingData: null,
_pendingEncoding: '',
server: undefined,
_server: null,
ssl: [TLSWrap],
_requestCert: true,
_rejectUnauthorized: false,
parser: null,
_httpMessage: [ClientRequest],
[Symbol(res)]: [TLSWrap],
[Symbol(asyncId)]: 9,
[Symbol(lastWriteQueueSize)]: 0,
[Symbol(timeout)]: null,
[Symbol(kBytesRead)]: 0,
[Symbol(kBytesWritten)]: 0,
[Symbol(connect-options)]: [Object] },
connection:
TLSSocket {
_tlsOptions: [Object],
_secureEstablished: true,
_securePending: false,
_newSessionPending: false,
_controlReleased: true,
_SNICallback: null,
servername: 'www.ahc.sa.gov.au',
alpnProtocol: false,
authorized: false,
authorizationError: 'SELF_SIGNED_CERT_IN_CHAIN',
encrypted: true,
_events: [Object],
_eventsCount: 8,
connecting: false,
_hadError: false,
_handle: [TLSWrap],
_parent: null,
_host: 'www.ahc.sa.gov.au',
_readableState: [ReadableState],
readable: true,
_maxListeners: undefined,
_writableState: [WritableState],
writable: false,
allowHalfOpen: false,
_sockname: null,
_pendingData: null,
_pendingEncoding: '',
server: undefined,
_server: null,
ssl: [TLSWrap],
_requestCert: true,
_rejectUnauthorized: false,
parser: null,
_httpMessage: [ClientRequest],
[Symbol(res)]: [TLSWrap],
[Symbol(asyncId)]: 9,
[Symbol(lastWriteQueueSize)]: 0,
[Symbol(timeout)]: null,
[Symbol(kBytesRead)]: 0,
[Symbol(kBytesWritten)]: 0,
[Symbol(connect-options)]: [Object] },
httpVersionMajor: 1,
httpVersionMinor: 1,
httpVersion: '1.1',
complete: true,
headers:
{ 'cache-control': 'private,max-age=0',
'content-length': '746',
'content-type': 'text/html',
expires: 'Thu, 04 Apr 2019 10:18:38 GMT',
server: 'Microsoft-IIS/8.0',
'x-sharepointhealthscore': '1',
'public-extension': 'http://schemas.microsoft.com/repl-2',
sprequestguid: '7c74d49e-4d5a-0074-688e-5c299a3f5c36',
'request-id': '7c74d49e-4d5a-0074-688e-5c299a3f5c36',
'x-frame-options': 'SAMEORIGIN',
sprequestduration: '20',
spiislatency: '0',
'x-powered-by': 'ASP.NET',
microsoftsharepointteamservices: '15.0.0.4945',
'x-content-type-options': 'nosniff',
'x-ms-invokeapp': '1; RequireReadOnly',
date: 'Fri, 19 Apr 2019 10:18:38 GMT',
connection: 'close' },
rawHeaders:
[ 'Cache-Control',
'private,max-age=0',
'Content-Length',
'746',
'Content-Type',
'text/html',
'Expires',
'Thu, 04 Apr 2019 10:18:38 GMT',
'Server',
'Microsoft-IIS/8.0',
'X-SharePointHealthScore',
'1',
'Public-Extension',
'http://schemas.microsoft.com/repl-2',
'SPRequestGuid',
'7c74d49e-4d5a-0074-688e-5c299a3f5c36',
'request-id',
'7c74d49e-4d5a-0074-688e-5c299a3f5c36',
'X-FRAME-OPTIONS',
'SAMEORIGIN',
'SPRequestDuration',
'20',
'SPIisLatency',
'0',
'X-Powered-By',
'ASP.NET',
'MicrosoftSharePointTeamServices',
'15.0.0.4945',
'X-Content-Type-Options',
'nosniff',
'X-MS-InvokeApp',
'1; RequireReadOnly',
'Date',
'Fri, 19 Apr 2019 10:18:38 GMT',
'Connection',
'close' ],
trailers: {},
rawTrailers: [],
aborted: false,
upgrade: false,
url: '',
method: null,
statusCode: 404,
statusMessage: 'NOT FOUND',
client:
TLSSocket {
_tlsOptions: [Object],
_secureEstablished: true,
_securePending: false,
_newSessionPending: false,
_controlReleased: true,
_SNICallback: null,
servername: 'www.ahc.sa.gov.au',
alpnProtocol: false,
authorized: false,
authorizationError: 'SELF_SIGNED_CERT_IN_CHAIN',
encrypted: true,
_events: [Object],
_eventsCount: 8,
connecting: false,
_hadError: false,
_handle: [TLSWrap],
_parent: null,
_host: 'www.ahc.sa.gov.au',
_readableState: [ReadableState],
readable: true,
_maxListeners: undefined,
_writableState: [WritableState],
writable: false,
allowHalfOpen: false,
_sockname: null,
_pendingData: null,
_pendingEncoding: '',
server: undefined,
_server: null,
ssl: [TLSWrap],
_requestCert: true,
_rejectUnauthorized: false,
parser: null,
_httpMessage: [ClientRequest],
[Symbol(res)]: [TLSWrap],
[Symbol(asyncId)]: 9,
[Symbol(lastWriteQueueSize)]: 0,
[Symbol(timeout)]: null,
[Symbol(kBytesRead)]: 0,
[Symbol(kBytesWritten)]: 0,
[Symbol(connect-options)]: [Object] },
_consuming: true,
_dumped: false,
req:
ClientRequest {
_events: [Object],
_eventsCount: 5,
_maxListeners: undefined,
output: [],
outputEncodings: [],
outputCallbacks: [],
outputSize: 0,
writable: true,
_last: true,
chunkedEncoding: false,
shouldKeepAlive: false,
useChunkedEncodingByDefault: false,
sendDate: false,
_removedConnection: false,
_removedContLen: false,
_removedTE: false,
_contentLength: 0,
_hasBody: true,
_trailer: '',
finished: true,
_headerSent: true,
socket: [TLSSocket],
connection: [TLSSocket],
_header:
'GET /Resident/planning-and-building/development-applications/development-applications-register HTTP/1.1\r\nhost: www.ahc.sa.gov.au\r\nConnection: close\r\n\r\n',
_onPendingData: [Function: noopPendingOutput],
agent: [Agent],
socketPath: undefined,
timeout: undefined,
method: 'GET',
path:
'/Resident/planning-and-building/development-applications/development-applications-register',
_ended: true,
res: [Circular],
aborted: undefined,
timeoutCb: null,
upgradeOrConnect: false,
parser: null,
maxHeadersCount: null,
[Symbol(isCorked)]: false,
[Symbol(outHeadersKey)]: [Object] },
request:
Request {
_events: [Object],
_eventsCount: 5,
_maxListeners: undefined,
uri: [Url],
readable: true,
writable: true,
_qs: [Querystring],
_auth: [Auth],
_oauth: [OAuth],
_multipart: [Multipart],
_redirect: [Redirect],
_tunnel: [Tunnel],
_rp_resolve: [Function],
_rp_reject: [Function],
_rp_promise: [Promise],
_rp_callbackOrig: undefined,
callback: [Function],
_rp_options: [Object],
headers: {},
setHeader: [Function],
hasHeader: [Function],
getHeader: [Function],
removeHeader: [Function],
method: 'GET',
localAddress: undefined,
pool: {},
dests: [],
__isRequestRequest: true,
_callback: [Function: RP$callback],
proxy: null,
tunnel: true,
setHost: true,
originalCookieHeader: undefined,
_disableCookies: true,
_jar: undefined,
port: 443,
host: 'www.ahc.sa.gov.au',
path:
'/Resident/planning-and-building/development-applications/development-applications-register',
httpModule: [Object],
agentClass: [Function],
agent: [Agent],
_started: true,
href:
'https://www.ahc.sa.gov.au/Resident/planning-and-building/development-applications/development-applications-register',
req: [ClientRequest],
ntick: true,
response: [Circular],
originalHost: 'www.ahc.sa.gov.au',
originalHostHeaderName: 'host',
responseContent: [Circular],
_destdata: true,
_ended: true,
_callbackCalled: true },
toJSON: [Function: responseToJSON],
caseless: Caseless { dict: [Object] },
body:
'<html>\n<head>\n<meta http-equiv="Content-Type" content="text/html;charset=utf-8" /><meta name="SharePointError" content=""/>\n<meta name="Description" content=""/>\n<meta name="Keywords" content=""/>\n<meta name="Robots" content="NOINDEX"/>\n<script type="text/javascript">\n<!--\nwindow.location.replace("https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fPages\\u002fPageNotFoundError.aspx?requestUrl=https:\\u002f\\u002fwww.ahc.sa.gov.au\\u002fResident\\u002fplanning-and-building\\u002fdevelopment-applications\\u002fdevelopment-applications-register")\n-->\n</script>\n</head>\n<body>\n<!------------------------------------------------------------------------->\nFile Not Found\n<!------------------------------------------------------------------------->\n</body>\n</html>' } }
Data
Downloaded
250 times
by
To download data sign in with GitHub
rows 10 / 1624
| council_reference | address | description | info_url | comment_url | date_scraped | date_received | on_notice_from | on_notice_to |
|---|---|---|---|---|---|---|---|---|
|
18/640
Application
|
PO BOX 153, ST
AGNES, SA 5097
|
Verandah
|
mailto:mail@ahc.sa.gov.au
|
2018-08-09
|
2018-08-08
|
|
|
|
|
17/690
|
18 Cranes Road, Birdwood SA 5234
|
Change of use to include horticulture- market garden (5.5 hectares), including change of use of existing farm building to associated agricultural industry (processing of produce)
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-10
|
|
|
|
|
17/669
|
47 Glen Stuart Road, Woodforde SA 5072
|
Split level detached dwelling and associated earthworks
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-10
|
|
|
|
|
17/703
|
7 Cromer Road, Birdwood SA 5234
|
Dwelling, including retaining wall (maximum height 700mm) & associated earthworks
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-10
|
|
|
|
|
17/700
|
146 Downers Road, Oakbank SA 5243
|
Carport
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-10
|
|
|
|
|
17/705
|
28 Henry Street, Woodside SA 5244
|
Fire hydrant
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-11
|
|
|
|
|
17/674
|
150 Pfeiffer Road, Woodside SA 5244
|
Winery and horticultural building (tractor storage, barrel storage for wine maturation and office) in association with existing mixed use development (vineyards, winery, cellar door, restaurant and function facility) associated retaining walls (2m maximum height) and earthworks
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-11
|
|
|
|
|
17/691
|
2/37 Onkaparinga Valley Road, Balhannah SA 5242
|
Change of use from service trade premises to include light industry (micro-brewery) & associated shop (tasting area) within Tenancy 2E (Building 10), including outdoor seating area
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-11
|
|
|
|
|
17/701
|
2 Thomas Street, Mount Torrens SA 5244
|
Verandah addition to dwelling
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-11
|
|
|
|
|
17/699
|
85A Main Street, Lobethal SA 5241
|
Change in use from activity centre to dwelling including building alterations
|
mailto:mail@ahc.sa.gov.au
|
2018-08-21
|
2017-08-14
|
|
|
Statistics
Average successful run time: less than a minute
Total run time: about 4 hours
Total cpu time used: 25 minutes
Total disk space used: 553 KB
History
-
Auto
ran
revision
72ebbe55
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
72ebbe55
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
72ebbe55
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
72ebbe55
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
72ebbe55
and
completed successfully
.
nothing changed in the database
- ...
- Created on morph.io