planningalerts-scrapers / campbelltown_city_council_sa_development_applications

Campbelltown City Council (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Campbelltown City Council web site.

Contributors MichaelBone jamezpolley

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): unspecified  engines.npm (package.json): unspecified (use default)   Resolving node version 6.x...  Downloading and installing node 6.16.0...  Using default npm version: 3.10.10  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.6 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v48-linux-x64/node_sqlite3.node" is installed via remote  @1.0.1 /tmp/build  +-- cheerio@0.22.0  | +-- css-select@1.2.0  | | +-- boolbase@1.0.0  | | +-- css-what@2.1.3  | | +-- domutils@1.5.1  | | `-- nth-check@1.0.2  | +-- dom-serializer@0.1.1  | | `-- domelementtype@1.3.1  | +-- entities@1.1.2  | +-- htmlparser2@3.10.1  | | +-- domhandler@2.4.2  | | +-- inherits@2.0.3  | | `-- readable-stream@3.1.1  | | +-- string_decoder@1.2.0  | | `-- util-deprecate@1.0.2  | +-- lodash.assignin@4.2.0  | +-- lodash.bind@4.2.1  | +-- lodash.defaults@4.2.0  | +-- lodash.filter@4.6.0  | +-- lodash.flatten@4.4.0  | +-- lodash.foreach@4.5.0  | +-- lodash.map@4.6.0  | +-- lodash.merge@4.6.1  | +-- lodash.pick@4.4.0  | +-- lodash.reduce@4.6.0  | +-- lodash.reject@4.6.0  | `-- lodash.some@4.6.0  +-- moment@2.24.0  +-- pdf2json@1.1.8  | +-- async@2.0.1  | +-- lodash@4.15.0  | +-- optimist@0.6.1  | | +-- minimist@0.0.10  | | `-- wordwrap@0.0.3  | `-- xmldom@0.1.22  +-- request@2.88.0  | +-- aws-sign2@0.7.0  | +-- aws4@1.8.0  | +-- caseless@0.12.0  | +-- combined-stream@1.0.7  | | `-- delayed-stream@1.0.0  | +-- extend@3.0.2  | +-- forever-agent@0.6.1  | +-- form-data@2.3.3  | | `-- asynckit@0.4.0  | +-- har-validator@5.1.3  | | +-- ajv@6.9.1  | | | +-- fast-deep-equal@2.0.1  | | | +-- fast-json-stable-stringify@2.0.0  | | | +-- json-schema-traverse@0.4.1  | | | `-- uri-js@4.2.2  | | | `-- punycode@2.1.1  | | `-- har-schema@2.0.0  | +-- http-signature@1.2.0  | | +-- assert-plus@1.0.0  | | +-- jsprim@1.4.1  | | | +-- extsprintf@1.3.0  | | | +-- json-schema@0.2.3  | | | `-- verror@1.10.0  | | | `-- core-util-is@1.0.2  | | `-- sshpk@1.16.1  | | +-- asn1@0.2.4  | | +-- bcrypt-pbkdf@1.0.2  | | +-- dashdash@1.14.1  | | +-- ecc-jsbn@0.1.2  | | +-- getpass@0.1.7  | | +-- jsbn@0.1.1  | | +-- safer-buffer@2.1.2  | | `-- tweetnacl@0.14.5  | +-- is-typedarray@1.0.0  | +-- isstream@0.1.2  | +-- json-stringify-safe@5.0.1  | +-- mime-types@2.1.22  | | `-- mime-db@1.38.0  | +-- oauth-sign@0.9.0  | +-- performance-now@2.1.0  | +-- qs@6.5.2  | +-- safe-buffer@5.1.2  | +-- tough-cookie@2.4.3  | | +-- psl@1.1.31  | | `-- punycode@1.4.1  | +-- tunnel-agent@0.6.0  | `-- uuid@3.3.2  +-- sqlite3@4.0.6  | +-- nan@2.10.0  | `-- node-pre-gyp@0.11.0  | +-- detect-libc@1.0.3  | +-- mkdirp@0.5.1  | | `-- minimist@0.0.8  | +-- needle@2.2.4  | | +-- debug@2.6.9  | | | `-- ms@2.0.0  | | +-- iconv-lite@0.4.24  | | `-- sax@1.2.4  | +-- nopt@4.0.1  | | +-- abbrev@1.1.1  | | `-- osenv@0.1.5  | | +-- os-homedir@1.0.2  | | `-- os-tmpdir@1.0.2  | +-- npm-packlist@1.3.0  | | +-- ignore-walk@3.0.1  | | | `-- minimatch@3.0.4  | | | `-- brace-expansion@1.1.11  | | | +-- balanced-match@1.0.0  | | | `-- concat-map@0.0.1  | | `-- npm-bundled@1.0.6  | +-- npmlog@4.1.2  | | +-- are-we-there-yet@1.1.5  | | | +-- delegates@1.0.0  | | | `-- readable-stream@2.3.6  | | | +-- isarray@1.0.0  | | | +-- process-nextick-args@2.0.0  | | | `-- string_decoder@1.1.1  | | +-- console-control-strings@1.1.0  | | +-- gauge@2.7.4  | | | +-- aproba@1.2.0  | | | +-- has-unicode@2.0.1  | | | +-- object-assign@4.1.1  | | | +-- signal-exit@3.0.2  | | | +-- string-width@1.0.2  | | | | +-- code-point-at@1.1.0  | | | | `-- is-fullwidth-code-point@1.0.0  | | | | `-- number-is-nan@1.0.1  | | | +-- strip-ansi@3.0.1  | | | | `-- ansi-regex@2.1.1  | | | `-- wide-align@1.1.3  | | `-- set-blocking@2.0.0  | +-- rc@1.2.8  | | +-- deep-extend@0.6.0  | | +-- ini@1.3.5  | | +-- minimist@1.2.0  | | `-- strip-json-comments@2.0.1  | +-- rimraf@2.6.3  | | `-- glob@7.1.3  | | +-- fs.realpath@1.0.0  | | +-- inflight@1.0.6  | | | `-- wrappy@1.0.2  | | +-- once@1.4.0  | | `-- path-is-absolute@1.0.1  | +-- semver@5.6.0  | `-- tar@4.4.8  | +-- chownr@1.1.1  | +-- fs-minipass@1.2.5  | +-- minipass@2.3.5  | +-- minizlib@1.2.1  | `-- yallist@3.0.3  `-- url@0.11.0  +-- punycode@1.3.2  `-- querystring@0.2.0   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Requesting page: http://www.campbelltown.sa.gov.au/page.aspx?u=1973 Found 13 PDF file(s) to download and parse at http://www.campbelltown.sa.gov.au/page.aspx?u=1973. Selecting two to parse. internal/streams/legacy.js:59 throw er; // Unhandled stream error in pipe. ^ Error: read ECONNRESET at exports._errnoException (util.js:1020:11) at TCP.onread (net.js:580:26)

Data

Downloaded 227 times by openaustralia MichaelBone Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (568 KB) Use the API

rows 10 / 1625

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
170/0001/18
25 Moorlands Road HECTORVILLE SA 5073MARDEN SA 5070
To divide land into 5 Torrens Title allotments
2018-06-26
2018-01-02
170/0006/18
2 Manresa Court ATHELSTONE SA 5076
To erect additional entry & basement addition
2018-06-26
2018-01-03
170/0007/18
32 Avenue Road PARADISE SA 5075
To demolish the existing dwelling
2018-06-26
2018-01-03
170/0008/18
2A Hudson Avenue ROSTREVOR SA 5073
To erect a detached single storey dwelling
2018-06-26
2018-01-03
170/0009/18
35A Arthur Street TRANMERE SA 5073
To erect a retaining wall and fence
2018-06-26
2018-01-03
170/0010/18
10 Leabrook Drive ROSTREVOR SA 5073
To erect a domestic outbuilding (Shed)
2018-06-26
2018-01-03
170/0011/18
4 Woodmere Avenue PARADISE SA 5075
To demolish the existing dwelling
2018-06-26
2018-01-28
170/0003/18
512 Lower North East Road CAMPBELLTOWN SA 5074
To construct Six, Two Storey Row Dwellings and a Three Storey Office Building with Under Croft Car Park comprising Eight Tenancies with associated Car Parking and
2018-06-26
2018-01-02
170/0013/18
19 Gameau Road PARADISE SA 5075
To demolish the existing dwelling
2018-06-26
2018-01-04
170/0014/18
17B Gameau Road PARADISE SA 5075
To demolish the existing dwelling
2018-06-26
2018-01-04

Statistics

Average successful run time: 1 minute

Total run time: 4 days

Total cpu time used: 23 minutes

Total disk space used: 676 KB

History

  • Auto ran revision 7f15eceb and failed .
    nothing changed in the database
  • Auto ran revision 7f15eceb and completed successfully .
    nothing changed in the database
  • Auto ran revision 7f15eceb and completed successfully .
    nothing changed in the database
  • Auto ran revision 7f15eceb and completed successfully .
    nothing changed in the database
  • Auto ran revision 7f15eceb and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history