planningalerts-scrapers / coorong_district_council_sa_development_applications

Coorong District Council (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Coorong District Council web site.

Contributors MichaelBone

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.14.1  engines.npm (package.json): unspecified (use default)   Resolving node version 10.14.1...  Downloading and installing node 10.14.1...  Using default npm version: 6.4.1  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.6 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 475 packages from 341 contributors and audited 4497 packages in 21.157s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.coorong.sa.gov.au/page.aspx?u=2084&year=2020 Found 12 PDF file(s). Selecting two to parse. Parsing document: undefined Reading development applications from undefined. { RequestError: Error: options.uri is a required argument at new RequestError (/app/node_modules/request-promise-core/lib/errors.js:14:15) at Request.plumbing.callback (/app/node_modules/request-promise-core/lib/plumbing.js:87:29) at Request.RP$callback [as _callback] (/app/node_modules/request-promise-core/lib/plumbing.js:46:31) at self.callback (/app/node_modules/request/request.js:185:22) at Request.emit (events.js:182:13) at Request.init (/app/node_modules/request/request.js:231:17) at Request.RP$initInterceptor [as init] (/app/node_modules/request-promise-core/configure/request2.js:45:29) at new Request (/app/node_modules/request/request.js:127:8) at request (/app/node_modules/request/index.js:53:10) at parsePdf (/app/scraper.js:280:24) name: 'RequestError', message: 'Error: options.uri is a required argument', cause: Error: options.uri is a required argument at Request.init (/app/node_modules/request/request.js:231:31) at Request.RP$initInterceptor [as init] (/app/node_modules/request-promise-core/configure/request2.js:45:29) at new Request (/app/node_modules/request/request.js:127:8) at request (/app/node_modules/request/index.js:53:10) at parsePdf (/app/scraper.js:280:24) at main (/app/scraper.js:396:45), error: Error: options.uri is a required argument at Request.init (/app/node_modules/request/request.js:231:31) at Request.RP$initInterceptor [as init] (/app/node_modules/request-promise-core/configure/request2.js:45:29) at new Request (/app/node_modules/request/request.js:127:8) at request (/app/node_modules/request/index.js:53:10) at parsePdf (/app/scraper.js:280:24) at main (/app/scraper.js:396:45), options: { encoding: null, callback: [Function: RP$callback], transform: undefined, simple: true, resolveWithFullResponse: false, transform2xxOnly: false }, response: undefined }

Data

Downloaded 256 times by openaustralia jesse-a-reilly MichaelBone Talie

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (604 KB) Use the API

rows 10 / 1199

council_reference address description info_url comment_url date_scraped date_received legal_description
571-077-12
215 ATTRILL ROAD, TAILEM BEND SA 5260
Lean-to Additions to Domestic Shed
mailto:council@coorong.sa.gov.au
2019-05-10
2012-07-20
571-080-12
67 NARRUNG ROAD, MENINGIE SA 5264
Lean-To Addition to Domestic Garage
mailto:council@coorong.sa.gov.au
2019-05-10
2012-07-27
LOT: 8 DP: D11034 CT: 5481/600 VG No: 8001013707
571-082-12
17 TILLER STREET, TAILEM BEND SA 5260
Domestic Garage
mailto:council@coorong.sa.gov.au
2019-05-10
2012-08-07
LOT: 654 DP: D4650 CT: 5255/519 VG No: 8000252183
571-006-12
65 WARRENGIE DRIVE, MENINGIE SA 5264
Domestic Shed
mailto:council@coorong.sa.gov.au
2019-05-11
2012-01-18
LOT: 28 DP: D43823 CT: 5293/330 VG No: 8001021950
571-012-12
31- 33 SEYMOUR STREET, TAILEM BEND SA 5260
Solar Panels (on Tilted Frame)
mailto:council@coorong.sa.gov.au
2019-05-11
2012-02-01
LOT: 24 DP: D1802 CT: 5367/44 VG No: 8000342015
571-016-12
5722 PRINCES HIGHWAY, MENINGIE SA 5264
Roofed Pergola (including Masonry Wall)
mailto:council@coorong.sa.gov.au
2019-05-11
2012-02-10
571-019-12
47 FALKNER STREET, MENINGIE SA 5264
Domestic Garage
mailto:council@coorong.sa.gov.au
2019-05-11
2012-02-21
LOT: 1 DP: D35757 CT: 5102/396 VG No: 8001213055
571-025-12
19 GEORGE TERRACE, COONALPYN SA 5265
Alterations and Additions to Existing Implement Shed
mailto:council@coorong.sa.gov.au
2019-05-11
2012-03-02
LOT: 113 DP: F204449 CT: 5565/761 VG No: 8005186007
571-027-12
3 MCCALLUM STREET, MENINGIE SA 5264
Domestic Garage
mailto:council@coorong.sa.gov.au
2019-05-11
2012-03-06
LOT: 239 DP: T750301 CT: 5637/907 VG No: 8001103008
571-030-12
19- 21 STATION DRIVE, TAILEM BEND SA 5260
Sign
mailto:council@coorong.sa.gov.au
2019-05-11
2012-03-13
LOT: 34 DP: T750702 CT: 5484/826 VG No: 8000183000

Statistics

Average successful run time: 1 minute

Total run time: about 6 hours

Total cpu time used: 27 minutes

Total disk space used: 830 KB

History

  • Auto ran revision 33e5afb9 and completed successfully .
    nothing changed in the database
  • Auto ran revision 33e5afb9 and completed successfully .
    nothing changed in the database
  • Auto ran revision 33e5afb9 and completed successfully .
    nothing changed in the database
  • Auto ran revision 33e5afb9 and completed successfully .
    8 records added, 8 records removed in the database
  • Auto ran revision 33e5afb9 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history