planningalerts-scrapers / port_augusta_city_council_sa_development_applications

Port Augusta City Council (South Australia) Development Applications


This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian Port Augusta City Council web site.

Contributors MichaelBone mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.6.0  engines.npm (package.json): unspecified (use default)   Resolving node version 10.6.0...  Downloading and installing node 10.6.0...  Using default npm version: 6.1.0  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.9 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 162 packages from 126 contributors and audited 303 packages in 7.821s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.portaugusta.sa.gov.au/da-register Parsing document: https://www.portaugusta.sa.gov.au/webdata/resources/files/March%202019.pdf Reading and parsing applications from page 1 of 5. Found "7/2019". Reading and parsing applications from page 2 of 5. Found "19/2019". Reading and parsing applications from page 3 of 5. Found "33/2019". Reading and parsing applications from page 4 of 5. Found "223/2018". Reading and parsing applications from page 5 of 5. Found "235/2018". Parsed 5 development application(s) from document: https://www.portaugusta.sa.gov.au/webdata/resources/files/March%202019.pdf Inserting development applications into the database. Saved: application "7/2019" with address "4-6 Flinders ST, PORT AUGUSTA SA 5700", description "Pergola" and received date "2019-03-26" into the database. Saved: application "19/2019" with address "5 Kelly CRT, STIRLING NORTH SA 5710", description "New Dwelling" and received date "2019-03-12" into the database. Saved: application "33/2019" with address "17 Glyde ST, PORT AUGUSTA SA 5700", description "Dwelling Extension" and received date "2019-03-19" into the database. Saved: application "223/2018" with address "9 Loudon ROAD, PORT AUGUSTA WEST SA 5700", description "Accommodation Units (Change of class from 10a to 3)" and received date "2019-03-01" into the database. Saved: application "235/2018" with address "20 Esplanade ROAD, MIRANDA SA 5700", description "New Dwelling" and received date "2019-03-12" into the database. Parsing document: https://www.portaugusta.sa.gov.au/webdata/resources/files/January%202019-1.pdf Reading and parsing applications from page 1 of 4. Found "6/2019". Reading and parsing applications from page 2 of 4. Found "205/2018". Reading and parsing applications from page 3 of 4. Found "231/2018". Reading and parsing applications from page 4 of 4. Found "240/2018". Parsed 4 development application(s) from document: https://www.portaugusta.sa.gov.au/webdata/resources/files/January%202019-1.pdf Inserting development applications into the database. Saved: application "6/2019" with address "1A Khan ST, PORT AUGUSTA WEST SA 5700", description "Carport" and received date "2019-01-30" into the database. Saved: application "205/2018" with address "48 Quorn ROAD, STIRLING NORTH SA 5710", description "Change from Home Based Childcare to Hairdressing Salon" and received date "2019-01-08" into the database. Saved: application "231/2018" with address "10 Artlett AVE, PORT AUGUSTA SA 5700", description "Dwelling Extension and Verandah" and received date "2019-01-08" into the database. Saved: application "240/2018" with address "13 Francis ST, STIRLING NORTH SA 5710", description "Verandah" and received date "2019-01-17" into the database. Complete.

Data

Downloaded 193 times by openaustralia jesse-a-reilly Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (68 KB) Use the API

rows 10 / 243

council_reference address description info_url comment_url date_scraped date_received
121/2018
69 Carlton PDE, PORT AUGUSTA SA 5700
Storage Building and Carport
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-10-16
138/2018
4-6 Flinders ST, PORT AUGUSTA SA 5700
Verandah and alternation to rumpus room
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-10-16
153/2018
7 Pool CRES, MIRANDA SA 5700
Balcony Enclosure
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-10-24
166/2018
6 Inglis CRT, PORT AUGUSTA WEST SA 5700
New Dwelling
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-10-31
173/2018
4 Inglis CRT, PORT AUGUSTA WEST SA 5700
New Dwelling
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-10-31
194/2018
30 Eyre HWY, PORT AUGUSTA WEST SA 5700
Petrol Station/Service Station Ad
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-10-16
14/2018
6 Keer ST, PORT AUGUSTA SA 5700
Demolition
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-01-25
40/2016
Augusta HWY, PORT AUGUSTA SA 5700
Industrial Training Facility (Access Trainning Centre)
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-01-08
87/2017
32 Zerna ROAD AREA NAMED, PORT AUGUSTA SA 5700
Ground Mounted Solar Panels and associated equipment
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-01-08
135/2017
Zanker AVE, STIRLING NORTH SA 5710
New Dwelling and Shed and Carport
mailto:admin@portaugusta.sa.gov.au
2018-12-04
2018-01-25

Statistics

Average successful run time: 1 minute

Total run time: about 4 hours

Total cpu time used: 6 minutes

Total disk space used: 222 KB

History

  • Auto ran revision 3da162f9 and completed successfully .
    9 records added, 9 records removed in the database
  • Auto ran revision 3da162f9 and completed successfully .
    14 records added, 14 records removed in the database
  • Auto ran revision 3da162f9 and completed successfully .
    14 records added, 14 records removed in the database
  • Auto ran revision 3da162f9 and completed successfully .
    14 records added, 14 records removed in the database
  • Auto ran revision 3da162f9 and completed successfully .
    9 records added, 9 records removed in the database
  • ...
  • Created on morph.io

Show complete history