planningalerts-scrapers / district_council_of_peterborough_sa_development_applications

District Council of Peterborough (South Australia) Development Applications

README.md

This is a scraper that runs on Morph. It scrapes lodged development applications from the South Australian District Council of Peterborough web site.

Contributors MichaelBone

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 10.14.1  engines.npm (package.json): unspecified (use default)   Resolving node version 10.14.1...  Downloading and installing node 10.14.1...  Using default npm version: 6.4.1  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@4.0.6 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v64-linux-x64/node_sqlite3.node" is installed via remote  added 475 packages from 341 contributors and audited 4497 packages in 17.473s  found 0 vulnerabilities   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving page: https://www.peterborough.sa.gov.au/Register Found 7 PDF file(s). Selecting two to parse. Parsing document: https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202017.pdf Reading development applications from https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202017.pdf. Reading and parsing applications from page 1 of 12. Found "504/001/17". Found "504/002/17". Reading and parsing applications from page 2 of 12. Found "504/003/17". Found "504/004/17". Reading and parsing applications from page 3 of 12. Found "504/005/17". Found "5004/006/17". Reading and parsing applications from page 4 of 12. Found "504/007/17". Found "504/008/17". Reading and parsing applications from page 5 of 12. Found "504/009/17". Found "5004/010/17". Reading and parsing applications from page 6 of 12. Found "504/011/17". Found "504/012/17". Reading and parsing applications from page 7 of 12. Found "504/013/17". Found "504/014/17". Reading and parsing applications from page 8 of 12. Found "504/015/17". Found "504/016/17". Reading and parsing applications from page 9 of 12. Found "504/017/17". Found "504/018/17". Reading and parsing applications from page 10 of 12. Found "504/019/17". Found "504/020/17". Reading and parsing applications from page 11 of 12. Found "504/021/17". Found "504/022/17". Reading and parsing applications from page 12 of 12. Found "504/023/17". Found "504/024/17". Parsed 24 development application(s) from document: https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202017.pdf Saving development applications to the database. Saved application "504/001/17" with address "11 WRIGHT STREET, PETERBOROUGH SA 5422", description "CARPORT" and received date "2017-01-19" to the database. Saved application "504/002/17" with address "92 RAILWAY TERRACE, PETERBOROUGH SA 5422", description "SHED REPLACEMENT" and received date "2017-01-31" to the database. Saved application "504/003/17" with address "130 MOSCOW STREET, PETERBOROUGH SA 5422", description "VERANDAH & PERGOLA" and received date "2017-04-18" to the database. Saved application "504/004/17" with address "137 SHIELDS ROAD, YONGALA SA 5493", description "MACHINERY SHED" and received date "2017-02-17" to the database. Saved application "504/005/17" with address "185-189 MAIN STREET, PETERBOROUGH SA 5422", description "CARPORT" and received date "2017-03-06" to the database. Saved application "5004/006/17" with address "PEECHARA HILLS, NACKARA SA 5440", description "BUSH CAMPING PARK, ABLUTION BLOCK, SEPTIC WASTE INSTALLATION" and received date "2017-03-16" to the database. Saved application "504/007/17" with address "93 HURLSTONE STREET, PETERBOROUGH SA 5422", description "2A STORAGE SHED" and received date "2017-03-24" to the database. Saved application "504/008/17" with address "25 WRIGHT STREET, PETERBOROUGH SA 5422", description "FREE STANDING EXTENSION TO SHED" and received date "2017-04-07" to the database. Saved application "504/009/17" with address "47 QUEEN STREET, PETERBOROUGH SA 5422", description "CARPORT" and received date "2017-04-20" to the database. Saved application "5004/010/17" with address "LOT 1 BENIAH RD, PETERBOROUGH SA 5422", description "SOLAR FARM" and received date "2017-06-20" to the database. Saved application "504/011/17" with address "144 YATINA ROAD PETERBOROUGH 1 PRICE ROAD, PETERBOROUGH SA 5422", description "EFFLUENT TREATMENT LAGOONS – 1 & 2" and received date "2017-09-15" to the database. Saved application "504/012/17" with address "SECT 53 BARRIER HIGHWAY, NACKARA SA 5440", description "TELECOMMUNICATIONS FACILITY" and received date "2017-07-14" to the database. Saved application "504/013/17" with address "18 BOURKE STREET, PETERBOROUGH SA 5422", description "NEW SHED" and received date "2017-08-04" to the database. Saved application "504/014/17" with address "94-95 HURLSTONE STREET, PETERBOROUGH SA 5422", description "NEW HOME" and received date "2017-08-04" to the database. Saved application "504/015/17" with address "20 BROWN STREEET, PETERBOROUGH SA 5422", description "CAR PORT" and received date "2017-08-25" to the database. Saved application "504/016/17" with address "48 SYMES ROAD, YONGALA SA 5493", description "FIXED TILTED SOLAR FARM" and received date "2017-08-28" to the database. Saved application "504/017/17" with address "121 MAIN STREET, PETERBOROUGH SA 5422", description "PARKING AREA REAR OF HOTEL" and received date "2017-09-27" to the database. Saved application "504/018/17" with address "105 RAILWAY TERRACE, PETERBOROUGH SA 5422", description "CAR PORT" and received date "2017-10-03" to the database. Saved application "504/019/17" with address "4 HIGH STREET, PETERBOROUGH SA 5422", description "SOLAR PANELS ON TILT FRAME" and received date "2017-10-09" to the database. Saved application "504/020/17" with address "3 EDITH STREET, PETERBOROUGH SA 5422", description "CARPORT & VERANDAH" and received date "2017-09-18" to the database. Saved application "504/021/17" with address "9 FOWLERS ROAD, PETERBOROUGH SA 5422", description "2 X FREESTANDING VERANDAH & 1 X ATTACHED VERANDAH" and received date "2017-11-01" to the database. Saved application "504/022/17" with address "9 KITCHENER STREET, PETERBOROUGH SA 5422", description "6M X6M TRANSPORTABLE SHED" and received date "2017-11-10" to the database. Saved application "504/023/17" with address "23 PINE STREET, PETERBOROUGH SA 5422", description "20FT CARGO WORTHY CONTAINER PLACED ON PROPERTY" and received date "2017-11-10" to the database. Saved application "504/024/17" with address "257 MAIN STREET, PETERBOROUGH SA 5422", description "STEEL FRAMED CARPORT FIXED TO EXISTING STONE DWELLING" and received date "2017-11-16" to the database. Parsing document: https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202019.pdf Reading development applications from https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202019.pdf. Reading and parsing applications from page 1 of 6. Found "504/001/19". Found "504/002/19". Reading and parsing applications from page 2 of 6. Found "504/003/19". Found "504/004/19". Reading and parsing applications from page 3 of 6. Found "504/005/19". Found "504/006/19". Reading and parsing applications from page 4 of 6. Found "504/007/19". Found "504/008/19". Reading and parsing applications from page 5 of 6. Found "504/009/19". Found "504/010/19". Reading and parsing applications from page 6 of 6. Found "504/011/19". Found "504/012/19". Parsed 12 development application(s) from document: https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202019.pdf Saving development applications to the database. Saved application "504/001/19" with address "112 COTTON ROAD, PETERBOROUGH SA 5422", description "SATELLITE COMMUNICATIONS PARK" and received date "2019-02-14" to the database. Saved application "504/002/19" with address "87 HILL STREET, PETERBOROUGH SA 5422", description "COLORBOND CAR SHED" and received date "2019-02-20" to the database. Saved application "504/003/19" with address "2 EDITH STREET, PETERBOROUGH SA 5422", description "STORAGE SHED" and received date "2019-02-25" to the database. Saved application "504/004/19" with address "193-195 MAIN STREET, PETERBOROUGH SA 5422", description "CARPORT/STRUCTURE FOR CUSTOMERS" and received date "2019-02-26" to the database. Saved application "504/005/19" with address "50 RAILWAY TERRACE, PETERBOROUGH SA 5422", description "GALVANISED SHED FOR GYM/TRAINING SITE" and received date "2019-03-14" to the database. Saved application "504/006/19" with address "110 RAILWAY TERRACE, PETERBOROUGH SA 5422", description "STEEL FRAMED GARAGE/SHED" and received date "2019-03-26" to the database. Saved application "504/007/19" with address "TELFORD AVENUE, PETERBOROUGH SA 5422", description "MINIATURE RAILWAY PARK TO PROVIDE ENTERTAINMENT" and received date "2019-03-28" to the database. Saved application "504/008/19" with address "31 KITCHENER STREET, PETERBOROUGH SA 5422", description "REMOVAL/DEMOLITION OF TIMBER FRAME ASBESTOS CLAD TRANSPORTABLE BUILDING & DEBRI" and received date "2019-03-28" to the database. Saved application "504/009/19" with address "105 VICTORIA STREET, PETERBOROUGH SA 5422", description "OLYMPIC VERANDAH" and received date "2019-05-01" to the database. Saved application "504/010/19" with address "110 RAILWAY TERRACE, PETERBOROUGH SA 5422", description "FREE STANDING VERANDAH" and received date "2019-05-20" to the database. Saved application "504/011/19" with address "67 QUEEN STREET, PETERBOROUGH SA 5422", description "CARPORT" and received date "2019-06-03" to the database. Saved application "504/012/19" with address "13 TELFORD AVENUE, PETERBOROUGH SA 5422", description "CONTAINER" and received date "2019-06-12" to the database. Complete.

Data

Downloaded 255 times by openaustralia MichaelBone jesse-a-reilly

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (56 KB) Use the API

rows 10 / 111

council_reference address description info_url comment_url date_scraped date_received
504/002/14
39 VICTORIA STREET, PETERBOROUGH SA 5422
GARAGE – 6 X 6M, 36M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-01-17
504/003/14
7 – 11 JERVOIS STREET, PETERBOROUGH SA 5422
8.325 X 5.340 EXTENSION TO REAR OF BUILDING 44M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-02-06
504/004/14
25 BRIDGES STREET, PETERBOROUGH SA 5422
CARPORT & SHELTER AREA. 99M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-02-17
504/005/14
169 QUEEN STREET, PETERBOROUGH SA 5422
Carport & Verandah, 116M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-04-28
504/006/14
9 SILVER STREET, PETERBOROUGH SA 5422
Solar System Angle Mount
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-05-19
504/007/14
18 – 20 HIGH STREET, PETERBOROUGH SA 5422
Rear Verandah, 25M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-05-26
504/008/14
54 MAIN STREET, PETERBOROUGH SA 5422
Sunroom at rear of existing shed, 33M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-06-15
504/009/14
20 JERVOIS STREET, PETERBOROUGH SA 5422
VERANDAH
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-07-10
504/010/14
37 GROVE STREET, PETERBOROUGH SA 5422
GARAGE 9M X 7.5M, 67M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-08-06
504/011/14
105 RAILWAY TERRACE, PETERBOROUGH SA 5422
CARPORT, 48M2
https://www.peterborough.sa.gov.au/webdata/resources/files/DA%20REGISTER%202014.pdf
mailto:council@peterborough.sa.gov.au
2020-01-09
2014-08-04

Statistics

Average successful run time: 1 minute

Total run time: about 5 hours

Total cpu time used: 39 minutes

Total disk space used: 366 KB

History

  • Auto ran revision 06b2f714 and completed successfully .
    36 records added, 36 records removed in the database
  • Auto ran revision 06b2f714 and completed successfully .
    27 records added, 27 records removed in the database
  • Auto ran revision 06b2f714 and completed successfully .
    38 records added, 38 records removed in the database
  • Auto ran revision 06b2f714 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision 06b2f714 and completed successfully .
    27 records added, 27 records removed in the database
  • ...
  • Created on morph.io

Show complete history