jamezpolley / waverley

Waverley Council Development Applications


Waverley Council Scraper

  • Server - XC.Track
  • Cookie tracking - Yes
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - No but acceptable

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData equivalentideas jamezpolley

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby  Command: 'set -o pipefail; curl -L --fail --retry 5 --retry-delay 1 --connect-timeout 30 --max-time 180 https://s3-external-1.amazonaws.com/heroku-buildpack-ruby/heroku-18/ruby-2.0.0.tgz -s -o - | tar zxf - ' failed on attempt 1 of 3.  Command: 'set -o pipefail; curl -L --fail --retry 5 --retry-delay 1 --connect-timeout 30 --max-time 180 https://s3-external-1.amazonaws.com/heroku-buildpack-ruby/heroku-18/ruby-2.0.0.tgz -s -o - | tar zxf - ' failed on attempt 2 of 3.    !  ! An error occurred while installing ruby-2.0.0  !  ! Heroku recommends you use the latest supported Ruby version listed here:  ! https://devcenter.heroku.com/articles/ruby-support#supported-runtimes  !  ! For more information on syntax for declaring a Ruby version see:  ! https://devcenter.heroku.com/articles/ruby-versions  !  !  ! Debug InformationCommand: 'set -o pipefail; curl -L --fail --retry 5 --retry-delay 1 --connect-timeout 30 --max-time 180 https://s3-external-1.amazonaws.com/heroku-buildpack-ruby/heroku-18/ruby-2.0.0.tgz -s -o - | tar zxf - ' failed unexpectedly:  !  ! gzip: stdin: unexpected end of file  ! tar: Child returned status 1  ! tar: Error is not recoverable: exiting now  !

Data

Downloaded 2 times by edwardblackshaw dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (6 KB) Use the API

rows 6 / 6

council_reference address description info_url comment_url date_scraped date_received
DA-226/2018
75 St Thomas Street BRONTE NSW 2024
Alterations and additions to basement, ground and first floor.
mailto:waver@waverley.nsw.gov.au?subject=DA-226/2018
2018-06-26
2018-06-25
DA-227/2018
7 Ebley Street BONDI JUNCTION NSW 2022
Change of use for beauty salon to indoor recreation (martial arts school). No building works or demolition.
mailto:waver@waverley.nsw.gov.au?subject=DA-227/2018
2018-06-26
2018-06-25
DA-228/2018
183 Bondi Road BONDI NSW 2026
Change of use of first floor from residential to commercial (Thai Massage)
mailto:waver@waverley.nsw.gov.au?subject=DA-228/2018
2018-06-26
2018-06-25
DA-101/2017/A
20 Llandaff Street BONDI JUNCTION NSW 2022
Modify condition relating to VPA.
mailto:waver@waverley.nsw.gov.au?subject=DA-101/2017/A
2018-06-26
2018-06-26
DA-229/2018
Westfield Shopping Centre 512-548 Oxford Street BONDI JUNCTION NSW 2022
Use of terrace to shop 5050 and balustrade extension.
mailto:waver@waverley.nsw.gov.au?subject=DA-229/2018
2018-06-26
2018-06-26
DA-230/2018
7/99 Hewlett Street BRONTE NSW 2024
Internal alterations to a sole occupancy unit within a heritage item.
mailto:waver@waverley.nsw.gov.au?subject=DA-230/2018
2018-06-26
2018-06-26

Statistics

Average successful run time: less than 20 seconds

Total run time: about 4 hours

Total cpu time used: less than 5 seconds

Total disk space used: 39.3 KB

History

  • Auto ran revision ca90e34b and failed .
    nothing changed in the database
  • Auto ran revision ca90e34b and failed .
    nothing changed in the database
  • Auto ran revision ca90e34b and failed .
    nothing changed in the database
  • Auto ran revision ca90e34b and failed .
    nothing changed in the database
  • Auto ran revision ca90e34b and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

waverley / scraper.rb