LoveMyData / north_sydney

North Sydney Council Development Applications


North Sydney Council Scraper

  • Server - Microsoft
  • System - XC.Track
  • XML - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors CloCkWeRX henare LoveMyData mlandauer equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.4  Fetching httpclient 2.8.3  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching net-http-digest_auth 1.4.1  Installing unf_ext 0.0.7.4 with native extensions  Installing httpclient 2.8.3  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Installing mini_portile2 2.3.0  Fetching webrobots 0.1.2  Installing ntlm-http 0.1.1  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Fetching mime-types 3.1  Installing mime-types 3.1  Installing sqlite3 1.3.13 with native extensions  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.5  Installing mechanize 2.7.5  Bundle complete! 2 Gemfile dependencies, 18 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (24.30s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data in `last14days`, changable via MORPH_PERIOD environment Skipping already saved record DA 115/22 Skipping already saved record DA 116/22 Skipping already saved record DA 416/17/3 Skipping already saved record DA 117/22 Skipping already saved record DA 118/22 Skipping already saved record DA 119/22 Skipping already saved record DA 120/22 Skipping already saved record DA 180/21/2 Skipping already saved record DA 232/20/4 Skipping already saved record DA 241/20/2 Skipping already saved record DA 121/22 Skipping already saved record DA 122/22 Skipping already saved record DA 123/22 Skipping already saved record DA 124/22 Skipping already saved record DA 125/22 Skipping already saved record DA 126/22 Skipping already saved record DA 127/22 Skipping already saved record DA 154/21/2 Skipping already saved record DA 252/19/4 Skipping already saved record DA 128/22 Skipping already saved record DA 129/22 Skipping already saved record DA 137/21/2 Skipping already saved record DA 36/20/2 Skipping already saved record DA 105/10/3 Skipping already saved record DA 130/22 Skipping already saved record DA 131/22 Skipping already saved record DA 329/18/2 Skipping already saved record DA 132/22 Skipping already saved record DA 133/20/2 Skipping already saved record DA 134/22 Skipping already saved record DA 164/03/9 Skipping already saved record DA 135/22 Skipping already saved record DA 136/22 Skipping already saved record DA 137/22 Skipping already saved record DA 138/22 Skipping already saved record DA 139/22 Skipping already saved record DA 140/22

Data

Downloaded 1876 times by LoveMyData dcalde MichaelBone mapMakingActuary

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.34 MB) Use the API

rows 10 / 2499

info_url comment_url council_reference date_received address description date_scraped
mailto:council@northsydney.nsw.gov.au
10/2017/183
2017-06-01
116 A Falcon Street CROWS NEST NSW 2065
To provide for two car spaces with crossing.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/184
2017-06-02
4 McKye Street WAVERTON NSW 2060
Demolish existing buildings and construct four (4) storey residential flat building consisting seven (7) apartments with basement parking.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/185
2017-06-05
McKye Street WAVERTON NSW 2060
Use of Unit 5 and 6A as a gym with hours of operation Monday to Friday: 6am - 9pm, Saturday: 7am - 7pm, Sunday: 9am - 12 Noon.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2016/410 /2
2017-06-06
101 Miller Street NORTH SYDNEY NSW 2060
Construction of a mezzanine level over the toilet area.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/186
2017-06-06
118 Walker Street NORTH SYDNEY NSW 2060
Fitout and use of Level 4 as Business College for 200 students 8am to 10pm Monday to Friday; 8am to 5.30pm Saturday.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/187
2017-06-07
70 Ellalong Road CREMORNE NSW 2090
Substantial demolition of dwelling and alterations and additions including two storey addition; new pool; front fence.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/188
2017-06-07
6 - 8 Falcon Street CROWS NEST NSW 2065
Extension of attic into a rooftop terrace
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/189
2017-06-07
201 Miller Street NORTH SYDNEY NSW 2060
Make good and fitout of level 1
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/190
2017-06-09
1 / 40 Brightmore Street CREMORNE NSW 2090
Demolition of existing residential flat building and construction of nine(9) storey residential flat building containing twenty eight (28) apartments with basement parking for 36 vehicles.
2017-07-31
mailto:council@northsydney.nsw.gov.au
10/2017/191
2017-06-09
7 / 17 Holbrook Avenue KIRRIBILLI NSW 2061
Refurbish existing apartment. New kitchen, bathroom + laundry, floorboards + painting. Minor alterations to existing internal walls.
2017-07-31

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 28 minutes

Total disk space used: 1.84 MB

History

  • Auto ran revision 27707503 and completed successfully .
    2 records added in the database
  • Auto ran revision 27707503 and completed successfully .
    4 records added in the database
  • Auto ran revision 27707503 and completed successfully .
    2 records added in the database
  • Auto ran revision 27707503 and completed successfully .
    nothing changed in the database
  • Auto ran revision 27707503 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

north_sydney / scraper.rb