LoveMyData / blacktown_city

Blacktown City Council Development Applications


Contributors LoveMyData henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.4  Fetching httpclient 2.8.3  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Installing httpclient 2.8.3  Installing unf_ext 0.0.7.4 with native extensions  Fetching net-http-digest_auth 1.4.1  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile2 2.2.0  Installing net-http-digest_auth 1.4.1  Fetching ntlm-http 0.1.1  Installing mini_portile2 2.2.0  Fetching webrobots 0.1.2  Installing ntlm-http 0.1.1  Fetching sqlite3 1.3.13  Installing webrobots 0.1.2  Installing sqlite3 1.3.13 with native extensions  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.0  Installing nokogiri 1.8.0 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.5  Installing mechanize 2.7.5  Bundle complete! 2 Gemfile dependencies, 18 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (23.00s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record DA-21-01957 Skipping already saved record DA-21-01976 Skipping already saved record DA-21-01982 Skipping already saved record DA-21-01985 Skipping already saved record DA-21-01991 Skipping already saved record DA-21-01999 Skipping already saved record DA-21-02002 Skipping already saved record DA-21-02009 Skipping already saved record DA-21-02012 Skipping already saved record DA-21-02020 Skipping already saved record DA-21-02024 Skipping already saved record DA-21-02025 Skipping already saved record DA-21-02026 Skipping already saved record DA-21-02030 Skipping already saved record DA-21-02031 Skipping already saved record DA-21-02032 Skipping already saved record DA-21-02034 Skipping already saved record DA-21-02035 Skipping already saved record DA-21-02036 Skipping already saved record DA-21-02037 Skipping already saved record DA-21-02041 Skipping already saved record DA-21-02042 Skipping already saved record DA-21-02044 Skipping already saved record DA-21-02047 Skipping already saved record DA-21-02048 Skipping already saved record DA-21-02049 Skipping already saved record DA-21-02050 Skipping already saved record DA-21-02051 Skipping already saved record DA-21-02056 Skipping already saved record DA-21-02060 Skipping already saved record MOD-21-00525 Skipping already saved record MOD-21-00528 Skipping already saved record MOD-21-00569 Skipping already saved record MOD-21-00571 Skipping already saved record MOD-21-00572 Skipping already saved record MOD-21-00573 Skipping already saved record MOD-21-00594 Skipping already saved record MOD-21-00595

Data

Downloaded 2112 times by LoveMyData dcalde MikeRalphson jacroft408 srsmonty Lyndall equivalentideas

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.24 MB) Use the API

rows 10 / 11840

council_reference address description date_received date_scraped info_url comment_url communt_url
DA-16-03444
44 Darlington Street STANHOPE GARDENS NSW 2768
Awning
2016-04-14
2016-04-23
DA-16-03436
45 Matthew Crescent BLACKTOWN NSW 2148
Demolition
2016-04-12
2016-04-23
DA-16-02936
154 Best Road SEVEN HILLS NSW 2147
Other Development
2016-02-05
2016-04-23
DA-16-03442
15 Medwin Place QUAKERS HILL NSW 2763
Dwelling - First Floor Addition
2016-04-13
2016-04-23
DA-16-03275
Oatley Close BLACKTOWN NSW 2148
Change of use
2016-03-17
2016-04-23
DA-16-03440
49 Sebastian Crescent COLEBEE NSW 2761
Change of use
2016-04-13
2016-04-23
DA-16-03443
6 Kippax Place SHALVEY NSW 2770
Dwelling - Alterations/Additions
2016-04-14
2016-04-23
DA-16-03439
Pomeroy Street SCHOFIELDS NSW 2762
Dwelling - 2 Storeys, Garage
2016-04-13
2016-04-23
MOD-15-02715
3 Joshua Way DEAN PARK NSW 2761
S96(1A) - Minimal enviornmental impact
2015-12-30
2016-04-23
DA-16-03457
66 Arnott Road MARAYONG NSW 2148
Dwelling - First Floor Addition
2016-04-15
2016-04-23

Statistics

Average successful run time: 1 minute

Total run time: 3 days

Total cpu time used: 40 minutes

Total disk space used: 4.26 MB

History

  • Auto ran revision 08951a26 and completed successfully .
    nothing changed in the database
  • Auto ran revision 08951a26 and completed successfully .
    nothing changed in the database
  • Auto ran revision 08951a26 and completed successfully .
    nothing changed in the database
  • Auto ran revision 08951a26 and completed successfully .
    nothing changed in the database
  • Auto ran revision 08951a26 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

blacktown_city / scraper.rb