planningalerts-scrapers / melbourne

City of Melbourne Planning Applications


Forked from ScraperWiki

Contributors mlandauer henare andrewasfa

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.2  Fetching httpclient 2.7.2  Fetching mime-types 2.99.1  Installing mime-types 2.99.1  Installing unf_ext 0.0.7.2 with native extensions  Installing httpclient 2.7.2  Fetching net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile2 2.0.0  Installing net-http-digest_auth 1.4  Fetching ntlm-http 0.1.1  Installing mini_portile2 2.0.0  Fetching webrobots 0.1.2  Installing ntlm-http 0.1.1  Installing webrobots 0.1.2  Fetching sqlite3 1.3.11  Fetching nokogiri 1.6.7.2  Installing sqlite3 1.3.11 with native extensions  Installing nokogiri 1.6.7.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20160310  Installing domain_name 0.5.20160310  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.4  Installing mechanize 2.7.4  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (26.16s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?std=01/10/2019&end=15/10/2019&page=1 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?std=01/10/2019&end=15/10/2019&page=2 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?std=01/10/2019&end=15/10/2019&page=3 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?std=01/10/2019&end=15/10/2019&page=4 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?std=01/10/2019&end=15/10/2019&page=5 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?std=01/10/2019&end=15/10/2019&page=6 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=325096 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=325102 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=325133 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323720 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323975 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323977 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323995 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=324519 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=324392 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323980 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323986 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=316632 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323678 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=322312 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=317149 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323676 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=317131 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=317127 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=315255 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=317114 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=323666 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=322320 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=315250 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=319675 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=315231 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=315126 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=315117 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=327070 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326683 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=327082 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=327094 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=327031 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=327023 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=327024 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326920 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326990 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326942 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326962 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326907 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326960 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326987 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326837 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=326887 Fetching http://www.melbourne.vic.gov.au/building-and-development/property-information/planning-building-registers/Pages/town-planning-permits-register-search-results.aspx?appid=325126

Data

Downloaded 3503 times by openaustralia LoveMyData DevAppProject jesse-a-reilly TheZepto equivalentideas GitHubMLee codemonkeyau MikeRalphson n1k0p0l PuZZleDucK Simsoi TornMarketing Jedwards157 cankei jbjl

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.8 MB) Use the API

rows 10 / 7400

date_scraped description info_url date_received council_reference address comment_url
2012-08-19
Render brick fence and install pickett gate and fence
2012-08-17
TP-2012-582
62 Barnett Street KENSINGTON VIC 3031
2012-08-19
Remove existing fence and replace with a pickett fence and gate.
2012-08-17
TP-2012-583
62 Barnett Street KENSINGTON VIC 3031
2012-08-19
To rectify pool fence in a Heritage overlay area
2012-08-17
TP-2012-584
110-124 Gipps Street EAST MELBOURNE VIC 3002
2012-08-19
Extension to residence
2012-08-17
TP-2012-585
16 Mulgrave Street KENSINGTON VIC 3031
2012-08-19
Partial demolition and rear three-storey addition including internal alterations to upgrade existing 2 No 2 bedroom townhouses to 2 No 3 bedroom residence
2012-08-17
TP-2012-586
38-40 Eades Place WEST MELBOURNE VIC 3003
2012-08-19
Partial demolition to rear of existing dwelling; alterations and additions to existing dwelling including construction of a deck at ground floor level and new pergolas at ground and first floor level and new on-site car space with rollere door access to Market Lane
2012-08-17
TP-2012-587
91 Courtney Street NORTH MELBOURNE VIC 3051
2012-08-19
Installation of a blade lightbox with business logo
2012-08-17
TP-2012-588
46 Little La Trobe Street MELBOURNE VIC 3000
2012-08-19
Application for a Music Event in the South lawn underground car park
2012-08-16
TP-2012-580
Carpark Melbourne University 220 Berkeley Street CARLTON VIC 3053
2012-08-19
Removal of redundant easements Vary easements Creation of easements for air, light and access
2012-08-16
TP-2012-581
441-447 Elizabeth Street MELBOURNE VIC 3000
2012-08-19
Proposed change of use to a Tavern and variation to existing liquor licence under Clause 52.27
2012-08-15
TP-2012-575
22 Drewery Place MELBOURNE VIC 3000

Statistics

Average successful run time: 3 minutes

Total run time: 2 months

Total cpu time used: about 12 hours

Total disk space used: 3.83 MB

History

  • Auto ran revision 7855cd2d and completed successfully .
    44 records added, 41 records removed in the database
  • Auto ran revision 7855cd2d and completed successfully .
    44 records added, 44 records removed in the database
  • Auto ran revision 7855cd2d and completed successfully .
    44 records added, 44 records removed in the database
  • Auto ran revision 7855cd2d and completed successfully .
    44 records added, 44 records removed in the database
  • Auto ran revision 7855cd2d and completed successfully .
    44 records added, 38 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

melbourne / scraper.rb