planningalerts-scrapers / banyule

Banyule City Council Development Applications


Banyule City Council Scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Enjoy

Contributors LoveMyData mlandauer jamezpolley AndreM101

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.3 -----> Installing dependencies using bundler 2.0.1  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 2.0.1  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.6  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Installing httpclient 2.8.3  Installing unf_ext 0.0.7.6 with native extensions  Fetching mime-types-data 3.2019.1009  Installing mime-types-data 3.2019.1009  Fetching net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Installing net-http-digest_auth 1.4.1  Installing mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.4.2  Installing sqlite3 1.4.2 with native extensions  Fetching net-http-persistent 3.1.0  Installing net-http-persistent 3.1.0  Fetching mime-types 3.3  Installing mime-types 3.3  Fetching nokogiri 1.10.7  Installing nokogiri 1.10.7 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20190701  Installing domain_name 0.5.20190701  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into `./vendor/bundle`  Bundle completed (22.10s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:   You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.5.3'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:329:in `fetch': 403 => Net::HTTPForbidden for https://www.banyule.vic.gov.au/Planning-building/Review-local-planning-applications/Planning-applications-on-public-notice?dlv_OC%20CL%20Public%20Works%20and%20Projects=(pageindex=1) -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:21:in `block in <main>' from scraper.rb:19:in `loop' from scraper.rb:19:in `<main>'

Data

Downloaded 2181 times by openaustralia dcalde jesse-a-reilly DevAppProject TheZepto reid82 Jedwards157 krynens mlandauer aaaaquaife

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (850 KB) Use the API

rows 10 / 1397

council_reference address description info_url communt_url date_scraped on_notice_from on_notice_to comment_url
P1553/2016
2 Cypress Street, Heidelberg West, VIC
Building and works for the construction of two (2) dwellings consisting of one (1) new dwelling and alteration and additions to the existing dwelling.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-23
2017-06-06
P180/2017
4 Musgrave Walk, Yallambie, VIC
Building and works associated with an existing dwelling on a lot less than 300 square metres.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-23
2017-06-06
P1201/2016
96 Torbay Street, Macleod, VIC
Multi-dwelling development - Construct two double storey dwellings.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-23
2017-06-06
P321/2013 PT2
18 Black Street, Watsonia, VIC
P321/2013 - Buildings and works associated with the construction of alterations and additions to an existing dwelling and a front fence.Amendments include: Construction of a first floor addition to the existing dwelling; Widening the existing carport; Enclosing the front porch and providing new dwelling entry; Internal reconfigurations to layout of existing dwelling; Alterations to external finishes of existing dwelling.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-26
2017-06-09
P1561/2016
8 Daphne Crescent, Bellfield, VIC
The development of the land for the construction of four (4) dwellings.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-26
2017-06-09
P1208/2016
574 & 576 Grimshaw Street, Bundoora, VIC
Multi-dwelling Development - construct eleven (11) dwellings (6 townhouses and 5 apartments) and alter access to a Road Zone Category 1.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-26
2017-06-09
P1265/2016
255 Lower Heidelberg Road, Ivanhoe East, VIC
Use of the land as a clinical pilates studio and the erection of business identification signage within a Heritage Overlay.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-26
2017-06-09
P1392/2016
11 St Helena Road, Greensborough, VIC
Building and works for the construction of two (2) dwellings consisting of one (1) new dwelling with a height greater than 8m in the front of the existing dwelling and alterations and additions to the existing dwelling; construction of a fence within 10 metres of the front boundary; and alteration access to a road in Road Zone, Category 1.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-26
2017-06-09
P1189/2016
20 Weatherlake Street, Watsonia, VIC
Multi Dwelling Development - construction of two dwellings.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-26
2017-06-09
P1354/2016
94 Erskine Road, Macleod, VIC
Five (5) two storey dwellings and reduction of on-site visitor car parking provision.
mailto:enquiries@banyule.vic.gov.au
2017-06-08
2017-05-30
2017-06-13

Statistics

Average successful run time: 1 minute

Total run time: about 2 months

Total cpu time used: 2 days

Total disk space used: 883 KB

History

  • Auto ran revision 2c90ccbb and failed .
    nothing changed in the database
  • Auto ran revision 2c90ccbb and failed .
    nothing changed in the database
  • Auto ran revision 2c90ccbb and failed .
    nothing changed in the database
  • Auto ran revision 2c90ccbb and failed .
    nothing changed in the database
  • Auto ran revision 2c90ccbb and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

banyule / scraper.rb