planningalerts-scrapers / casey

City of Casey Development Applications


This is a scraper that runs on Morph. To get started see the documentation

Contributors flying-feline CloCkWeRX henare JasonThomasData

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching httpclient 2.6.0.1  Installing httpclient 2.6.0.1  Fetching mime-types 2.5  Installing mime-types 2.5  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (25.29s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.0.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:308:in `fetch': 404 => Net::HTTPNotFound for https://www.casey.vic.gov.au/building-planning/planning-documents-on-exhibition/Advertised-planning-applications/A-C -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/2.0.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:976:in `response_redirect' from /app/vendor/bundle/ruby/2.0.0/gems/mechanize-2.7.3/lib/mechanize/http/agent.rb:300:in `fetch' from /app/vendor/bundle/ruby/2.0.0/gems/mechanize-2.7.3/lib/mechanize.rb:440:in `get' from scraper.rb:40:in `<main>'

Data

Downloaded 2318 times by openaustralia LoveMyData jesse-a-reilly TheZepto MikeRalphson Simsoi GitHubMLee TornMarketing derman232 DT88

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (799 KB) Use the API

rows 10 / 1524

info_url comment_url council_reference on_notice_to address description date_scraped
PlnA00028/14 
2015-06-19
8 Beaumont View Lane, Berwick, VIC
Development of a Shed
2015-06-17
PlnA00207/15 
2015-06-25
92/94 Enterprise Avenue, Berwick, VIC
Use of Premises for an Indoor Recreation Facility and Office, Advertising Signage, Additions to Existing Mezzanine and a Reduction in Car Parking
2015-06-17
PlnA00871/14 
2015-06-22
157 High Street, Berwick, VIC
Development of Five Dwellings (compromising three single storey and two double storey) Removal of Vegetation and Buildings and Works within the Tree Protection Zones of Trees Protected by the Provisions of the Significant Overlay No. 4
2015-06-17
PlnA00085/15 
2015-06-30
2-4 Scotsgate Way, Berwick, VIC
Development of a Dwelling and Removal of Three Trees
2015-06-17
PlnA00140/15 
2015-06-19
11 & 13 Barkly Street, Cranbourne, VIC
Development of Two Additional Dwellings and Alterations to the Existing Dwellings
2015-06-17
PlnA00064/15 
2015-06-22
16 Clarendon Street, Cranbourne, VIC
Development of a Second Dwelling
2015-06-17
PlnA00690/14 
2015-07-02
4 Kurt Place, Cranbourne, VIC
Development of a Second Dwelling and Alterations to the Existing Dwelling, Two Lot Subdivision and Variation of Covenant (to allow the height of the fence to be increased to 1.8m)
2015-06-17
PlnA00945/14 
2015-07-06
825 Cranbourne Frankston Road, Cranbourne West, VIC
Buildings and Works Associated with the Construction of a Dam and Earthworks on Land Affected by an Environment Significance Overlay No. 7
2015-06-17
PlnA00261/15 
2015-06-25
8 Finsbury Road, Devon Meadows, VIC
Development of a Shed
2015-06-17
PlnA00161/15 
2015-06-19
9-11 Green Street, Doveton, VIC
Use and Development of a Place of Assembly (Community Centre)
2015-06-17

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 827 KB

History

  • Auto ran revision 7d564587 and failed .
    nothing changed in the database
  • Auto ran revision 7d564587 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 7d564587 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 7d564587 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 7d564587 and failed .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

casey / scraper.rb