planningalerts-scrapers / casey

City of Casey Development Applications


City of Casey council scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - Yes
  • JSON - Yes
  • Clearly defined data within a row - Yes

Enjoy

Contributors flying-feline CloCkWeRX henare JasonThomasData LoveMyData MichaelBone mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.3 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.5  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Installing httpclient 2.8.3  Installing unf_ext 0.0.7.5 with native extensions  Fetching json 2.2.0  Fetching mime-types-data 3.2018.0812  Installing json 2.2.0 with native extensions  Installing mime-types-data 3.2018.0812  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Installing mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.4.0  Installing sqlite3 1.4.0 with native extensions  Fetching net-http-persistent 3.0.0  Installing net-http-persistent 3.0.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.2  Installing nokogiri 1.10.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 3 Gemfile dependencies, 20 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (30.48s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Scraping page 1 of 3 Saving record PlnA00658/19, 89-101T Oakgrove Drive, Narre Warren South, VIC Saving record PlnA00755/18.A, 77-89 Victor Crescent, Narre Warren, VIC Saving record PlnA00653/19, 44 Betula Street, Doveton, VIC Saving record PlnA00718/19, 12 Rowan Drive, Doveton, VIC Saving record PlnA00724/19, 15 Minton walk, Narre Warren South, VIC Saving record PlnA00599/19, 60 Cranbourne Drive, Cranbourne, VIC Saving record PlnA00763/19, 2 Oxley Court, Cranbourne North, VIC Saving record PlnA00716/19, 66-68 Vesper Drive, Narre Warren, VIC Saving record PlnA00750/17.B, 65 Berwick-Cranbourne Road, Cranbourne East, VIC Saving record PlnA00613/19, South Gippsland Highway, Cranbourne, VIC Scraping page 2 of 3 Saving record PlnA00525/19, 8 Karo Court, Doveton, VIC Saving record PlnA00501/19, 4 Cannons Creek Road, Cannons Creek, VIC Saving record PlnA00526/19, 39 Cannons Creek Road, Cannons Creek, VIC Saving record PlnA00992/00.A, Unit 1/22 Harkaway Road, Berwick, VIC Saving record PlnA00539/19, 1-39 Centre Road, Hampton Park, VIC Saving record PlnE01886/19, 7 Avenview Drive, Narre Warren North, VIC Saving record PlnA00722/16.A, 7 Annette Court, Endeavour Hills, VIC Saving record PlnA00639/19, 12-14 Olive Road, Devon Meadows, VIC Saving record PlnA00651/19, 9 Willow Drive, Hampton Park, VIC Saving record PlnA00559/19, 33 Ash Street, Doveton, VIC Scraping page 3 of 3 Saving record PlnA00368/19, 45 David Collins Drive, Endeavour Hills, VIC Saving record PlnA00335/18.A, 18 Gloucester Avenue, Berwick, VIC Saving record PlnA00735/19, 106 Bellevue Drive, Berwick, VIC Saving record PlnA00840/19, 1 Capra Court, Narre Warren North, VIC Saving record PlnA00557/19, 11 Pettit Close, Berwick, VIC Saving record PlnA00674/19, 84 Paperbark Street, Doveton, VIC Saving record PlnA00741/19, 78-86 Rowallan Avenue, Harkaway, VIC Saving record PlnA00632/19, 2 Rubida Court, Endeavour Hills, VIC Saving record PlnA00520/19, 41 Kidds Road, Doveton, VIC Saving record PlnA00167/19, 73 Browns Road, Devon Meadows, VIC

Data

Downloaded 3072 times by openaustralia LoveMyData jesse-a-reilly DevAppProject TheZepto MikeRalphson derman232 Jedwards157 cankei DT88 Simsoi GitHubMLee TornMarketing

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (924 KB) Use the API

rows 10 / 1865

info_url comment_url council_reference on_notice_to address description date_scraped
PlnA00028/14 
2015-06-19
8 Beaumont View Lane, Berwick, VIC
Development of a Shed
2015-06-17
PlnA00207/15 
2015-06-25
92/94 Enterprise Avenue, Berwick, VIC
Use of Premises for an Indoor Recreation Facility and Office, Advertising Signage, Additions to Existing Mezzanine and a Reduction in Car Parking
2015-06-17
PlnA00871/14 
2015-06-22
157 High Street, Berwick, VIC
Development of Five Dwellings (compromising three single storey and two double storey) Removal of Vegetation and Buildings and Works within the Tree Protection Zones of Trees Protected by the Provisions of the Significant Overlay No. 4
2015-06-17
PlnA00085/15 
2015-06-30
2-4 Scotsgate Way, Berwick, VIC
Development of a Dwelling and Removal of Three Trees
2015-06-17
PlnA00140/15 
2015-06-19
11 & 13 Barkly Street, Cranbourne, VIC
Development of Two Additional Dwellings and Alterations to the Existing Dwellings
2015-06-17
PlnA00064/15 
2015-06-22
16 Clarendon Street, Cranbourne, VIC
Development of a Second Dwelling
2015-06-17
PlnA00690/14 
2015-07-02
4 Kurt Place, Cranbourne, VIC
Development of a Second Dwelling and Alterations to the Existing Dwelling, Two Lot Subdivision and Variation of Covenant (to allow the height of the fence to be increased to 1.8m)
2015-06-17
PlnA00945/14 
2015-07-06
825 Cranbourne Frankston Road, Cranbourne West, VIC
Buildings and Works Associated with the Construction of a Dam and Earthworks on Land Affected by an Environment Significance Overlay No. 7
2015-06-17
PlnA00261/15 
2015-06-25
8 Finsbury Road, Devon Meadows, VIC
Development of a Shed
2015-06-17
PlnA00161/15 
2015-06-19
9-11 Green Street, Doveton, VIC
Use and Development of a Place of Assembly (Community Centre)
2015-06-17

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 28 minutes

Total disk space used: 958 KB

History

  • Auto ran revision 17ba9d99 and completed successfully .
    30 records added, 30 records removed in the database
  • Auto ran revision 17ba9d99 and completed successfully .
    32 records added, 32 records removed in the database
  • Auto ran revision 17ba9d99 and completed successfully .
    32 records added, 31 records removed in the database
  • Auto ran revision 17ba9d99 and completed successfully .
    31 records added, 31 records removed in the database
  • Auto ran revision 17ba9d99 and completed successfully .
    31 records added, 31 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

casey / scraper.rb