PuZZleDucK / South_Gippsland_Shire_DAs

South Gippsland Shire DAs


South Gippsland Shire Council Scraper

Build Status

Setup scraper

bash bundle install

Run Localy

bash bundle exec ruby scraper.rb

Site Information

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - Not yet supported * Javascript - No * Ajax - No * JSON - No * Structured HTML - Reasonable

Contributors PuZZleDucK LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.2  Fetching httpclient 2.8.2.4  Fetching mime-types-data 3.2016.0521  Installing unf_ext 0.0.7.2 with native extensions  Installing mime-types-data 3.2016.0521  Installing httpclient 2.8.2.4  Fetching net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching pkg-config 1.1.7  Installing net-http-digest_auth 1.4  Installing pkg-config 1.1.7  Fetching ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing ntlm-http 0.1.1  Fetching sqlite3 1.3.11  Installing webrobots 0.1.2  Installing sqlite3 1.3.11 with native extensions  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.6.8  Installing nokogiri 1.6.8 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20160826  Installing domain_name 0.5.20160826  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.5  Installing mechanize 2.7.5  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (21.95s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 544 times by dcalde MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (61 KB) Use the API

rows 10 / 130

council_reference address description info_url date_received on_notice_from on_notice_to date_scraped comment_url
2014/314
2 Gordon Street Korumburra VIC 3950
2 lot subdivision (2 Lot Subdivision)
2014-11-13
2014-11-13
2014-11-27
2015-12-22
2006/541/C
15 Korumburra South Road Korumburra South VIC 3950
Use and development of a Rural store - Proposed amendment to include Contractors depot, additional storage and change conditions (Use & Development)
2015-01-05
2015-01-05
2015-01-19
2015-12-22
2015/19
35 Stevens Road Korumburra VIC 3950
Development of an extension to a dwelling (Single Dwelling (New/Alteration/Outbuilding))
2015-01-09
2015-01-09
2015-01-23
2015-12-22
2015/102
100 Grip Road Toora VIC 3962
Use & Development of Dwelling (Single Dwelling (New/Alteration/Outbuilding))
2015-03-31
2015-03-31
2015-04-14
2015-12-22
2015/193
49-51 River Drive Tarwin Lower VIC 3956
Internally Illuminated Business Identification Sign (Development Only)
2015-06-17
2015-06-17
2015-07-01
2015-12-22
2015/221
5-9 Wills Street Korumburra VIC 3950
2 lot subdivision (2 Lot Subdivision)
2015-07-13
2015-07-13
2015-07-27
2015-12-22
2015/241
151 McCartin Street Leongatha VIC 3953
Use and development of a dwelling (Single Dwelling (New/Alteration/Outbuilding))
2015-07-24
2015-07-24
2015-08-07
2015-12-22
2015/259
31 Hourigan Camp Lane Yanakie VIC 3960
Use and development of a dwelling (Single Dwelling (New/Alteration/Outbuilding))
2015-08-12
2015-08-12
2015-08-26
2015-12-22
2015/272
37A-37B Young Street Leongatha VIC 3953
Development of four dwellings (Development Only)
2015-09-01
2015-09-01
2015-09-15
2015-12-22
2015/284
126 Buchanans Road Bena VIC 3946
Use and develop land for dwelling. (Single Dwelling (New/Alteration/Outbuilding))
2015-09-14
2015-09-14
2015-09-28
2015-12-22

Statistics

Average successful run time: 1 minute

Total run time: 17 days

Total cpu time used: 43 minutes

Total disk space used: 91.9 KB

History

  • Auto ran revision 013814c6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 013814c6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 013814c6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 013814c6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 013814c6 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history