planningalerts-scrapers / scenic_rim

Scenic Rim Regional Council Development Applications


Scenic Rim Regional council scraper

This site is a typical .NET ICON site * Terms to agreed - Yes * Cookie - Yes * XML - Yes

Enjoy

Forked from ScraperWiki

Contributors mlandauer emikulic equivalentideas LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Fetching httpclient 2.6.0.1  Fetching mime-types 2.6.1  Installing mime-types 2.6.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing httpclient 2.6.0.1  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.10  Fetching nokogiri 1.6.6.2  Installing sqlite3 1.3.10 with native extensions  Installing nokogiri 1.6.6.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.5  Installing sqlite_magic 0.0.5  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (25.31s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 1790 times by openaustralia LoveMyData jesse-a-reilly TheZepto stevebrencorp spatialsteve Jedwards157 MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (476 KB) Use the API

rows 10 / 1391

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Impact Assessment: Tourist Cabins (Tourist Use) (20 Tourist Cabins and Associated Buildings and Infrastructure) and Environmentally Relevant Activiey (ERA 63(2)(a) - Sewage Treatment Plant with Total Daily Peak Design Capacity of 21 EP to 100EP)
2011-08-09
MC.Bd211/00066
43 Justin Avenue, NORTH TAMBORINE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - House Residential Use
2011-08-12
MC.Bd211/00067
507 Round Mountain Road, JOSEPHVILLE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Impact Assessment - Utility Major
2011-08-16
MC.Bd211/00068
61 - 63 Brooks Drive, KOORALBYN, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment House residential use
2011-08-23
MC.Bd211/00069
8373 Mt Lindesay Highway, JOSEPHVILLE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - Second Dwelling
2011-08-24
MC.Bd211/00070
83 Windabout Road, BEECHMONT, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - Dwelling
2011-08-26
MC.Bd211/00071
247 - 249 Guanaba Road, MOUNT TAMBORINE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - House (Residential Use)
2011-08-29
MC.Bd211/00073
12A Coomera Gorge Drive, MOUNT TAMBORINE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - Accommodation facilities for the handicapped
2011-08-30
MC.Bd211/00072
2 - 4 Davis Street, BEAUDESERT, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment
2011-08-19
OW.Bd2/000050
1 - 5 McKee Street, BEAUDESERT, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Impact Inconsistent Assessment- Boundary Re-alignment
2011-08-10
RL.Bn/00044
Ipswich Boonah Road, COULSON, QLD
mailto:mail@scenicrim.qld.gov.au

Statistics

Average successful run time: less than a minute

Total run time: 11 days

Total cpu time used: 37 minutes

Total disk space used: 964 KB

History

  • Auto ran revision 0188e482 and completed successfully .
    18 records added, 18 records removed in the database
  • Auto ran revision 0188e482 and completed successfully .
    19 records added, 18 records removed in the database
  • Auto ran revision 0188e482 and completed successfully .
    18 records added, 16 records removed in the database
  • Auto ran revision 0188e482 and completed successfully .
    16 records added, 15 records removed in the database
  • Auto ran revision 0188e482 and completed successfully .
    15 records added, 13 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

scenic_rim / scraper.rb