LoveMyData / scenic_rim

Scenic Rim Regional Council Development Applications


Scenic Rim Regional council scraper

This site is a typical .NET ICON site * Terms to agreed - Yes * Cookie - Yes * XML - Yes

Enjoy

Contributors emikulic mlandauer equivalentideas LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Fetching httpclient 2.6.0.1  Fetching mime-types 2.6.1  Installing mime-types 2.6.1  Installing httpclient 2.6.0.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Installing net-http-digest_auth 1.4  Fetching mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing mini_portile 0.6.2  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.1  Fetching sqlite3 1.3.10  Installing webrobots 0.1.1  Installing sqlite3 1.3.10 with native extensions  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.5  Installing sqlite_magic 0.0.5  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (26.13s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record MCU22/021 Skipping already saved record EXE22/002 Skipping already saved record POS22/018 Skipping already saved record OPW22/011 Skipping already saved record OPW22/012 Skipping already saved record CAR22/020 Skipping already saved record CAR22/021 Skipping already saved record MCU22/022 Skipping already saved record MCU22/023 Skipping already saved record MCU22/024 Skipping already saved record POS22/019 Skipping already saved record POS22/020 Skipping already saved record MCU22/025 Skipping already saved record MCU22/026 Skipping already saved record MCU22/027 Skipping already saved record MCU22/028 Skipping already saved record RAL22/011 Skipping already saved record CAR22/022 Skipping already saved record MCU22/029 Skipping already saved record MCU22/030 Skipping already saved record MCU22/031 Skipping already saved record CAR22/023 Skipping already saved record MCU22/032 Skipping already saved record MCU22/033 Skipping already saved record MCU22/034 Skipping already saved record POS22/021 Skipping already saved record RAL22/012 Skipping already saved record RAL22/013

Data

Downloaded 2102 times by LoveMyData dcalde yourneighbourhood

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (745 KB) Use the API

rows 10 / 1964

council_reference description date_received address date_scraped info_url comment_url
MCBd16/089
Intensive Agriculture (Rural Use)
2016-09-06
3079 Beaudesert-Boonah Road, BROMELTON QLD 4285
2016-09-16
D8041.02
Extension of Time for Relevant Period - Code / ERA Assessment Poultry Farming 1,000 - 200,000 birds
2016-09-07
763 Roadvale-Harrisville Road, MILORA QLD 4309
2016-09-16
MCBd16/091
House (Residential Use)
2016-09-07
627 - 639 Main Western Road, TAMBORINE MOUNTAIN QLD 4272
2016-09-16
MCBd16/092
Dual Occupancy (Residential Use)
2016-09-08
362 - 376 Main Western Road, TAMBORINE MOUNTAIN QLD 4272
2016-09-16
MCBd16/093
Dual Occupancy (Residential Use)
2016-09-09
868 Lamington National Park Road, CANUNGRA QLD 4275
2016-09-16
MCBd16/094
Extension of time for Relevant Period - House (Residential Use) (Class 1a Secondary Dwelling and Class 10 Shed)
2016-09-15
429 Main Western Road, TAMBORINE MOUNTAIN QLD 4272
2016-09-16
OW.Bd2/000195
Earthworks
2016-09-16
106 - 110 Wongawallan Road, TAMBORINE MOUNTAIN QLD 4272
2016-09-16
MCBd16/095
Extension of Time for Relevant Period
2016-09-21
23 - 25 William Street, BEAUDESERT QLD 4285
2016-09-30
MCBd16/096
House (Residential Use)
2016-09-23
19 - 21 Power Parade, TAMBORINE MOUNTAIN QLD 4272
2016-09-30
RLBd16/020
Subdivision
2016-09-23
19 - 21 Power Parade, TAMBORINE MOUNTAIN QLD 4272
2016-09-30

Statistics

Average successful run time: 1 minute

Total run time: 15 days

Total cpu time used: 34 minutes

Total disk space used: 1.2 MB

History

  • Auto ran revision 22b17ecc and completed successfully .
    nothing changed in the database
  • Auto ran revision 22b17ecc and completed successfully .
    1 record added in the database
  • Auto ran revision 22b17ecc and completed successfully .
    nothing changed in the database
  • Auto ran revision 22b17ecc and completed successfully .
    nothing changed in the database
  • Auto ran revision 22b17ecc and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

scenic_rim / scraper.rb