planningalerts-scrapers / scenic_rim

Scenic Rim Regional Council Development Applications

Scrapes srr-prod-icon.saas.t1cloud.com, www.bbc.co.uk, and www.bbc.com

Terms and Conditions


Scenic Rim Regional council scraper

This site is a typical .NET ICON site * Terms to agreed - Yes * Cookie - Yes * XML - Yes

Enjoy

Forked from ScraperWiki

Contributors mlandauer emikulic equivalentideas LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Fetching httpclient 2.6.0.1  Fetching mime-types 2.6.1  Installing httpclient 2.6.0.1  Installing mime-types 2.6.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Installing net-http-digest_auth 1.4  Fetching webrobots 0.1.1  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Installing webrobots 0.1.1  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.5  Installing sqlite_magic 0.0.5  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (25.55s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record MCU18/118 Skipping already saved record MCU18/119 Skipping already saved record MCU18/120 Skipping already saved record RAL18/044 Skipping already saved record BuildEnv18/014 Skipping already saved record MCU18/121 Skipping already saved record POS18/048 Skipping already saved record RAL18/045 Skipping already saved record MCU18/122 Skipping already saved record MCU18/123 Skipping already saved record MCU18/124 Skipping already saved record POS18/049 Skipping already saved record POS18/050 Skipping already saved record MCU18/125 Skipping already saved record BuildEnv18/015 Skipping already saved record MCU18/126 Skipping already saved record MCU18/127 Skipping already saved record MCU18/128 Skipping already saved record MCU18/129 Skipping already saved record MCU18/130 Skipping already saved record POS18/051 Skipping already saved record OPW18/029 Skipping already saved record RAL18/046 Skipping already saved record RAL18/047 Skipping already saved record MCU18/131 Skipping already saved record OPW18/030 Skipping already saved record POS18/052 Skipping already saved record RAL18/048 Skipping already saved record RAL18/049 Skipping already saved record POS18/053 Skipping already saved record POS18/054 Skipping already saved record POS18/055 Skipping already saved record RAL18/050 Skipping already saved record MCU18/132 Skipping already saved record MCU18/133 Skipping already saved record RAL18/051

Data

Downloaded 1534 times by openaustralia LoveMyData TheZepto jesse-a-reilly stevebrencorp MikeRalphson spatialsteve

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (405 KB) Use the API

rows 10 / 1194

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Impact Assessment: Tourist Cabins (Tourist Use) (20 Tourist Cabins and Associated Buildings and Infrastructure) and Environmentally Relevant Activiey (ERA 63(2)(a) - Sewage Treatment Plant with Total Daily Peak Design Capacity of 21 EP to 100EP)
2011-08-09
MC.Bd211/00066
43 Justin Avenue, NORTH TAMBORINE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - House Residential Use
2011-08-12
MC.Bd211/00067
507 Round Mountain Road, JOSEPHVILLE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Impact Assessment - Utility Major
2011-08-16
MC.Bd211/00068
61 - 63 Brooks Drive, KOORALBYN, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment House residential use
2011-08-23
MC.Bd211/00069
8373 Mt Lindesay Highway, JOSEPHVILLE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - Second Dwelling
2011-08-24
MC.Bd211/00070
83 Windabout Road, BEECHMONT, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - Dwelling
2011-08-26
MC.Bd211/00071
247 - 249 Guanaba Road, MOUNT TAMBORINE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - House (Residential Use)
2011-08-29
MC.Bd211/00073
12A Coomera Gorge Drive, MOUNT TAMBORINE, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment - Accommodation facilities for the handicapped
2011-08-30
MC.Bd211/00072
2 - 4 Davis Street, BEAUDESERT, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Code Assessment
2011-08-19
OW.Bd2/000050
1 - 5 McKee Street, BEAUDESERT, QLD
mailto:mail@scenicrim.qld.gov.au
2011-09-11
Impact Inconsistent Assessment- Boundary Re-alignment
2011-08-10
RL.Bn/00044
Ipswich Boonah Road, COULSON, QLD
mailto:mail@scenicrim.qld.gov.au

Statistics

Average successful run time: less than a minute

Total run time: 11 days

Total cpu time used: 33 minutes

Total disk space used: 890 KB

History

  • Auto ran revision 98a8c422 and completed successfully .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 98a8c422 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 98a8c422 and completed successfully .
    2 records added in the database
    4 pages scraped
  • Auto ran revision 98a8c422 and completed successfully .
    1 record added in the database
    4 pages scraped
  • Auto ran revision 98a8c422 and completed successfully .
    1 record added in the database
    4 pages scraped
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

scenic_rim / scraper.rb