PuZZleDucK / BurdekinShire_DAs

Burdekin Shire Current Development Applications

Scrapes www.burdekin.qld.gov.au

Welcome to the Burdekin, sugar capital of Australia and one of the most prosperous rural communities in the country. It's also one of the prettiest districts along the Queensland coast and boasts a stable population of warm, friendly and down-to-earth residents.


Welcome to the Burdekin, sugar capital of Australia and one of the most prosperous rural communities in the country. It's also one of the prettiest districts along the Queensland coast and boasts a stable population of warm, friendly and down-to-earth residents.

It scrapes data from: http://www.burdekin.qld.gov.au/building-planning-and-infrastructure/town-planning/current-development-applications/

Contributors PuZZleDucK

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.1.2 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Fetching httpclient 2.6.0.1  Fetching mime-types 2.5  Installing httpclient 2.6.0.1  Installing mime-types 2.5  Installing unf_ext 0.0.7.1 with native extensions  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing net-http-persistent 2.9.4  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing ntlm-http 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.10  Fetching nokogiri 1.6.6.2  Installing sqlite3 1.3.10 with native extensions  Installing nokogiri 1.6.6.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (23.81s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 2 times by PuZZleDucK MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18 KB) Use the API

rows 10 / 45

council_reference address description info_url comment_url date_scraped
CONS15/0005
28 Osborne Road, Osborne
Material Change of Use for Light Industry (Manufacture of Fibreglass Boats)
2015-11-27
CONS15/0019
14-16 Albert Street, Ayr
Material Change of Use for Home Occupation (Beauty Therapy)
2015-11-27
CONS15/0020
11 Giddy Road, McDesme
Material Change of Use for General Industry
2015-11-27
CONS15/0021
6630 Ayr Dalbeg Road, Millaroo
Material Change of Use for Forestry
2015-12-02
CONS15/0022
6924 Ayr Dalbeg Road and Seton Road, Millaroo
Material Change of use for Forestry
2015-12-02
CONS15/0023
7061 Ayr Dalbeg Road, Millaroo
Material Change of Use for Forestry
2015-12-02
CONS15/0024
92 Stockyard, 53 & 101 Parkinson Roads, Dalbeg
Material Change of Use for Forestry
2015-12-02
CONS15/0025
8314 Ayr Dalbeg Road, Dalbeg
Material Change of Use for Forestry
2015-12-02
CONS15/0026
459 Trent Road, Alva
Material Change of Use for Astaxanthin processing facility (Moderate aquaculture operation)
2015-12-02
CONS15/0027
6 x 1 bedroom units) at 39 Queen Street, Ayr
Material Change of Use for a multi unit development (
2015-12-21

Statistics

Average successful run time: less than a minute

Total run time: about 13 hours

Total cpu time used: 14 minutes

Total disk space used: 43.1 KB

History

  • Auto ran revision e7640b0e and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision e7640b0e and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision e7640b0e and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision e7640b0e and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision e7640b0e and completed successfully .
    nothing changed in the database
    3 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

BurdekinShire_DAs / scraper.rb