ianheggie-oaf / BurdekinShire_DAs

Burdekin Shire Current Development Applications


Introduction

Welcome to the Burdekin, sugar capital of Australia and one of the most prosperous rural communities in the country. It's also one of the prettiest districts along the Queensland coast and boasts a stable population of warm, friendly and down-to-earth residents.

It scrapes data from: https://www.burdekin.qld.gov.au/Planning-building-and-development/Planning-and-Development/Development-applications/Current-development-applications

Install

bash bundle install

Run

bash bundle exec scraper.rb

Contributors PuZZleDucK mlandauer ianheggie-oaf equivalentideas benrfairless henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Installing bundler 2.3.10 [1G-----> Removing BUNDLED WITH version in the Gemfile.lock [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-3.2.2 [1G-----> Installing dependencies using bundler 2.3.10 [1G Running: BUNDLE_WITHOUT='development:test' BUNDLE_PATH=vendor/bundle BUNDLE_BIN=vendor/bundle/bin BUNDLE_DEPLOYMENT=1 bundle install -j4 [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching gem metadata from https://rubygems.org/.......... [1G Fetching rake 12.3.3 [1G Installing rake 12.3.3 [1G Fetching bigdecimal 3.3.1 [1G Fetching public_suffix 6.0.2 [1G Fetching ansi 1.5.0 [1G Fetching base64 0.3.0 [1G Installing bigdecimal 3.3.1 with native extensions [1G Installing base64 0.3.0 [1G Installing ansi 1.5.0 [1G Using bundler 2.4.10 [1G Fetching connection_pool 2.5.4 [1G Installing public_suffix 6.0.2 [1G Installing connection_pool 2.5.4 [1G Fetching rexml 3.4.4 [1G Fetching diff-lcs 1.6.2 [1G Installing rexml 3.4.4 [1G Fetching docile 1.4.1 [1G Installing diff-lcs 1.6.2 [1G Installing docile 1.4.1 [1G Fetching domain_name 0.6.20240107 [1G Fetching dotenv 3.1.8 [1G Installing dotenv 3.1.8 [1G Installing domain_name 0.6.20240107 [1G Fetching event_stream_parser 1.0.0 [1G Fetching uri 1.1.1 [1G Installing event_stream_parser 1.0.0 [1G Installing uri 1.1.1 [1G Fetching logger 1.7.0 [1G Fetching multipart-post 2.4.1 [1G Fetching json 2.16.0 [1G Installing logger 1.7.0 [1G Installing multipart-post 2.4.1 [1G Fetching hashdiff 1.2.1 [1G Installing json 2.16.0 with native extensions [1G Installing hashdiff 1.2.1 [1G Fetching mutex_m 0.3.0 [1G Installing mutex_m 0.3.0 [1G Fetching net-http-digest_auth 1.4.1 [1G Fetching mime-types-data 3.2025.0924 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching racc 1.8.1 [1G Installing mime-types-data 3.2025.0924 [1G Installing racc 1.8.1 with native extensions [1G Fetching webrick 1.9.1 [1G Installing webrick 1.9.1 [1G Fetching webrobots 0.1.2 [1G Installing webrobots 0.1.2 [1G Fetching rspec-support 3.13.6 [1G Installing rspec-support 3.13.6 [1G Fetching sqlite3 1.6.9 (x86_64-linux) [1G Installing sqlite3 1.6.9 (x86_64-linux) [1G Fetching simplecov-html 0.13.2 [1G Installing simplecov-html 0.13.2 [1G Fetching unicode-emoji 4.1.0 [1G Installing unicode-emoji 4.1.0 [1G Fetching timecop 0.9.10 [1G Installing timecop 0.9.10 [1G Fetching rubyntlm 0.6.5 [1G Installing rubyntlm 0.6.5 [1G Fetching vcr 6.3.1 [1G Installing vcr 6.3.1 [1G Fetching net-http-persistent 4.0.6 [1G Installing net-http-persistent 4.0.6 [1G Fetching addressable 2.8.7 [1G Fetching http-cookie 1.1.0 [1G Installing http-cookie 1.1.0 [1G Installing addressable 2.8.7 [1G Fetching net-http 0.7.0 [1G Installing net-http 0.7.0 [1G Fetching faraday-multipart 1.1.1 [1G Installing faraday-multipart 1.1.1 [1G Fetching httpclient 2.9.0 [1G Fetching mime-types 3.7.0 [1G Installing mime-types 3.7.0 [1G Installing httpclient 2.9.0 [1G Fetching rspec-core 3.13.6 [1G Installing rspec-core 3.13.6 [1G Fetching rspec-expectations 3.13.5 [1G Fetching rspec-mocks 3.13.7 [1G Installing rspec-expectations 3.13.5 [1G Installing rspec-mocks 3.13.7 [1G Fetching sqlite_magic 0.0.6 [1G Fetching simplecov 0.18.5 [1G Installing sqlite_magic 0.0.6 [1G Installing simplecov 0.18.5 [1G Fetching unicode-display_width 3.2.0 [1G Installing unicode-display_width 3.2.0 [1G Fetching nokogiri 1.15.7 (x86_64-linux) [1G Fetching faraday-net_http 3.4.2 [1G Installing faraday-net_http 3.4.2 [1G Fetching rspec 3.13.2 [1G Installing rspec 3.13.2 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching terminal-table 4.0.0 [1G Installing terminal-table 4.0.0 [1G Fetching simplecov-console 0.9.4 [1G Installing simplecov-console 0.9.4 [1G Installing nokogiri 1.15.7 (x86_64-linux) [1G Fetching mechanize 2.8.5 [1G Installing mechanize 2.8.5 [1G Fetching faraday 2.14.0 [1G Installing faraday 2.14.0 [1G Fetching ruby-anthropic 0.4.2 [1G Installing ruby-anthropic 0.4.2 [1G Fetching crack 1.0.1 [1G Installing crack 1.0.1 [1G Fetching webmock 3.26.1 [1G Installing webmock 3.26.1 [1G Bundle complete! 13 Gemfile dependencies, 55 gems now installed. [1G Gems in the groups 'development' and 'test' were not installed. [1G Bundled gems are installed into `./vendor/bundle` [1G Bundle completed (8.83s) [1G Cleaning up the bundler cache. [1G Removing bundler (2.3.10) [1G-----> Detecting rake tasks [1G [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Fetching page: https://www.burdekin.qld.gov.au/Planning-building-and-development/Planning-and-Development/Development-applications/Current-development-applications found 20 applications on page Storing RAL25/0015 - 397 Rita Island Road and 407 Rita Island Road, Jarvisfield QLD 4807: In Progress Storing MCU25/0014 - Mitchell Road, Clare QLD 4807: Decided Storing RAL25/0019 - 151 and 157 Burstall Road Airdmillan: In Progress Storing RAL25/0017 - 190 Marshall Road Osborne: In Progress Storing RAL25/0018 - 374 and 384 George Road Clare: In Progress Storing RAL25/0013 - 1/2 Wilmington Street and 2/19 Chippendale Street, Ayr QLD 4807: In Progress Storing MCU24/0014 - 60 Railway Street, Ayr: Decided Storing RAL25/0017 - 260 and 276 Hoey Road, Barratta: In Progress Storing RAL25/0008 - 613 Home Hil Kirknie Road, Osborne: Decided Storing MCU24/0013 - 171-185 Queen Street, Ayr: Decided Storing RAL25/0006 - 101 Anabranch Road, Jarvisfield: Decided Storing MCU24/0016 - 125 Edwards Street, Ayr: Decided Storing RAL25/0009 - 18 and 72 Tobruk Road, Mona Park: Decided Storing MCU24/0017 - 194 Phillips Camp Road, Jarvisfield: Decided Storing RAL25/0010 - 20 Queen Street, Ayr: In Progress Storing RAL25/0012 - 20, 38, 60 and 90 Colevale Road, Brandon: Decided Storing RAL25/0014 - 205 Sarri Road, Mount Surround QLD 4807: Decided Storing RAL25/0011 - 280 Ruddy Road & 32 McNeil Road, Jarvisfield: Decided Storing MCU23/0003 - 8-16 Eighth Avenue Home Hill: Decided Storing MCU25/0013 - 94 Macmillan Street, Ayr QLD 4807: Decided Scraping complete. Total records saved: 20

Data

Downloaded 275 times by ianheggie-oaf

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (24 KB) Use the API

rows 10 / 19

council_reference date_received address description status info_url comment_url date_scraped
RAL25/0015
2025-09-05
397 Rita Island Road and 407 Rita Island Road, Jarvisfield QLD 4807
In Progress
2025-11-11
MCU25/0014
2025-09-05
Mitchell Road, Clare QLD 4807
Decided
2025-11-11
RAL25/0019
2025-10-20
151 and 157 Burstall Road Airdmillan
In Progress
2025-11-11
RAL25/0018
2025-10-15
374 and 384 George Road Clare
In Progress
2025-11-11
RAL25/0013
2025-08-13
1/2 Wilmington Street and 2/19 Chippendale Street, Ayr QLD 4807
In Progress
2025-11-11
MCU24/0014
2024-08-12
60 Railway Street, Ayr
Decided
2025-11-11
RAL25/0017
2025-10-01
260 and 276 Hoey Road, Barratta
In Progress
2025-11-11
RAL25/0008
2025-05-30
613 Home Hil Kirknie Road, Osborne
Decided
2025-11-11
MCU24/0013
2024-08-07
171-185 Queen Street, Ayr
Decided
2025-11-11
RAL25/0006
2025-04-16
101 Anabranch Road, Jarvisfield
Decided
2025-11-11

Statistics

Average successful run time: less than a minute

Total run time: 2 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 61.3 KB

History

  • Manually ran revision a36c3d0e and completed successfully .
    19 records added, 19 records removed in the database
  • Manually ran revision 3ab57b00 and completed successfully .
    19 records added in the database
  • Created on morph.io

Scraper code

Ruby

BurdekinShire_DAs / scraper.rb