planningalerts-scrapers / sorell

A Sorell Council web scraper for OpenAustralia's PlanningAlerts website


Contributors hailspuds CloCkWeRX henare mlandauer ianheggie-oaf jamezpolley benrfairless

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Installing bundler 2.3.10 [1G-----> Removing BUNDLED WITH version in the Gemfile.lock [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-3.2.2 [1G-----> Installing dependencies using bundler 2.3.10 [1G Running: BUNDLE_WITHOUT='development:test' BUNDLE_PATH=vendor/bundle BUNDLE_BIN=vendor/bundle/bin BUNDLE_DEPLOYMENT=1 bundle install -j4 [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 2.4.10 [1G Fetching connection_pool 3.0.2 [1G Fetching public_suffix 7.0.5 [1G Fetching base64 0.3.0 [1G Fetching domain_name 0.6.20240107 [1G Installing base64 0.3.0 [1G Installing connection_pool 3.0.2 [1G Fetching logger 1.7.0 [1G Fetching mutex_m 0.3.0 [1G Installing domain_name 0.6.20240107 [1G Installing public_suffix 7.0.5 [1G Installing mutex_m 0.3.0 [1G Fetching mime-types-data 3.2026.0701 [1G Installing logger 1.7.0 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching nkf 0.3.0 [1G Fetching racc 1.8.1 [1G Installing mime-types-data 3.2026.0701 [1G Fetching webrick 1.9.2 [1G Installing racc 1.8.1 with native extensions [1G Installing nkf 0.3.0 with native extensions [1G Installing webrick 1.9.2 [1G Fetching webrobots 0.1.2 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 2.2.0 (x86_64-linux-gnu) [1G Fetching net-http-persistent 4.0.8 [1G Installing net-http-persistent 4.0.8 [1G Fetching rubyntlm 0.6.5 [1G Installing rubyntlm 0.6.5 [1G Fetching httpclient 2.9.0 [1G Installing httpclient 2.9.0 [1G Installing sqlite3 2.2.0 (x86_64-linux-gnu) [1G Fetching http-cookie 1.1.6 [1G Installing http-cookie 1.1.6 [1G Fetching addressable 2.9.0 [1G Installing addressable 2.9.0 [1G Fetching mime-types 3.7.0 [1G Installing mime-types 3.7.0 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching nokogiri 1.17.2 (x86_64-linux) [1G Installing nokogiri 1.17.2 (x86_64-linux) [1G Fetching mechanize 2.14.0 [1G Installing mechanize 2.14.0 [1G Bundle complete! 4 Gemfile dependencies, 24 gems now installed. [1G Gems in the groups 'development' and 'test' were not installed. [1G Bundled gems are installed into `./vendor/bundle` [1G Bundle completed (6.30s) [1G Cleaning up the bundler cache. [1G Removing bundler (2.3.10) [1G-----> Detecting rake tasks [1G [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Saving 256-1 Saving 260-1 Saving 264-1 Saving 265-1 Saving 288-1 Saving 289-1 Saving 245-1 Saving 286-1 Saving 254-1 Saving 249-1 Saving 137-1 Saving 285-1 Saving 261-1 Saving 149-1

Data

Downloaded 5400 times by openaustralia mlandauer dcalde LoveMyData jesse-a-reilly tkrikke repose-lecture TheZepto Manasaanand qs4v8thvrq-boop 538digital planometric-vic TazzieFez Jedwards157 roystontyk

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (680 KB) Use the API

rows 10 / 835

info_url comment_url council_reference on_notice_to address description date_scraped
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.123.1+Development+Application+3+Linden+Road%2C+Primrose+Sands
5.2020.123.1 Development Application 3 Linden Road, Primrose Sands
2020-07-27T00:00:00+00:00
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.133.1+Development+Application+9+Valley+View+Close%2C+Sorell
5.2020.133.1 Development Application 9 Valley View Close, Sorell
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.138.1+Development+Application
5.2020.138.1 Development Application
4 Esther Court, Dodges Ferry, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.163.1+Development+Application+108+Weston+Hill+Road+Sorell+Representation+Close+Monday+10th+August+2020
5.2020.163.1 Development Application 108 Weston Hill Road Sorell Representation Close Monday 10th August 2020
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.164.1+Development+Application+5+Shoalwater+Way%2C+Midway+Point
5.2020.164.1 Development Application 5 Shoalwater Way, Midway Point
2020-07-27T00:00:00+00:00
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.166.1+Development+Application+646+Shark+Point+Road%2C+Penna
5.2020.166.1 Development Application 646 Shark Point Road, Penna
2020-07-27T00:00:00+00:00
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.173.1+Development+Application+184+Gillingbrook+Road%2C+Forcett
5.2020.173.1 Development Application 184 Gillingbrook Road, Forcett
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.174.1+Development+Application+238+Marion+Bay+Road%2C+Bream+Creek
5.2020.174.1 Development Application 238 Marion Bay Road, Bream Creek
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.175.1+Development+Application+31+Abruzzi+Court%2C+Orielton
5.2020.175.1 Development Application 31 Abruzzi Court, Orielton
, TAS
Description not available. See 'Read more information' link.
2020-08-10
mailto:sorell.council@sorell.tas.gov.au?subject=Development+Application+Enquiry%3A+5.2020.180.1+Development+Application+139+Lewisham+Road%2C+Forcett
5.2020.180.1 Development Application 139 Lewisham Road, Forcett
, TAS
Description not available. See 'Read more information' link.
2020-08-10

Statistics

Average successful run time: less than a minute

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 864 KB

History

  • Auto ran revision f07d3f71 and completed successfully .
    14 records added, 14 records removed in the database
  • Auto ran revision f07d3f71 and completed successfully .
    14 records added, 14 records removed in the database
  • Auto ran revision f07d3f71 and completed successfully .
    23 records added, 23 records removed in the database
  • Auto ran revision f07d3f71 and completed successfully .
    23 records added, 23 records removed in the database
  • Auto ran revision f07d3f71 and completed successfully .
    23 records added, 23 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

sorell / scraper.rb