planningalerts-scrapers / cardinia

Cardinia Shire Council Planning Applications

Cardinia Council Scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - Yes
  • System - Unknown


Contributors flying-feline LoveMyData henare equivalentideas mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from  Fetching version metadata from  Fetching  Using bundler 1.15.2  Fetching unf_ext  Fetching httpclient  Fetching mime-types 2.5  Installing mime-types 2.5  Installing httpclient  Installing unf_ext with native extensions  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Installing net-http-persistent 2.9.4  Fetching ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing ntlm-http 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.10  Fetching nokogiri  Installing sqlite3 1.3.10 with native extensions  Installing nokogiri with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (21.20s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Scraping page... Saving record T210030, 35 Boundary Drain Road, Koo Wee Rup, VIC /app/vendor/bundle/ruby/2.3.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:91:in `initialize': database disk image is malformed (SQLite3::CorruptException) from /app/vendor/bundle/ruby/2.3.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:91:in `new' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:91:in `prepare' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:134:in `execute' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:93:in `block in save_data' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:88:in `each' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:88:in `save_data' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraperwiki-ruby-fc5017681250/lib/scraperwiki.rb:89:in `save_sqlite' from scraper.rb:25:in `block in scrape_page' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri- `block in each' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri- `upto' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri- `each' from scraper.rb:9:in `scrape_page' from scraper.rb:33:in `<main>'


Average successful run time: less than a minute

Total run time: 5 days

Total cpu time used: 36 minutes

Total disk space used: 239 KB


  • Auto ran revision fe679977 and failed .
  • Auto ran revision fe679977 and failed .
  • Auto ran revision fe679977 and failed .
  • Auto ran revision fe679977 and failed .
  • Auto ran revision fe679977 and failed .
  • ...
  • Created on

Show complete history

Scraper code


cardinia / scraper.rb