jeremyw24 / charters_towers

Charters Towers Regional Council Development Applications


Development applications for PlanningAlerts

Contributors CloCkWeRX henare mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.6  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Fetching mime-types-data 3.2019.0331  Installing httpclient 2.8.3  Installing unf_ext 0.0.7.6 with native extensions  Installing mime-types-data 3.2019.0331  Fetching net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Installing mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Installing net-http-digest_auth 1.4.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Fetching sqlite3 1.4.1  Installing webrobots 0.1.2  Installing sqlite3 1.4.1 with native extensions  Fetching net-http-persistent 3.1.0  Installing net-http-persistent 3.1.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.3  Installing nokogiri 1.10.3 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20190701  Installing domain_name 0.5.20190701  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (27.28s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Saving record MC17/10, 20 Vulture Street, Charters Towers City    Qld    4820 , QLD /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.6/lib/sqlite_magic.rb:100:in `block in save_data': Data has nil value for unique key. Unique keys are [:council_reference]. Offending data: {"council_reference"=>"MC17/10", "date_received"=>"2017-01-27", "description"=>" Material Change of Use Home Occupation (Massage Therapy) ", "address"=>" 20 Vulture Street, Charters Towers City    Qld    4820 , QLD", "info_url"=>"http://www.charterstowers.qld.gov.au/recently-submitted-applications", "comment_url"=>"mailto:mail@charterstowers.qld.gov.au", "date_scraped"=>"2019-08-11"} (SqliteMagic::DatabaseError) from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.6/lib/sqlite_magic.rb:97:in `each' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.6/lib/sqlite_magic.rb:97:in `save_data' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraperwiki-ruby-fc5017681250/lib/scraperwiki.rb:89:in `save_sqlite' from scraper.rb:31:in `block in <main>' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.10.3/lib/nokogiri/xml/node_set.rb:238:in `block in each' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.10.3/lib/nokogiri/xml/node_set.rb:237:in `upto' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.10.3/lib/nokogiri/xml/node_set.rb:237:in `each' from scraper.rb:12:in `each_with_index' from scraper.rb:12:in `<main>'

Statistics

Total run time: 1 minute

Total cpu time used: less than 5 seconds

Total disk space used: 25.6 KB

History

  • Manually ran revision 0fb34f9b and failed .
    nothing changed in the database
  • Manually ran revision 3c31f9a3 and failed .
  • Created on morph.io

Scraper code

Ruby

charters_towers / scraper.rb