openaustralia / planningalerts_coverage

The number of authorities in PlanningAlerts and the claimed percentage of the population who live in them

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.0.0 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation. [1G Using bundler 1.15.2 [1G Fetching unf_ext 0.0.7.1 [1G Installing unf_ext 0.0.7.1 with native extensions [1G Fetching httpclient 2.6.0.1 [1G Installing httpclient 2.6.0.1 [1G Fetching mime-types 2.5 [1G Installing mime-types 2.5 [1G Fetching net-http-digest_auth 1.4 [1G Installing net-http-digest_auth 1.4 [1G Fetching net-http-persistent 2.9.4 [1G Installing net-http-persistent 2.9.4 [1G Fetching mini_portile 0.6.2 [1G Installing mini_portile 0.6.2 [1G Fetching ntlm-http 0.1.1 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.1 [1G Installing webrobots 0.1.1 [1G Fetching sqlite3 1.3.10 [1G Installing sqlite3 1.3.10 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching nokogiri 1.6.6.2 [1G Installing nokogiri 1.6.6.2 with native extensions [1G Fetching sqlite_magic 0.0.3 [1G Installing sqlite_magic 0.0.3 [1G Fetching domain_name 0.5.24 [1G Installing domain_name 0.5.24 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching http-cookie 1.0.2 [1G Installing http-cookie 1.0.2 [1G Fetching mechanize 2.7.3 [1G Installing mechanize 2.7.3 [1G Bundle complete! 2 Gemfile dependencies, 17 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (14.10s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... {:date_scraped=>"2024-04-20", :percentage_of_population_convered=>86, :number_of_authorities=>194}

Data

Downloaded 4 times by odnagroup has-taiar MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (121 KB) Use the API

rows 10 / 2650

date_scraped percentage_of_population_convered number_of_authorities
2016-05-27
65
146
2016-05-28
65
146
2016-05-29
65
146
2016-05-30
65
146
2016-05-31
65
146
2016-06-01
65
146
2016-06-02
65
146
2016-06-03
65
146
2016-06-04
65
146
2016-06-05
65
146

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 143 KB

History

  • Auto ran revision 7201d616 and completed successfully .
    1 record added in the database
  • Auto ran revision 7201d616 and completed successfully .
    1 record added in the database
  • Auto ran revision 7201d616 and completed successfully .
    1 record added in the database
  • Auto ran revision 7201d616 and completed successfully .
    1 record added in the database
  • Auto ran revision 7201d616 and completed successfully .
    1 record added in the database
  • ...
  • Created on morph.io

Show complete history