openaustralia / PlanningAlerts_vanity_stats

The vanity weekly metrics displayed on the PlanningAlerts website

Scrapes www.planningalerts.org.au

A free service which searches Australian planning authority websites and emails you details of applications near you


This is a scraper that runs on Morph. To get started see the documentation

Contributors equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Installing coderay 1.1.1  Installing unf_ext 0.0.7.1 with native extensions  Installing httpclient 2.6.0.1  Installing mime-types 2.5  Installing net-http-digest_auth 1.4  Installing net-http-persistent 2.9.4  Installing mini_portile 0.6.2  Installing ntlm-http 0.1.1  Installing webrobots 0.1.1  Installing method_source 0.8.2  Installing slop 3.6.0  Installing sqlite3 1.3.10 with native extensions  Using bundler 1.11.2  Installing unf 0.1.4  Installing nokogiri 1.6.6.2 with native extensions  Installing pry 0.10.3  Installing sqlite_magic 0.0.3  Installing domain_name 0.5.24  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing http-cookie 1.0.2  Installing mechanize 2.7.3  Bundle complete! 3 Gemfile dependencies, 21 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (24.52s)  Cleaning up the bundler cache.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 2 times by henare handelaar

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (12 KB) Use the API

rows 10 / 171

date_scraped applications_added_in_last_week email_alerts_sent_in_last_week new_alert_subscriptions_in_last_week new_comments_made_in_last_week
2016-05-11
3094
95465
355
82
2016-05-12
3225
100266
362
79
2016-05-13
3166
100968
370
80
2016-05-14
3312
101233
384
76
2016-05-15
3373
102169
381
74
2016-05-16
3349
105175
411
79
2016-05-17
3314
104840
416
80
2016-05-18
3806
104974
467
79
2016-05-19
3797
104559
462
77
2016-05-20
3828
103257
492
78

Statistics

Average successful run time: half a minute

Total run time: about 2 hours

Total cpu time used: 4 minutes

Total disk space used: 46.7 KB

History

  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    544 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and failed .
    nothing changed in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    402 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    3 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    30 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and failed .
    nothing changed in the database
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    16 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    73 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    8 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    259 pages scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added, 1 record removed in the database
  • Manually ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Auto ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Manually ran revision c24458f3 and completed successfully .
    1 record added in the database
  • Created on morph.io