openaustralia / jacaranda

a watchful tree and slack messenger to keep you informed of the use of PlanningAlerts

README.md

Jacaranda

A watchful tree and slack messenger to keep you informed of the use of PlanningAlerts.

Working on PlanningAlerts over the last year we’ve noticed that:

We don’t have an accurate idea of the impact of PlanningAlerts, how many people are using it, or the rate a which this is changing; and
We feel more energised in our work when we get feedback about it’s use and impact.

Jacaranda is an experiment to see the impact of regular feedback on the people developing PlanningAlerts. It aims to keep you more informed of the use and impact of PlanningAlerts; to remind you of the effort you’ve put in to achieve this; and to do this in an quick and unobtrusive way.

Jacaranda collects information about people using PlanningAlerts and the work we do to make it better for them. It then sends a short fortnightly message to our Slack channel to give us a sense of how things are going.

Image of slack message from Jacaranda

This is a very basic start. We’ve interested to see how getting these messages impacts us and what we do with the information.

Currently Jacaranda tells you about:

the number of people who signed up for PlanningAlerts in the last fortnight;
the difference between this number and the figure for the previous fortnight;
the number of people who have unsubscribed in the last fortnight;
the difference between this number and the figure for the previous fortnight;
the number of commits pushed to the project in the last fortnight; and,
the total number of people now signed up to PlanningAlerts.

While the number of users isn’t a great measure of PlanningAlerts’ impact, it’s a start to see how the feedback works for us. Feel free to change the text or the information in presents to what you think will have a better impact.

Caveats

The time frames that this claims to show subscribers for aren’t accurate because they're displayed as it they were recorded in local time, but they're actually counted in UTC.

Usage

This program depends on three environment variables:

GitHub OAuth token for your github account
Slack channel webhook url to post the message to
Live mode to make it actually post to the Slack channel #townsquare and save to the database

In local development you can add these to a .env file and use dotenv to load them as the scraper runs:

MORPH_SLACK_CHANNEL_WEBHOOK_URL="https://hooks.slack.com/services/XXXXXXXXXXXXX" MORPH_GITHUB_OAUTH_ACCESS_TOKEN=XXXXXXXXXXXXXXXXXXXXXXXXXXXXX MORPH_LIVE_MODE=false

Create a .env file using the example provided by running cp .env.example .env.

Running this on morph.io

You can also run this as a scraper on Morph. To get started see the documentation

Image credit

The Jacaranda Slack avatar is cropped from a photograph of the Jacaranda trees on Gowrie St, Newtown, Sydney by Flickr user murry. Thanks murry for making it available under a creative commons license.

Contributors

Last run completed successfully 2017-05-28.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.0.0-p648 [1G-----> Installing dependencies using bundler 1.13.7 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/.. [1G Fetching dependency metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation. [1G Installing i18n 0.7.0 [1G Installing json 1.8.3 with native extensions [1G Installing minitest 5.9.0 [1G Installing thread_safe 0.3.5 [1G Installing addressable 2.4.0 [1G Installing unf_ext 0.0.7.1 with native extensions [1G Installing multipart-post 2.0.0 [1G Installing httpclient 2.6.0.1 [1G Installing mime-types 2.5 [1G Installing net-http-digest_auth 1.4 [1G Installing net-http-persistent 2.9.4 [1G Installing mini_portile2 2.1.0 [1G Installing pkg-config 1.1.7 [1G Installing ntlm-http 0.1.1 [1G Installing webrobots 0.1.1 [1G Installing sqlite3 1.3.10 with native extensions [1G Using bundler 1.13.7 [1G Installing tzinfo 1.2.2 [1G Installing unf 0.1.4 [1G Installing faraday 0.9.2 [1G Installing rest-client 1.6.7 [1G Installing nokogiri 1.6.8 with native extensions [1G Installing sqlite_magic 0.0.3 [1G Installing activesupport 4.2.7.1 [1G Installing domain_name 0.5.24 [1G Installing sawyer 0.7.0 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing http-cookie 1.0.2 [1G Installing octokit 4.3.0 [1G Installing mechanize 2.7.3 [1G Bundle complete! 8 Gemfile dependencies, 30 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (35.70s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... In live mode, this will post to Slack and save to the db Check if it has collected data in the last fortnight "I’ve already spoken to the team this fortnight"

Data

Downloaded 1 time by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (9 KB) Use the API

rows 10 / 19

date_posted	text
2016-08-29	700 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 6% down from the fortnight before. You shipped 26 commits in the same period. There are now 36.8 thousand PlanningAlerts subscribers! :star2:
2016-09-12	705 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 3% up from the fortnight before. You shipped 1 commits in the same period. There are now 37.4 thousand PlanningAlerts subscribers! :star2:
2016-09-26	746 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 6% up from the fortnight before. You shipped 13 commits in the same period. There are now 38 thousand PlanningAlerts subscribers! :star2:
2016-10-10	728 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 0% down from the fortnight before. There are now 38.6 thousand PlanningAlerts subscribers! :star2:
2016-10-25	745 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 5% up from the fortnight before. There are now 39.3 thousand PlanningAlerts subscribers! :star2:
2016-11-09	743 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 1% less than the fortnight before. 180 people left :scream_cat: That’s 4% more than the fortnight before. You shipped 27 commits in the same period. There are now 39.9 thousand PlanningAlerts subscribers! :star2:
2016-11-25	678 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 10% less than the fortnight before. 177 people left :scream_cat: That’s 3% less than the fortnight before. There are now 40.5 thousand PlanningAlerts subscribers! :star2:
2016-12-10	745 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 9% more than the fortnight before. 175 people left. That’s 1% less than the fortnight before. You shipped 3 commits in the same period. There are now 41.1 thousand PlanningAlerts subscribers! :star2:
2016-12-24	639 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 14% less than the fortnight before. 189 people left. That’s 7% more than the fortnight before. There are now 41.6 thousand PlanningAlerts subscribers! :star2:
2017-01-11	552 people signed up for PlanningAlerts last fortnight :revolving_hearts: That’s 2% less than the fortnight before. 94 people left. That’s 37% less than the fortnight before. You shipped 69 commits in the same period. There are now 42.2 thousand PlanningAlerts subscribers! :star2:

Statistics

Average successful run time: less than a minute

Total run time: 8 days

Total cpu time used: 5 minutes

Total disk space used: 207 KB

History

Auto ran revision 1951df3a and completed successfully 2017-05-28.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-27.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-26.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-25.

run time 58 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-24.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-23.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-22.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-21.

run time 3 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-20.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-19.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-18.

run time 3 minutes

1 record added in the database
Auto ran revision 1951df3a and completed successfully 2017-05-17.

run time 48 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-16.

run time 46 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-15.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-14.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-13.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-12.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-11.

run time 56 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-10.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-09.

run time 45 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-08.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-07.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-06.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-05.

run time 57 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-04.

run time 2 minutes

1 record added in the database
Auto ran revision 1951df3a and completed successfully 2017-05-03.

run time 46 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-02.

run time 48 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-05-01.

run time 58 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-30.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-29.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-28.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-27.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-26.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-25.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-24.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-23.

run time 3 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-22.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-21.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-20.

run time 2 minutes

1 record added in the database
Auto ran revision 1951df3a and completed successfully 2017-04-19.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-18.

run time 53 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-17.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-16.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-15.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-14.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-13.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-12.

run time 46 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-11.

run time 57 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-10.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-09.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-08.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-07.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-06.

run time 2 minutes

1 record added in the database
Auto ran revision 1951df3a and completed successfully 2017-04-05.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-04.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-03.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-04-02.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-31.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-31.

run time 3 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-30.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-29.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-28.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-27.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-26.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-25.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-24.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-23.

run time 2 minutes

1 record added in the database
Auto ran revision 1951df3a and completed successfully 2017-03-22.

run time 53 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-21.

run time 5 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-21.

run time 2 minutes

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-19.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-17.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-17.

run time 53 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-16.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-15.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-14.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-13.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-10.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-09.

run time 2 minutes

1 record added in the database

4 pages scraped
Auto ran revision 1951df3a and completed successfully 2017-03-08.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-07.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-06.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-05.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-04.

run time 44 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-03.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-02.

run time 3 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-03-02.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-28.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-27.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-26.

run time 53 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-25.

run time 41 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-24.

run time 3 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-23.

run time 2 minutes

1 record added in the database

5 pages scraped
Auto ran revision 1951df3a and completed successfully 2017-02-22.

run time 2 minutes

nothing changed in the database

5 pages scraped
Auto ran revision 1951df3a and completed successfully 2017-02-21.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-20.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-19.

run time 48 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-18.

run time 48 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-17.

run time 49 s

nothing changed in the database

9 pages scraped
Auto ran revision 1951df3a and completed successfully 2017-02-15.

run time 45 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-15.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-14.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-13.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-11.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-10.

run time 4 minutes

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-09.

run time 44 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-08.

run time 11 minutes

1 record added in the database
Auto ran revision 1951df3a and completed successfully 2017-02-07.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-06.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-05.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-04.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-03.

run time 53 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-02-02.

run time 45 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2017-02-01.

run time 2 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-31.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-30.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-27.

run time 50 s

nothing changed in the database
Auto ran and failed 2017-01-27.

run time 0 s
Auto ran revision 1951df3a and completed successfully 2017-01-25.

run time 2 minutes

1 record added in the database

4 pages scraped
Auto ran revision 1951df3a and failed 2017-01-24.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-23.

run time 5 s

nothing changed in the database

3 pages scraped
Auto ran revision 1951df3a and failed 2017-01-22.

run time 2 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2017-01-19.

run time 40 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2017-01-18.

run time 42 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2017-01-16.

run time 1 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-16.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-14.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2017-01-11.

run time 2 minutes

1 record added in the database

6 pages scraped
Auto ran revision 1951df3a and failed 2017-01-11.

run time 8 days
Auto ran revision 1951df3a and failed 2017-01-02.

run time 3 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2016-12-31.

run time 42 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-30.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-29.

run time 45 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-28.

run time 54 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-27.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-26.

run time 50 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-25.

run time 51 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-24.

run time 2 minutes

1 record added in the database

4 pages scraped
Auto ran revision 1951df3a and completed successfully 2016-12-23.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-22.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-21.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-20.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-19.

run time 43 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-18.

run time 42 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2016-12-16.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-16.

run time 56 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2016-12-15.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-13.

run time 1 minute

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-12.

run time 46 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-11.

run time 49 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-10.

run time 2 minutes

1 record added in the database
Auto ran revision 1951df3a and failed 2016-12-09.

run time 3 minutes

nothing changed in the database

4 pages scraped
Auto ran revision 1951df3a and completed successfully 2016-12-08.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-07.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-06.

run time 48 s

nothing changed in the database
Auto ran and failed 2016-12-05.

run time 0 s
Auto ran revision 1951df3a and completed successfully 2016-12-04.

run time 47 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-03.

run time 48 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-12-02.

run time 52 s

nothing changed in the database
Auto ran revision 1951df3a and failed 2016-12-01.

run time 4 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-11-30.

run time 55 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-11-29.

run time 44 s

nothing changed in the database
Auto ran revision 1951df3a and completed successfully 2016-11-28.

run time 47 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-27.

run time 46 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-26.

run time 47 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-25.

run time 1 minute

1 record added in the database

4 pages scraped
Auto ran revision 6b9ef336 and completed successfully 2016-11-25.

run time 2 minutes

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-21.

run time 46 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-20.

run time 44 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-19.

run time 42 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-18.

run time 59 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-17.

run time 43 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-16.

run time 48 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-15.

run time 46 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-15.

run time 45 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-13.

run time 48 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-12.

run time 41 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-11.

run time 50 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-10.

run time 45 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-09.

run time 2 minutes

1 record added in the database

4 pages scraped
Auto ran revision 6b9ef336 and failed 2016-11-08.

run time 3 minutes

nothing changed in the database

4 pages scraped
Auto ran revision 6b9ef336 and completed successfully 2016-11-07.

run time 47 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-06.

run time 42 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-05.

run time 46 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-04.

run time 43 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-03.

run time 46 s

nothing changed in the database
Auto ran revision 6b9ef336 and completed successfully 2016-11-02.

run time 49 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-11-01.

run time 48 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-31.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 49bda9c6 and completed successfully 2016-10-30.

run time 49 s

nothing changed in the database

80 pages scraped
Auto ran revision 49bda9c6 and completed successfully 2016-10-28.

run time 45 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-28.

run time 44 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-27.

run time 53 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-26.

run time 50 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-25.

run time 2 minutes

1 record added in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-24.

run time 2 minutes

nothing changed in the database

5 pages scraped
Auto ran revision 49bda9c6 and completed successfully 2016-10-23.

run time 41 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-22.

run time 54 s

nothing changed in the database

62 pages scraped
Auto ran revision 49bda9c6 and completed successfully 2016-10-22.

run time 40 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-20.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-19.

run time 49 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-18.

run time 52 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-17.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-16.

run time 50 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-15.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-14.

run time 50 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-13.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-12.

run time 1 minute

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-11.

run time 44 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-10.

run time 2 minutes

1 record added in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-09.

run time 43 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-08.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-06.

run time 48 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-06.

run time 50 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-05.

run time 1 minute

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-04.

run time 44 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-03.

run time 44 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-02.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-10-01.

run time 4 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-30.

run time 55 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-29.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-28.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-27.

run time 45 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-26.

run time 2 minutes

1 record added in the database

5 pages scraped
Auto ran revision 49bda9c6 and completed successfully 2016-09-25.

run time 45 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-24.

run time 3 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-23.

run time 3 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-22.

run time 47 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-21.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-20.

run time 4 s

nothing changed in the database

30 pages scraped
Auto ran revision 49bda9c6 and completed successfully 2016-09-19.

run time 45 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-18.

run time 48 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-17.

run time 43 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-16.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-15.

run time 48 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-14.

run time 1 minute

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-13.

run time 45 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-12.

run time 2 minutes

1 record added in the database

5 pages scraped
Auto ran revision 49bda9c6 and completed successfully 2016-09-11.

run time 4 s

nothing changed in the database

1 page scraped
Auto ran revision 49bda9c6 and completed successfully 2016-09-10.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-09.

run time 44 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-08.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-07.

run time 51 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-05.

run time 3 minutes

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-04.

run time 3 minutes

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-03.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-02.

run time 49 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-09-01.

run time 45 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-08-31.

run time 4 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-08-30.

run time 46 s

nothing changed in the database
Auto ran revision 49bda9c6 and completed successfully 2016-08-29.

run time 54 s

nothing changed in the database
Manually ran revision 49bda9c6 and completed successfully 2016-08-29.

run time 2 minutes

1 record added in the database

5 pages scraped
Manually ran and failed 2016-08-29.

run time 0 s
Manually ran revision f422cfcb and completed successfully 2016-08-29.

run time 1 minute

1 record added in the database

1300 pages scraped
Manually ran and failed 2016-08-29.

run time 0 s
Manually ran and failed 2016-08-29.

run time 0 s
Manually ran and failed 2016-08-29.

run time 0 s
Manually ran revision 0b9fcd74 and completed successfully 2016-08-29.

run time 2 minutes

1 record added in the database

5 pages scraped
Manually ran revision 0b9fcd74 and failed 2016-08-29.

run time 2 minutes

nothing changed in the database

4 pages scraped
Manually ran revision e2550979 and failed 2016-08-29.

run time 45 s

nothing changed in the database
Manually ran revision eed3cf9e and failed 2016-08-29.

run time 53 s

nothing changed in the database
Created on morph.io 2016-08-28

Scraper code

Ruby

jacaranda / scraper.rb

git clone URL