djkencloud / daily_fire_ratings_tutorial
Tutorial on daily fire ratings - Sept2015
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.2.1
[1G-----> Installing dependencies using bundler 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Fetching gem metadata from https://rubygems.org/........
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Using bundler 1.15.2
[1G Fetching unf_ext 0.0.7.1
[1G Fetching httpclient 2.6.0.1
[1G Fetching mime-types 2.5
[1G Installing mime-types 2.5
[1G Installing httpclient 2.6.0.1
[1G Fetching net-http-digest_auth 1.4
[1G Installing unf_ext 0.0.7.1 with native extensions
[1G Installing net-http-digest_auth 1.4
[1G Fetching net-http-persistent 2.9.4
[1G Fetching mini_portile 0.6.2
[1G Installing net-http-persistent 2.9.4
[1G Installing mini_portile 0.6.2
[1G Fetching ntlm-http 0.1.1
[1G Fetching webrobots 0.1.1
[1G Installing ntlm-http 0.1.1
[1G Installing webrobots 0.1.1
[1G Fetching sqlite3 1.3.10
[1G Fetching nokogiri 1.6.6.2
[1G Installing sqlite3 1.3.10 with native extensions
[1G Installing nokogiri 1.6.6.2 with native extensions
[1G Fetching unf 0.1.4
[1G Installing unf 0.1.4
[1G Fetching domain_name 0.5.24
[1G Installing domain_name 0.5.24
[1G Fetching http-cookie 1.0.2
[1G Installing http-cookie 1.0.2
[1G Fetching sqlite_magic 0.0.3
[1G Installing sqlite_magic 0.0.3
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Fetching mechanize 2.7.3
[1G Installing mechanize 2.7.3
[1G Bundle complete! 2 Gemfile dependencies, 17 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (24.14s)
[1G Cleaning up the bundler cache.
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Far North Coast", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"North Coast", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Bellingen; Coffs Harbour; Port Macquarie-Hastings; Kempsey; Nambucca; Mid-Coast"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Greater Hunter", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Greater Sydney Region", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"The Hills; Blacktown; Blue Mountains; Burwood; Camden; Campbelltown; Canada Bay; Fairfield; Hawkesbury; Hornsby; Hunters Hill; Kogarah; Ku-ring-gai; Lane Cove; Liverpool; Mosman; North Sydney; Parramatta; Penrith; Randwick; Ryde; Strathfield; Sutherland; Sydney; Waverley; Willoughby; Woollahra; Bayside; Canterbury-Bankstown; Central Coast; Cumberland; Georges River; Inner West; Northern Beaches"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Illawarra/Shoalhaven", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Far South Coast", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Bega Valley; Eurobodalla"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Monaro Alpine", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Snowy Monaro"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"ACT", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>""}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Southern Ranges", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Goulburn Mulwaree; Upper Lachlan; Yass Valley; Queanbeyan-Palerang"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Central Ranges", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"New England", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Glen Innes Severn; Tenterfield; Uralla; Walcha; Armidale"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Northern Slopes", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Gunnedah; Gwydir; Inverell; Liverpool Plains; Tamworth"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"North Western", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Moree Plains; Narrabri; Walgett; Warrumbungle"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Upper Central West Plains", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Bogan; Coonamble; Gilgandra; Warren"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Lower Central West Plains", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Bland; Forbes; Lachlan; Narromine; Parkes; Temora; Weddin; Dubbo"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Southern Slopes", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Cootamundra-Gundagai; Hilltops; Snowy Valleys"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Eastern Riverina", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Albury; Coolamon; Greater Hume; Junee; Lockhart; Wagga Wagga"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Southern Riverina", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Berrigan; Edward River; Federation; Murray River; Southern parts of Murrumbidgee"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Northern Riverina", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Carrathool; Griffith; Hay; Leeton; Narrandera; Northern parts of Murrumbidgee"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"South Western", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Balranald; Wentworth"}
{:date_scraped=>#<Date: 2019-06-04 ((2458639j,0s,0n),+0s,2299161j)>, :name=>"Far Western", :dangerToday=>"None", :toBanToday=>"No ", :fireDangerTomorrow=>"None", :toBanTomorrow=>"No", :councils=>"Bourke; Brewarrina; Broken Hill; Central Darling; Cobar"}
done
Data
Downloaded
4 times
by
To download data sign in with GitHub
rows 10 / 21
| date_scraped | name | dangerToday | toBanToday | fireDangerTomorrow | toBanTomorrow | councils |
|---|---|---|---|---|---|---|
| date_scraped
2019-06-04
|
name
Far North Coast
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed
|
| date_scraped
2019-06-04
|
name
North Coast
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Bellingen; Coffs Harbour; Port Macquarie-Hastings; Kempsey; Nambucca; Mid-Coast
|
| date_scraped
2019-06-04
|
name
Greater Hunter
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter
|
| date_scraped
2019-06-04
|
name
Greater Sydney Region
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
The Hills; Blacktown; Blue Mountains; Burwood; Camden; Campbelltown; Canada Bay; Fairfield; Hawkesbury; Hornsby; Hunters Hill; Kogarah; Ku-ring-gai; Lane Cove; Liverpool; Mosman; North Sydney; Parramatta; Penrith; Randwick; Ryde; Strathfield; Sutherland; Sydney; Waverley; Willoughby; Woollahra; Bayside; Canterbury-Bankstown; Central Coast; Cumberland; Georges River; Inner West; Northern Beaches
|
| date_scraped
2019-06-04
|
name
Illawarra/Shoalhaven
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong
|
| date_scraped
2019-06-04
|
name
Far South Coast
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Bega Valley; Eurobodalla
|
| date_scraped
2019-06-04
|
name
Monaro Alpine
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Snowy Monaro
|
| date_scraped
2019-06-04
|
name
ACT
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
|
| date_scraped
2019-06-04
|
name
Southern Ranges
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Goulburn Mulwaree; Upper Lachlan; Yass Valley; Queanbeyan-Palerang
|
| date_scraped
2019-06-04
|
name
Central Ranges
|
dangerToday
None
|
toBanToday
No
|
fireDangerTomorrow
None
|
toBanTomorrow
No
|
councils
Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange
|
Statistics
Average successful run time: less than a minute
Total run time: 3 minutes
Total cpu time used: less than 5 seconds
Total disk space used: 31.4 KB
History
-
Manually
ran
revision
ee1ff4c3
and
completed successfully
.
21 records added, 21 records removed in the database
-
Manually
ran
revision
ee1ff4c3
and
completed successfully
.
21 records added, 21 records removed in the database1 page scraped
-
Manually
ran
revision
ee1ff4c3
and
completed successfully
.
21 records added in the database1 page scraped
- Created on morph.io