kelpenhagen / Fire_Danger_Ratings_Tutorial
Daily Fire Ratings and Total Fire Bans for NSW (Rural Fire Service)
Scrapes www.rfs.nsw.gov.au
NSW RFS - NSW Rural Fire Service
This is a scraper that runs on Morph. To get started see the documentation
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.2.3
[1G-----> Installing dependencies using bundler 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Fetching gem metadata from https://rubygems.org/........
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Using bundler 1.15.2
[1G Fetching unf_ext 0.0.7.1
[1G Fetching httpclient 2.6.0.1
[1G Fetching mime-types 2.5
[1G Installing mime-types 2.5
[1G Installing httpclient 2.6.0.1
[1G Fetching net-http-digest_auth 1.4
[1G Installing unf_ext 0.0.7.1 with native extensions
[1G Fetching net-http-persistent 2.9.4
[1G Installing net-http-digest_auth 1.4
[1G Fetching mini_portile 0.6.2
[1G Installing net-http-persistent 2.9.4
[1G Fetching ntlm-http 0.1.1
[1G Installing mini_portile 0.6.2
[1G Installing ntlm-http 0.1.1
[1G Fetching webrobots 0.1.1
[1G Fetching sqlite3 1.3.10
[1G Installing webrobots 0.1.1
[1G Fetching nokogiri 1.6.6.2
[1G Installing sqlite3 1.3.10 with native extensions
[1G Installing nokogiri 1.6.6.2 with native extensions
[1G Fetching unf 0.1.4
[1G Installing unf 0.1.4
[1G Fetching domain_name 0.5.24
[1G Installing domain_name 0.5.24
[1G Fetching http-cookie 1.0.2
[1G Installing http-cookie 1.0.2
[1G Fetching sqlite_magic 0.0.3
[1G Installing sqlite_magic 0.0.3
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Fetching mechanize 2.7.3
[1G Installing mechanize 2.7.3
[1G Bundle complete! 2 Gemfile dependencies, 17 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (24.42s)
[1G Cleaning up the bundler cache.
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Far North Coast", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"North Coast", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bellingen; Coffs Harbour; Port Macquarie-Hastings; Kempsey; Nambucca; Mid-Coast"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Greater Hunter", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Greater Sydney Region", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"The Hills; Blacktown; Blue Mountains; Burwood; Camden; Campbelltown; Canada Bay; Fairfield; Hawkesbury; Hornsby; Hunters Hill; Kogarah; Ku-ring-gai; Lane Cove; Liverpool; Mosman; North Sydney; Parramatta; Penrith; Randwick; Ryde; Strathfield; Sutherland; Sydney; Waverley; Willoughby; Woollahra; Bayside; Canterbury-Bankstown; Central Coast; Cumberland; Georges River; Inner West; Northern Beaches"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Illawarra/Shoalhaven", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Far South Coast", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bega Valley; Eurobodalla"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Monaro Alpine", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Snowy Monaro"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"ACT", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>""}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Southern Ranges", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Goulburn Mulwaree; Upper Lachlan; Yass Valley; Queanbeyan-Palerang"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Central Ranges", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"New England", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Glen Innes Severn; Tenterfield; Uralla; Walcha; Armidale"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Northern Slopes", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Gunnedah; Gwydir; Inverell; Liverpool Plains; Tamworth"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"North Western", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Moree Plains; Narrabri; Walgett; Warrumbungle"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Upper Central West Plains", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bogan; Coonamble; Gilgandra; Warren"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Lower Central West Plains", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bland; Forbes; Lachlan; Narromine; Parkes; Temora; Weddin; Dubbo"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Southern Slopes", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Cootamundra-Gundagai; Hilltops; Snowy Valleys"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Eastern Riverina", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Albury; Coolamon; Greater Hume; Junee; Lockhart; Wagga Wagga"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Southern Riverina", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Berrigan; Edward River; Federation; Murray River; Southern parts of Murrumbidgee"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Northern Riverina", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Carrathool; Griffith; Hay; Leeton; Narrandera; Northern parts of Murrumbidgee"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"South Western", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Balranald; Wentworth"}
{:date_scraped=>#<Date: 2018-06-22 ((2458292j,0s,0n),+0s,2299161j)>, :name=>"Far Western", :today_fire_d=>"None", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bourke; Brewarrina; Broken Hill; Central Darling; Cobar"}
Data
Downloaded
5 times
by
To download data sign in with GitHub
rows 10 / 17220
| date_scraped | name | today_fire_d | today_toban | tomorrow_fire_d | tomorrow_toban | council |
|---|---|---|---|---|---|---|
|
2015-09-04
|
Far North Coast
|
LOW MODERATE
|
No
|
None
|
No
|
Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed
|
|
2015-09-04
|
North Coast
|
LOW MODERATE
|
No
|
None
|
No
|
Bellingen; Coffs Harbour; Gloucester; Greater Taree; Great Lakes; Port Macquarie-Hastings; Kempsey; Nambucca
|
|
2015-09-04
|
Greater Hunter
|
LOW MODERATE
|
No
|
None
|
No
|
Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter
|
|
2015-09-04
|
Greater Sydney Region
|
LOW MODERATE
|
No
|
None
|
No
|
Ashfield; Auburn; Bankstown; The Hills; Blacktown; Blue Mountains; Botany Bay; Burwood; Camden; Campbelltown; Canada Bay; Canterbury; Fairfield; Gosford; Hawkesbury; Holroyd; Hornsby; Hunters Hill; Hurstville; Kogarah; Ku-ring-gai; Lane Cove; Leichhardt; Liverpool; Manly; Marrickville; Mosman; North Sydney; Parramatta; Penrith; Pittwater; Randwick; Rockdale; Ryde; Strathfield; Sutherland; Sydney; Warringah; Waverley; Willoughby; Woollahra; Wyong
|
|
2015-09-04
|
Illawarra/Shoalhaven
|
LOW MODERATE
|
No
|
None
|
No
|
Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong
|
|
2015-09-04
|
Far South Coast
|
LOW MODERATE
|
No
|
None
|
No
|
Bega Valley; Eurobodalla
|
|
2015-09-04
|
Monaro Alpine
|
LOW MODERATE
|
No
|
None
|
No
|
Bombala; Cooma-Monaro; Snowy River
|
|
2015-09-04
|
ACT
|
LOW MODERATE
|
No
|
None
|
No
|
|
|
2015-09-04
|
Southern Ranges
|
LOW MODERATE
|
No
|
None
|
No
|
Goulburn Mulwaree; Palerang; Queanbeyan; Upper Lachlan; Yass Valley
|
|
2015-09-04
|
Central Ranges
|
LOW MODERATE
|
No
|
None
|
No
|
Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange
|
Statistics
Average successful run time: 4 minutes
Total run time: 29 days
Total cpu time used: 18 minutes
Total disk space used: 3.12 MB
History
-
Auto
ran
revision
a4cc5676
and
completed successfully
.
21 records added in the database1 page scraped
-
Auto
ran
revision
a4cc5676
and
completed successfully
.
21 records added in the database
-
Auto
ran
revision
a4cc5676
and
completed successfully
.
21 records added in the database1 page scraped
-
Auto
ran
revision
a4cc5676
and
completed successfully
.
21 records added in the database1 page scraped
-
Auto
ran
revision
a4cc5676
and
completed successfully
.
21 records added, 21 records removed in the database1 page scraped
- ...
- Created on morph.io