kelpenhagen / Fire_Danger_Ratings_Tutorial

Daily Fire Ratings and Total Fire Bans for NSW (Rural Fire Service)

Scrapes www.rfs.nsw.gov.au

NSW RFS - NSW Rural Fire Service


This is a scraper that runs on Morph. To get started see the documentation

Contributors kelpenhagen

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.2.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Fetching httpclient 2.6.0.1  Fetching mime-types 2.5  Installing httpclient 2.6.0.1  Installing unf_ext 0.0.7.1 with native extensions  Installing mime-types 2.5  Fetching net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-digest_auth 1.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Installing mini_portile 0.6.2  Fetching webrobots 0.1.1  Fetching sqlite3 1.3.10  Installing webrobots 0.1.1  Installing sqlite3 1.3.10 with native extensions  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (22.16s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Far North Coast", :today_fire_d=>"LOW MODERATE", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"North Coast", :today_fire_d=>"HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bellingen; Coffs Harbour; Port Macquarie-Hastings; Kempsey; Nambucca; Mid-Coast"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Greater Hunter", :today_fire_d=>"SEVERE", :today_toban=>"Yes ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Greater Sydney Region", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"The Hills; Blacktown; Blue Mountains; Burwood; Camden; Campbelltown; Canada Bay; Fairfield; Hawkesbury; Hornsby; Hunters Hill; Kogarah; Ku-ring-gai; Lane Cove; Liverpool; Mosman; North Sydney; Parramatta; Penrith; Randwick; Ryde; Strathfield; Sutherland; Sydney; Waverley; Willoughby; Woollahra; Bayside; Canterbury-Bankstown; Central Coast; Cumberland; Georges River; Inner West; Northern Beaches"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Illawarra/Shoalhaven", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Far South Coast", :today_fire_d=>"HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bega Valley; Eurobodalla"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Monaro Alpine", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Snowy Monaro"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"ACT", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>""} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Southern Ranges", :today_fire_d=>"SEVERE", :today_toban=>"Yes ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Goulburn Mulwaree; Upper Lachlan; Yass Valley; Queanbeyan-Palerang"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Central Ranges", :today_fire_d=>"SEVERE", :today_toban=>"Yes ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"New England", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Glen Innes Severn; Tenterfield; Uralla; Walcha; Armidale"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Northern Slopes", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Gunnedah; Gwydir; Inverell; Liverpool Plains; Tamworth"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"North Western", :today_fire_d=>"SEVERE", :today_toban=>"Yes ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Moree Plains; Narrabri; Walgett; Warrumbungle"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Upper Central West Plains", :today_fire_d=>"LOW MODERATE", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bogan; Coonamble; Gilgandra; Warren"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Lower Central West Plains", :today_fire_d=>"HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bland; Forbes; Lachlan; Narromine; Parkes; Temora; Weddin; Dubbo"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Southern Slopes", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Cootamundra-Gundagai; Hilltops; Snowy Valleys"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Eastern Riverina", :today_fire_d=>"VERY HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Albury; Coolamon; Greater Hume; Junee; Lockhart; Wagga Wagga"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Southern Riverina", :today_fire_d=>"HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Berrigan; Edward River; Federation; Murray River; Southern parts of Murrumbidgee"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Northern Riverina", :today_fire_d=>"HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Carrathool; Griffith; Hay; Leeton; Narrandera; Northern parts of Murrumbidgee"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"South Western", :today_fire_d=>"HIGH", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Balranald; Wentworth"} {:date_scraped=>#<Date: 2018-01-21 ((2458140j,0s,0n),+0s,2299161j)>, :name=>"Far Western", :today_fire_d=>"LOW MODERATE", :today_toban=>"No ", :tomorrow_fire_d=>"None", :tomorrow_toban=>"No", :council=>"Bourke; Brewarrina; Broken Hill; Central Darling; Cobar"}

Data

Downloaded 5 times by kelpenhagen MikeRalphson henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.6 MB) Use the API

rows 10 / 14406

date_scraped name today_fire_d today_toban tomorrow_fire_d tomorrow_toban council
2015-09-04
Far North Coast
LOW MODERATE
No
None
No
Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed
2015-09-04
North Coast
LOW MODERATE
No
None
No
Bellingen; Coffs Harbour; Gloucester; Greater Taree; Great Lakes; Port Macquarie-Hastings; Kempsey; Nambucca
2015-09-04
Greater Hunter
LOW MODERATE
No
None
No
Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter
2015-09-04
Greater Sydney Region
LOW MODERATE
No
None
No
Ashfield; Auburn; Bankstown; The Hills; Blacktown; Blue Mountains; Botany Bay; Burwood; Camden; Campbelltown; Canada Bay; Canterbury; Fairfield; Gosford; Hawkesbury; Holroyd; Hornsby; Hunters Hill; Hurstville; Kogarah; Ku-ring-gai; Lane Cove; Leichhardt; Liverpool; Manly; Marrickville; Mosman; North Sydney; Parramatta; Penrith; Pittwater; Randwick; Rockdale; Ryde; Strathfield; Sutherland; Sydney; Warringah; Waverley; Willoughby; Woollahra; Wyong
2015-09-04
Illawarra/Shoalhaven
LOW MODERATE
No
None
No
Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong
2015-09-04
Far South Coast
LOW MODERATE
No
None
No
Bega Valley; Eurobodalla
2015-09-04
Monaro Alpine
LOW MODERATE
No
None
No
Bombala; Cooma-Monaro; Snowy River
2015-09-04
ACT
LOW MODERATE
No
None
No
2015-09-04
Southern Ranges
LOW MODERATE
No
None
No
Goulburn Mulwaree; Palerang; Queanbeyan; Upper Lachlan; Yass Valley
2015-09-04
Central Ranges
LOW MODERATE
No
None
No
Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange

Statistics

Average successful run time: 4 minutes

Total run time: 29 days

Total cpu time used: 15 minutes

Total disk space used: 2.63 MB

History

  • Auto ran revision a4cc5676 and completed successfully .
    21 records added in the database
    1 page scraped
  • Auto ran revision a4cc5676 and completed successfully .
    21 records added in the database
    1 page scraped
  • Auto ran revision a4cc5676 and completed successfully .
    21 records added in the database
    1 page scraped
  • Auto ran revision a4cc5676 and failed .
    nothing changed in the database
  • Auto ran revision a4cc5676 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history