JasonThomasData / scraperToRunRuby

whatwhatwhat

Scrapes www.rfs.nsw.gov.au and eservices.fremantle.wa.gov.au

NSW RFS - NSW Rural Fire Service


Contributors JasonThomasData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-1.9.3 [1G-----> Installing dependencies using 1.7.12 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Installing httpclient 2.6.0.1 [1G Installing mime-types 2.5 [1G Installing net-http-digest_auth 1.4 [1G Installing net-http-persistent 2.9.4 [1G Installing mini_portile 0.6.2 [1G Installing ntlm-http 0.1.1 [1G Installing unf_ext 0.0.7.1 [1G Using bundler 1.7.12 [1G Installing webrobots 0.1.1 [1G Installing unf 0.1.4 [1G Installing domain_name 0.5.24 [1G Installing http-cookie 1.0.2 [1G Installing sqlite3 1.3.10 [1G Installing sqlite_magic 0.0.3 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults) [1G Installing nokogiri 1.6.6.2 [1G Installing mechanize 2.7.3 [1G Your bundle is complete! [1G Gems in the groups development and test were not installed. [1G It was installed into ./vendor/bundle [1G Bundle completed (28.03s) [1G Cleaning up the bundler cache. [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper [1G Default process types for Ruby -> rake, console Injecting scraper and running... done

Data

Downloaded 2 times by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (6 KB) Use the API

rows 10 / 21

date_scraped name dangerToday toBanToday fireDangerTomorrow toBanTomorrow councils
2015-09-04
Far North Coast
LOW MODERATE
No
None
No
Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed
2015-09-04
North Coast
LOW MODERATE
No
None
No
Bellingen; Coffs Harbour; Gloucester; Greater Taree; Great Lakes; Port Macquarie-Hastings; Kempsey; Nambucca
2015-09-04
Greater Hunter
LOW MODERATE
No
None
No
Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter
2015-09-04
Greater Sydney Region
LOW MODERATE
No
None
No
Ashfield; Auburn; Bankstown; The Hills; Blacktown; Blue Mountains; Botany Bay; Burwood; Camden; Campbelltown; Canada Bay; Canterbury; Fairfield; Gosford; Hawkesbury; Holroyd; Hornsby; Hunters Hill; Hurstville; Kogarah; Ku-ring-gai; Lane Cove; Leichhardt; Liverpool; Manly; Marrickville; Mosman; North Sydney; Parramatta; Penrith; Pittwater; Randwick; Rockdale; Ryde; Strathfield; Sutherland; Sydney; Warringah; Waverley; Willoughby; Woollahra; Wyong
2015-09-04
Illawarra/Shoalhaven
LOW MODERATE
No
None
No
Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong
2015-09-04
Far South Coast
LOW MODERATE
No
None
No
Bega Valley; Eurobodalla
2015-09-04
Monaro Alpine
LOW MODERATE
No
None
No
Bombala; Cooma-Monaro; Snowy River
2015-09-04
ACT
LOW MODERATE
No
None
No
2015-09-04
Southern Ranges
LOW MODERATE
No
None
No
Goulburn Mulwaree; Palerang; Queanbeyan; Upper Lachlan; Yass Valley
2015-09-04
Central Ranges
LOW MODERATE
No
None
No
Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange

Statistics

Average successful run time: 1 minute

Total run time: 1 minute

Total cpu time used: less than 5 seconds

Total disk space used: 29.8 KB

History

  • Manually ran revision 99a614ca and completed successfully .
    21 records added in the database
    2 pages scraped
  • Created on morph.io

Scraper code

scraperToRunRuby