JasonThomasData / scraperToRunRuby

whatwhatwhat

Scrapes www.rfs.nsw.gov.au and eservices.fremantle.wa.gov.au

NSW RFS - NSW Rural Fire Service


This is a scraper that runs on Morph. To get started see the documentation

Contributors JasonThomasData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-1.9.3 -----> Installing dependencies using 1.7.12  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing httpclient 2.6.0.1  Installing mime-types 2.5  Installing net-http-digest_auth 1.4  Installing net-http-persistent 2.9.4  Installing mini_portile 0.6.2  Installing ntlm-http 0.1.1  Installing unf_ext 0.0.7.1  Using bundler 1.7.12  Installing webrobots 0.1.1  Installing unf 0.1.4  Installing domain_name 0.5.24  Installing http-cookie 1.0.2  Installing sqlite3 1.3.10  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults)  Installing nokogiri 1.6.6.2  Installing mechanize 2.7.3  Your bundle is complete!  Gems in the groups development and test were not installed.  It was installed into ./vendor/bundle  Bundle completed (28.03s)  Cleaning up the bundler cache.  -----> Discovering process types  Procfile declares types -> scraper  Default process types for Ruby -> rake, console Injecting scraper and running... done

Data

Downloaded 2 times by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (6 KB) Use the API

rows 10 / 21

date_scraped name dangerToday toBanToday fireDangerTomorrow toBanTomorrow councils
2015-09-04
Far North Coast
LOW MODERATE
No
None
No
Ballina; Byron; Clarence Valley; Kyogle; Lismore; Richmond Valley; Tweed
2015-09-04
North Coast
LOW MODERATE
No
None
No
Bellingen; Coffs Harbour; Gloucester; Greater Taree; Great Lakes; Port Macquarie-Hastings; Kempsey; Nambucca
2015-09-04
Greater Hunter
LOW MODERATE
No
None
No
Cessnock; Dungog; Lake Macquarie; Maitland; Muswellbrook; Newcastle; Port Stephens; Singleton; Upper Hunter
2015-09-04
Greater Sydney Region
LOW MODERATE
No
None
No
Ashfield; Auburn; Bankstown; The Hills; Blacktown; Blue Mountains; Botany Bay; Burwood; Camden; Campbelltown; Canada Bay; Canterbury; Fairfield; Gosford; Hawkesbury; Holroyd; Hornsby; Hunters Hill; Hurstville; Kogarah; Ku-ring-gai; Lane Cove; Leichhardt; Liverpool; Manly; Marrickville; Mosman; North Sydney; Parramatta; Penrith; Pittwater; Randwick; Rockdale; Ryde; Strathfield; Sutherland; Sydney; Warringah; Waverley; Willoughby; Woollahra; Wyong
2015-09-04
Illawarra/Shoalhaven
LOW MODERATE
No
None
No
Kiama; Shellharbour; Shoalhaven; Wingecarribee; Wollondilly; Wollongong
2015-09-04
Far South Coast
LOW MODERATE
No
None
No
Bega Valley; Eurobodalla
2015-09-04
Monaro Alpine
LOW MODERATE
No
None
No
Bombala; Cooma-Monaro; Snowy River
2015-09-04
ACT
LOW MODERATE
No
None
No
2015-09-04
Southern Ranges
LOW MODERATE
No
None
No
Goulburn Mulwaree; Palerang; Queanbeyan; Upper Lachlan; Yass Valley
2015-09-04
Central Ranges
LOW MODERATE
No
None
No
Bathurst; Blayney; Cabonne; Cowra; Lithgow; Mid-Western; Oberon; Orange

Statistics

Average successful run time: 1 minute

Total run time: 1 minute

Total cpu time used: less than 5 seconds

Total disk space used: 29.8 KB

History

  • Manually ran revision 99a614ca and completed successfully .
    21 records added in the database
    2 pages scraped
  • Created on morph.io

Scraper code

Ruby

scraperToRunRuby / scraper.rb