richygit / nsw_mp_data

Scrapes www.parliament.nsw.gov.au

Parliament of NSW


nswmpdata

Contributors richygit

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/open-uri.rb:225:in `open_loop': redirection forbidden: http://www.parliament.nsw.gov.au/prod/parlment/members.nsf/reports/ContactSpreadsheetAll.csv -> https://www.parliament.nsw.gov.au/prod/parlment/members.nsf/reports/ContactSpreadsheetAll.csv (RuntimeError) from /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri' from /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.4/lib/ruby/2.3.0/open-uri.rb:35:in `open' from /app/csv_scraper.rb:14:in `scrape' from /app/scraper_main.rb:8:in `main' from scraper.rb:4:in `<main>'

Statistics

Average successful run time: 3 minutes

Total run time: about 23 hours

Total cpu time used: 19 minutes

Total disk space used: 741 KB

History

  • Auto ran revision 3278f0d4 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 3278f0d4 and failed .
    nothing changed in the database
  • Auto ran revision 3278f0d4 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 3278f0d4 and failed .
    nothing changed in the database
  • Auto ran revision 3278f0d4 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

nsw_mp_data / scraper.rb