tmtmtmtm / timor-leste-parlamento

Scrapes github.com and www.parlamento.tl

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:225:in `open_loop': redirection forbidden: http://www.parlamento.tl/deputadus/2012-2017/pt/index.php -> https://www.parlamento.tl/deputadus/2012-2017/pt/index.php (RuntimeError) from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `block in open_uri' from /app/vendor/bundle/ruby/2.3.0/gems/vcr-3.0.3/lib/vcr/util/variable_args_block_caller.rb:9:in `call_block' from /app/vendor/bundle/ruby/2.3.0/gems/vcr-3.0.3/lib/vcr.rb:189:in `use_cassette' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive.rb:36:in `record' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `open_uri' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:35:in `open' from scraper.rb:14:in `noko_for' from scraper.rb:18:in `scrape_list' from scraper.rb:49:in `<main>'

Data

Downloaded 22 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17 KB) Use the API

rows 0 / 0

Statistics

Average successful run time: 4 minutes

Total run time: about 13 hours

Total cpu time used: about 1 hour

Total disk space used: 2.57 MB

History

  • Auto ran revision 1d6e427e and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 1d6e427e and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 1d6e427e and failed .
    nothing changed in the database
  • Auto ran revision 1d6e427e and failed .
    nothing changed in the database
  • Auto ran revision 1d6e427e and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

timor-leste-parlamento / scraper.rb