everypolitician-scrapers / spain_congreso_es

Details of members of the Spanish Congress from the official website congreso.es

Scrapes www.congreso.es and github.com

Congreso de los Diputados


This is a scraper that runs on Morph. To get started see the documentation

Contributors struan tmtmtmtm octopusinvitro chrismytton

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... including Capybara::DSL in the global scope is not recommended! including Capybara::DSL in the global scope is not recommended! /app/vendor/bundle/ruby/2.0.0/bundler/gems/scraped_page_archive-9d8a6347d122/lib/scraped_page_archive/git_storage.rb:32:in `save': undefined local variable or method `ret' for #<ScrapedPageArchive::GitStorage:0x007fa0f35c4450> (NameError) from /app/vendor/bundle/ruby/2.0.0/bundler/gems/scraped_page_archive-9d8a6347d122/lib/scraped_page_archive.rb:37:in `record' from /app/vendor/bundle/ruby/2.0.0/bundler/gems/scraped_page_archive-9d8a6347d122/lib/scraped_page_archive.rb:18:in `record' from /app/vendor/bundle/ruby/2.0.0/bundler/gems/scraped_page_archive-9d8a6347d122/lib/scraped_page_archive/capybara.rb:57:in `command' from /app/vendor/bundle/ruby/2.0.0/gems/poltergeist-1.9.0/lib/capybara/poltergeist/browser.rb:75:in `visible_text' from /app/vendor/bundle/ruby/2.0.0/gems/poltergeist-1.9.0/lib/capybara/poltergeist/node.rb:17:in `command' from /app/vendor/bundle/ruby/2.0.0/gems/poltergeist-1.9.0/lib/capybara/poltergeist/node.rb:50:in `visible_text' from /app/vendor/bundle/ruby/2.0.0/gems/capybara-2.6.2/lib/capybara/node/element.rb:61:in `block in text' from /app/vendor/bundle/ruby/2.0.0/gems/capybara-2.6.2/lib/capybara/node/base.rb:84:in `synchronize' from /app/vendor/bundle/ruby/2.0.0/gems/capybara-2.6.2/lib/capybara/node/element.rb:57:in `text' from scraper.rb:145:in `block in scrape_people' from scraper.rb:144:in `scrape_people' from scraper.rb:289:in `<main>'

Statistics

Total run time: 3 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 54.2 MB

History

  • Manually ran revision 750cf457 and failed .
    nothing changed in the database
    14 pages scraped
  • Manually ran revision 750cf457 and failed .
    nothing changed in the database
    8 pages scraped
  • Manually ran revision 750cf457 and failed .
    nothing changed in the database
    8 pages scraped
  • Manually ran and failed .
  • Manually ran and failed .
  • Created on morph.io

Scraper code

Ruby

spain_congreso_es / scraper.rb