tmtmtmtm / abkhazia-peoples-assmebly

Scrapes github.com, www.parlamentra.org, www.camara.gov.br, and 1 other domain

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:91:in `block in save_data': Data has nil value for unique key. Unique keys are [:id, :term]. Offending data: {:id=>nil, :name=>"Кварчия Валерий Ермейович", :source=>"", :area=>nil, :email=>nil, :image=>"http://www.parlamentra.org/upload/iblock/a9a/%D0%92%D0%B0%D0%BB%D0%B5%D1%80%D0%B8%D0%B9%20%D0%9A%D0%B2%D0%B0%D1%80%D1%87%D0%B8%D1%8F.JPG", :term=>5} (SqliteMagic::DatabaseError) from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:88:in `each' from /app/vendor/bundle/ruby/2.3.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:88:in `save_data' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraperwiki-ruby-fc5017681250/lib/scraperwiki.rb:89:in `save_sqlite' from scraper.rb:31:in `block in scrape_list' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.7.1/lib/nokogiri/xml/node_set.rb:187:in `block in each' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.7.1/lib/nokogiri/xml/node_set.rb:186:in `upto' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.7.1/lib/nokogiri/xml/node_set.rb:186:in `each' from scraper.rb:19:in `scrape_list' from scraper.rb:36:in `<main>'

Statistics

Average successful run time: half a minute

Total run time: about 5 hours

Total cpu time used: 15 minutes

Total disk space used: 938 KB

History

  • Auto ran revision 0af80e23 and failed .
    nothing changed in the database
    9 pages scraped
  • Auto ran revision 0af80e23 and failed .
    nothing changed in the database
  • Auto ran revision 0af80e23 and failed .
    nothing changed in the database
  • Auto ran revision 0af80e23 and failed .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 0af80e23 and failed .
    nothing changed in the database
    6 pages scraped
  • ...
  • Created on morph.io

Show complete history