tmtmtmtm / poland-sejm-wikipedia

Scrapes pl.wikipedia.org

Wikipedia, wolna encyklopedia


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching coderay 1.1.2  Fetching httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Installing coderay 1.1.2  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching open-uri-cached 0.0.5  Installing httpclient 2.8.3  Fetching sqlite3 1.3.13  Installing open-uri-cached 0.0.5  Installing sqlite3 1.3.13 with native extensions  Fetching nokogiri 1.8.2  Fetching pry 0.11.3  Installing pry 0.11.3  Installing nokogiri 1.8.2 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 4 Gemfile dependencies, 11 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (18.01s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 8 Klub Poselski Polskiego Stronnictwa Ludowego – Unii Europejskich Demokratów was Klub Poselski Polskiego Stronnictwa Ludowego – Unii Europejskich Demokratów[w] scraper.rb:63:in `block (2 levels) in current_members': undefined method `attr' for nil:NilClass (NoMethodError) from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:190:in `block in each' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `upto' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `each' from scraper.rb:60:in `block in current_members' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:190:in `block in each' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `upto' from /app/vendor/bundle/ruby/2.3.0/gems/nokogiri-1.8.2/lib/nokogiri/xml/node_set.rb:189:in `each' from scraper.rb:52:in `current_members' from scraper.rb:30:in `term_data' from scraper.rb:137:in `block in <main>' from scraper.rb:135:in `reverse_each' from scraper.rb:135:in `<main>'

Statistics

Average successful run time: 2 minutes

Total run time: 5 days

Total cpu time used: about 5 hours

Total disk space used: 1.37 MB

History

  • Auto ran revision 202bffa0 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 202bffa0 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 202bffa0 and failed .
    nothing changed in the database
    80 pages scraped
  • Auto ran revision 202bffa0 and failed .
    3898 records removed in the database
    1 page scraped
  • Auto ran revision 202bffa0 and completed successfully .
    nothing changed in the database
    8 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

poland-sejm-wikipedia / scraper.rb