tmtmtmtm / malawi_parliament

Parliament of Malawi MPs


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Installing rake 10.4.2  Installing coderay 1.1.0  Installing colorize 0.7.7  Installing httpclient 2.6.0.1  Installing json 1.8.2 with native extensions  Installing method_source 0.8.2  Installing mini_portile 0.6.2  Installing open-uri-cached 0.0.5  Installing slop 3.6.0  Installing sqlite3 1.3.10 with native extensions  Using bundler 1.11.2  Installing nokogiri 1.6.6.2 with native extensions  Installing pry 0.10.1  Installing sqlite_magic 0.0.5  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 7 Gemfile dependencies, 15 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (20.83s)  Cleaning up the bundler cache.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting http://www.parliament.gov.mw/mps.php?mode=alps /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:353:in `open_http': 404 Not Found (OpenURI::HTTPError) from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:709:in `buffer_open' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:210:in `block in open_loop' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:208:in `catch' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:208:in `open_loop' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:149:in `open_uri' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:689:in `open' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:34:in `open' from scraper.rb:18:in `noko_for' from scraper.rb:27:in `scrape_list' from scraper.rb:70:in `<main>'

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 1 / 1

id name start_date
2014
2014
2014

Statistics

Total run time: 1 minute

Total cpu time used: less than 5 seconds

Total disk space used: 28.5 KB

History

  • Manually ran revision 1046c3c9 and failed .
    1 record added, 1 record removed in the database
  • Manually ran revision 1046c3c9 and failed .
    nothing changed in the database
  • Manually ran revision 30018317 and failed .
    1 record added, 1 record removed in the database
  • Manually ran revision 63875aed and failed .
    1 record added in the database
  • Created on morph.io

Scraper code

Ruby

malawi_parliament / scraper.rb