tmtmtmtm / malta-parliament

Scrapes github.com and www.parlament.mt

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm ondenman chrismytton

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:225:in `open_loop': redirection forbidden: http://www.parlament.mt/membersofparliament?l=1 -> https://www.parlament.mt/membersofparliament?l=1 (RuntimeError) from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `block in open_uri' from /app/vendor/bundle/ruby/2.3.0/gems/vcr-3.0.3/lib/vcr/util/variable_args_block_caller.rb:9:in `call_block' from /app/vendor/bundle/ruby/2.3.0/gems/vcr-3.0.3/lib/vcr.rb:189:in `use_cassette' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive.rb:36:in `record' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `open_uri' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:35:in `open' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request/strategy/live_request.rb:10:in `response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:29:in `block in first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `first' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:13:in `response' from scraper.rb:17:in `scrape' from scraper.rb:21:in `<main>'

Data

Downloaded 1185 times by everypolitician chrismytton MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (20 KB) Use the API

rows 10 / 71

id name faction email image term source electoral_history honorific_prefix
abela-carmelo
Carmelo Abela
Partit Laburista
carmelo.abela@parlament.mt
12
abela-anthony
Anthony Abela
Partit Nazzjonalista
anthony.c.abela@parlament.mt
12
agius-chris
Chris Agius
Partit Laburista
chris.agius@parlament.mt
12
agius-david
David Agius
Partit Nazzjonalista
david.agius@parlament.mt
12
agiusdecelis-anthony
Anthony Agius Decelis
Partit Laburista
anthony.agius-decelis@gov.mt
12
arrigo-robert
Robert Arrigo
Partit Nazzjonlista
robert.arrigo@parlament.mt
12
bartolo-evarist
Evarist Bartolo
Partit Laburista
evarist.bartolo@gov.mt
12
azzopardi-frederick
Frederick Azzopardi
Partit Nazzjonlista
azzopardi.frederick@parlament.mt
12
bonnici-owen
Owen Bonnici
Partit Laburista
owen.bonnici@gov.mt
12
azzopardi-jason
Jason Azzopardi
Partit Nazzjonlista
jason.azzopardi@parlament.mt
12

Statistics

Average successful run time: 6 minutes

Total run time: 9 days

Total cpu time used: about 10 hours

Total disk space used: 15.9 MB

History

  • Auto ran revision b2054809 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b2054809 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b2054809 and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b2054809 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision b2054809 and failed .
    nothing changed in the database
    3 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

malta-parliament / scraper.rb