This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Error removing intermediate container 74b81e01c49d: Driver aufs failed to remove root filesystem 74b81e01c49d3c35b1d2ee08279e035901f0c62985d92f03a8fa132a38d0b80c: rename /var/lib/docker/aufs/mnt/5bdaa03afa1c221d814f75a0603446fae6703deda6d5bdcb3d93f698af2e5f45 /var/lib/docker/aufs/mnt/5bdaa03afa1c221d814f75a0603446fae6703deda6d5bdcb3d93f698af2e5f45-removing: device or resource busy  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.1 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/field_serializer.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing ast 2.3.0  Installing coderay 1.1.0  Installing colorize 0.7.7  Installing public_suffix 2.0.4  Installing safe_yaml 1.0.4  Using field_serializer 0.1.0 from https://github.com/everypolitician/field_serializer.git (at master@16d5d90)  Installing git 1.3.0  Installing hashdiff 0.3.1  Installing method_source 0.8.2  Installing mini_portile 0.6.2  Installing httpclient 2.6.0.1  Installing open-uri-cached 0.0.5  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing rainbow 2.1.0  Installing require_all 1.3.3  Installing ruby-progressbar 1.8.1  Installing unicode-display_width 1.1.1  Using bundler 1.11.2  Installing sqlite3 1.3.10 with native extensions  Installing vcr 3.0.3  Installing parser 2.3.1.4  Installing addressable 2.5.0  Installing crack 0.4.3  Installing pry 0.10.1  Installing rubocop 0.43.0  Installing nokogiri 1.6.6.2 with native extensions  Installing webmock 2.0.3  Installing vcr-archive 0.3.0  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7)  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 9 Gemfile dependencies, 32 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (26.04s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Error removing intermediate container 74b81e01c49d: No such container: 74b81e01c49d3c35b1d2ee08279e035901f0c62985d92f03a8fa132a38d0b80c Injecting scraper and running... Found 101 members Found 101 members Found 101 members Found 101 members

Data

Downloaded 2 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (73 KB) Use the API

rows 10 / 119

id name faction committees image phone email facebook twitter source
d29b95db-3b4d-43de-802d-652c32199211
Andres Anvelt
Sotsiaaldemokraatliku Erakonna fraktsioon
Põhiseaduskomisjon
6316603
andres.anvelt@riigikogu.ee
9c583623-eb94-48de-bf39-2bf49759c5a6
Mihhail Korb
Eesti Keskerakonna fraktsioon
Majanduskomisjon
6316475
mihhail.korb@riigikogu.ee
8719c4cd-291e-4216-b3e1-8b5a0d7902fb
Sven Mikser
Sotsiaaldemokraatliku Erakonna fraktsioon
Väliskomisjon
6316460
sven.mikser@riigikogu.ee
c91bc287-d95b-4d95-aded-f7a142c1e599
Urve Palo
Sotsiaaldemokraatliku Erakonna fraktsioon
Majanduskomisjon
6316658
urve.palo@riigikogu.ee
87b36dbb-08e9-4048-91eb-6df699c6e27e
Jüri Ratas
Eesti Keskerakonna fraktsioon
6316321
jyri.ratas@riigikogu.ee
ce3f9ed0-083c-4d0f-b45a-096610012b5f
Martin Repinski
Eesti Keskerakonna fraktsioon
Euroopa Liidu asjade komisjon;Maaelukomisjon
6316563
martin.repinski@riigikogu.ee
74f8df6d-6f4d-410b-8b45-bf58922cf421
Mailis Reps
Eesti Keskerakonna fraktsioon
Kultuurikomisjon
6316628
mailis.reps@riigikogu.ee
382d928f-8fa4-422b-9538-043ff3033b65
Kadri Simson
Eesti Keskerakonna fraktsioon
Riigikaitsekomisjon;Rahanduskomisjon
6316683
kadri.simson@riigikogu.ee
586335bd-0e3f-4cee-a325-7af602224ca7
Vladimir Arhipov
Fraktsiooni mittekuuluvad saadikud
6316637
vladimir.arhipov@riigikogu.ee
13ae3199-f2e4-4b49-a73b-f2880451da33
Peep Aru
Eesti Reformierakonna fraktsioon
Maaelukomisjon;Julgeolekuasutuste järelevalve erikomisjon
6316459
peep.aru@riigikogu.ee

Statistics

Average successful run time: about 1 hour

Total run time: 6 days

Total cpu time used: 1 day

Total disk space used: 58.2 MB

History

  • Auto ran revision 37b1439d and completed successfully .
    101 records added, 101 records removed in the database
  • Auto ran revision 37b1439d and completed successfully .
    101 records added, 101 records removed in the database
    511 pages scraped
  • Auto ran revision 37b1439d and completed successfully .
    101 records added, 101 records removed in the database
  • Auto ran revision 37b1439d and completed successfully .
    nothing changed in the database
    511 pages scraped
  • Auto ran revision 37b1439d and completed successfully .
    101 records added, 100 records removed in the database
    511 pages scraped
  • Auto ran revision 623fc42c and failed .
    84 records added, 75 records removed in the database
    596 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 93 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and failed .
    94 records added, 94 records removed in the database
    674 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and failed .
    81 records added, 81 records removed in the database
    575 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    1426 pages scraped
  • Auto ran revision 623fc42c and failed .
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    1426 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    715 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    1426 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
  • Auto ran revision 623fc42c and completed successfully .
    nothing changed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    nothing changed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    nothing changed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    nothing changed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Auto ran revision 623fc42c and completed successfully .
    101 records added, 101 records removed in the database
    713 pages scraped
  • Manually ran revision b2bf9ed7 and completed successfully .
    101 records added, 9 records removed in the database
    713 pages scraped
  • Manually ran revision 3b8fcc1a and failed .
    9 records added in the database
    21 pages scraped
  • Created on morph.io

Scraper code

Ruby

estonia-riigikogu / scraper.rb