Contributors tmtmtmtm

Last run failed with status code 128.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/scraped.git  fatal: unable to access 'https://github.com/everypolitician/scraped.git/': Failed to connect to github.com port 443: Connection timed out  Retrying git clone 'https://github.com/everypolitician/scraped.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/scraped-4aebd6454f7f48898bb4e4442c6d8f78e3f53aaa" --bare --no-hardlinks --quiet due to error (2/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'https://github.com/everypolitician/scraped.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/scraped-4aebd6454f7f48898bb4e4442c6d8f78e3f53aaa" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing ast 2.3.0  Installing public_suffix 2.0.4  Installing rake 12.0.0  Installing coderay 1.1.1  Installing safe_yaml 1.0.4  Installing field_serializer 0.3.0  Installing hashdiff 0.3.0  Installing git 1.3.0  Installing method_source 0.8.2  Installing mini_portile2 2.1.0  Installing httpclient 2.8.2.4  Installing minitest 5.10.1  Installing vcr 3.0.3  Installing open-uri-cached 0.0.5  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing rainbow 2.1.0  Installing require_all 1.4.0  Installing unicode-display_width 1.1.2  Installing ruby-progressbar 1.8.1  Using bundler 1.11.2  Installing sqlite3 1.3.12 with native extensions  Installing addressable 2.5.0  Installing parser 2.3.3.1  Installing crack 0.4.3  Installing minispec-metadata 2.0.0  Installing pry 0.10.4  Installing rubocop 0.46.0  Installing nokogiri 1.7.0.1 with native extensions  Installing webmock 2.0.3  Installing minitest-vcr 1.4.0  Installing vcr-archive 0.3.0  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7)  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Using scraped 0.2.0 from https://github.com/everypolitician/scraped.git (at master@c3fc06e)  Bundle complete! 12 Gemfile dependencies, 36 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (360.26s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 75 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (185 KB) Use the API

rows 10 / 449

name faction area image source id birth_date start_date area_id
Абрамов Иван Николаевич
ЛДПР
Амурская область
1756684
1978-06-16
2016-10-05
0071
Авдеев Александр Александрович
«ЕДИНАЯ РОССИЯ»
Калужская область
1756998
1975-08-12
2016-10-05
0099
Агаев Ваха Абуевич
КПРФ
все субъекты Российской Федерации
1756685
1953-03-15
2016-10-05
Адучиев Батор Канурович
«ЕДИНАЯ РОССИЯ»
Республика Калмыкия, Ставропольский край, Астраханская область, Ростовская область
1756730
1963-01-27
2016-10-05
Азимов Рахим Азизбоевич
«ЕДИНАЯ РОССИЯ»
Кировская область
1756688
1964-08-16
2016-10-05
0105
Аксаков Анатолий Геннадьевич
«СПРАВЕДЛИВАЯ РОССИЯ»
Чувашская Республика - Чувашия
1756975
1957-11-28
2016-10-05
0037
Алексеева Татьяна Олеговна
«ЕДИНАЯ РОССИЯ»
Кемеровская область
1756689
1962-12-16
2016-10-05
0101
Алферов Жорес Иванович
КПРФ
все субъекты Российской Федерации
1756686
1930-03-15
2016-10-05
Альшевских Андрей Геннадьевич
«ЕДИНАЯ РОССИЯ»
Свердловская область
1756731
1972-05-14
2016-10-05
0168
Ананских Игорь Александрович
«СПРАВЕДЛИВАЯ РОССИЯ»
Республика Карелия, Ленинградская область, Мурманская область
1756942
1966-09-06
2016-10-05

Statistics

Average successful run time: about 8 hours

Total run time: 21 days

Total cpu time used: 8 days

Total disk space used: 33.7 MB

History

  • Auto ran revision 7abfe4ec and failed .
    nothing changed in the database
  • Auto ran revision 7abfe4ec and failed .
    nothing changed in the database
  • Auto ran revision 7abfe4ec and completed successfully .
    2 records updated in the database
    1803 pages scraped
  • Auto ran revision 7abfe4ec and failed .
    nothing changed in the database
    1281 pages scraped
  • Auto ran revision 7abfe4ec and completed successfully .
    nothing changed in the database
    1802 pages scraped
  • Auto ran revision 7abfe4ec and completed successfully .
    344 records added in the database
    1802 pages scraped
  • Auto ran revision 7abfe4ec and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 7abfe4ec and failed .
    344 records removed in the database
    429 pages scraped
  • Auto ran revision 7abfe4ec and completed successfully .
    446 records added in the database
    1802 pages scraped
  • Auto ran revision 7abfe4ec and failed .
    3 records added, 452 records removed in the database
    18 pages scraped
  • Auto ran revision 661414de and failed .
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and failed .
    nothing changed in the database
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and failed .
    353 records added, 353 records removed in the database
    1420 pages scraped
  • Auto ran revision 661414de and failed .
    408 records added, 408 records removed in the database
    1639 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and failed .
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 448 records removed in the database
    1802 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and failed .
    148 records added, 148 records removed in the database
    599 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1799 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    3597 pages scraped
  • Auto ran revision 661414de and failed .
    253 records added, 253 records removed in the database
    1019 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and failed .
    352 records added, 352 records removed in the database
    1415 pages scraped
  • Auto ran revision 661414de and completed successfully .
    5 records added, 5 records removed in the database
    27 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
  • Auto ran revision 661414de and completed successfully .
    nothing changed in the database
  • Auto ran revision 661414de and failed .
    nothing changed in the database
    219 pages scraped
  • Auto ran revision 661414de and completed successfully .
    nothing changed in the database
    1802 pages scraped
  • Manually ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 1beafedd and failed .
    61 records added, 61 records removed in the database
    375 pages scraped
  • Auto ran revision 1beafedd and failed .
    64 records added, 64 records removed in the database
  • Auto ran revision 1beafedd and failed .
    404 records added, 403 records removed in the database
    2433 pages scraped
  • Auto ran revision 1beafedd and failed .
    54 records added, 54 records removed in the database
    333 pages scraped
  • Auto ran revision 1beafedd and failed .
    323 records added, 323 records removed in the database
    1947 pages scraped
  • Auto ran revision 1beafedd and failed .
    75 records added, 75 records removed in the database
    459 pages scraped
  • Auto ran revision 1beafedd and failed .
    91 records added, 91 records removed in the database
    555 pages scraped
  • Auto ran revision 1beafedd and failed .
    56 records added, 56 records removed in the database
    345 pages scraped
  • Auto ran revision 1beafedd and failed .
    59 records added, 59 records removed in the database
    363 pages scraped
  • Auto ran revision 1beafedd and failed .
    91 records added, 91 records removed in the database
    555 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    686 pages scraped
  • Auto ran revision 1beafedd and failed .
    147 records added, 147 records removed in the database
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
  • Auto ran revision 1beafedd and failed .
    230 records added, 230 records removed in the database
    1389 pages scraped
  • Auto ran revision 1beafedd and failed .
    263 records added, 263 records removed in the database
    1587 pages scraped
  • Auto ran revision 1beafedd and failed .
    69 records added, 69 records removed in the database
    423 pages scraped
  • Auto ran revision 1beafedd and failed .
    63 records added, 63 records removed in the database
    387 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and failed .
    43 records added, 43 records removed in the database
    267 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    5388 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    459 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    704 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    2617 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    449 records added, 449 records removed in the database
    2700 pages scraped
  • Auto ran revision 1beafedd and failed .
    275 records added, 275 records removed in the database
    1659 pages scraped
  • Auto ran revision 1beafedd and failed .
    9 records added, 9 records removed in the database
    61 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    450 records added, 450 records removed in the database
    2706 pages scraped
  • Auto ran revision 1beafedd and failed .
    349 records added, 349 records removed in the database
    2102 pages scraped
  • Manually ran revision 1beafedd and completed successfully .
    450 records added, 450 records removed in the database
    2706 pages scraped
  • Manually ran revision e8e2a846 and completed successfully .
    450 records added, 11 records removed in the database
    451 pages scraped
  • Manually ran revision 7e8b3b07 and failed .
    11 records added in the database
    13 pages scraped
  • Created on morph.io

Scraper code

Ruby

russia-duma-2016 / scraper.rb