everypolitician-scrapers / russia-duma-2016

Scrapes github.com and www.duma.gov.ru

Build software better, together.


Contributors tmtmtmtm

The scraper is running. It was queued automatically .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Found 448 members Found 448 members Found 448 members

Data

Downloaded 48 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (182 KB) Use the API

rows 10 / 451

name faction area image source id birth_date start_date area_id
Нарышкин Сергей Евгеньевич
Вне фракций
Ленинградская область
1757002
Макаровец Николай Александрович
«ЕДИНАЯ РОССИЯ»
1756928
2016-10-05
Скоробогатько Александр Иванович
«ЕДИНАЯ РОССИЯ»
Краснодарский край
1756605
1967-09-25
2016-10-05
Зюганов Геннадий Андреевич
КПРФ
все субъекты Российской Федерации
1756694
1944-06-26
2016-10-05
Иванов Валерий Викторович
«ЕДИНАЯ РОССИЯ»
Ивановская область, Костромская область, Тверская область, Ярославская область
1756873
1960-09-14
2016-10-05
Иванов Максим Анатольевич
«ЕДИНАЯ РОССИЯ»
Свердловская область
1756875
1967-11-24
2016-10-05
0172
Иванов Николай Николаевич
КПРФ
Калужская область, Курская область, Орловская область
1756876
1957-01-17
2016-10-05
Иванов Сергей Владимирович
ЛДПР
Ростовская область, Курская область
1756877
1969-10-26
2016-10-05
Игнатов Виктор Александрович
«ЕДИНАЯ РОССИЯ»
Новосибирская область
1756879
1968-10-15
2016-10-05
0138
Игошин Игорь Николаевич
«ЕДИНАЯ РОССИЯ»
Владимирская область
1756880
1970-12-11
2016-10-05
0079

Statistics

Average successful run time: about 7 hours

Total run time: 11 days

Total cpu time used: 5 days

Total disk space used: 48.8 MB

History

  • Auto ran revision 661414de and failed .
    148 records added, 148 records removed in the database
    599 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1799 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    3597 pages scraped
  • Auto ran revision 661414de and failed .
    253 records added, 253 records removed in the database
    1019 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and completed successfully .
    448 records added, 448 records removed in the database
    1798 pages scraped
  • Auto ran revision 661414de and failed .
    352 records added, 352 records removed in the database
    1415 pages scraped
  • Auto ran revision 661414de and completed successfully .
    5 records added, 5 records removed in the database
    27 pages scraped
  • Auto ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
  • Auto ran revision 661414de and completed successfully .
    nothing changed in the database
  • Auto ran revision 661414de and failed .
    nothing changed in the database
    219 pages scraped
  • Auto ran revision 661414de and completed successfully .
    nothing changed in the database
    1802 pages scraped
  • Manually ran revision 661414de and completed successfully .
    449 records added, 449 records removed in the database
    1802 pages scraped
  • Auto ran revision 1beafedd and failed .
    61 records added, 61 records removed in the database
    375 pages scraped
  • Auto ran revision 1beafedd and failed .
    64 records added, 64 records removed in the database
  • Auto ran revision 1beafedd and failed .
    404 records added, 403 records removed in the database
    2433 pages scraped
  • Auto ran revision 1beafedd and failed .
    54 records added, 54 records removed in the database
    333 pages scraped
  • Auto ran revision 1beafedd and failed .
    323 records added, 323 records removed in the database
    1947 pages scraped
  • Auto ran revision 1beafedd and failed .
    75 records added, 75 records removed in the database
    459 pages scraped
  • Auto ran revision 1beafedd and failed .
    91 records added, 91 records removed in the database
    555 pages scraped
  • Auto ran revision 1beafedd and failed .
    56 records added, 56 records removed in the database
    345 pages scraped
  • Auto ran revision 1beafedd and failed .
    59 records added, 59 records removed in the database
    363 pages scraped
  • Auto ran revision 1beafedd and failed .
    91 records added, 91 records removed in the database
    555 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    686 pages scraped
  • Auto ran revision 1beafedd and failed .
    147 records added, 147 records removed in the database
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
  • Auto ran revision 1beafedd and failed .
    230 records added, 230 records removed in the database
    1389 pages scraped
  • Auto ran revision 1beafedd and failed .
    263 records added, 263 records removed in the database
    1587 pages scraped
  • Auto ran revision 1beafedd and failed .
    69 records added, 69 records removed in the database
    423 pages scraped
  • Auto ran revision 1beafedd and failed .
    63 records added, 63 records removed in the database
    387 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and failed .
    43 records added, 43 records removed in the database
    267 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    5388 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    448 records added, 448 records removed in the database
    2694 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    459 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    704 pages scraped
  • Auto ran revision 1beafedd and failed .
    nothing changed in the database
    2617 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    449 records added, 449 records removed in the database
    2700 pages scraped
  • Auto ran revision 1beafedd and failed .
    275 records added, 275 records removed in the database
    1659 pages scraped
  • Auto ran revision 1beafedd and failed .
    9 records added, 9 records removed in the database
    61 pages scraped
  • Auto ran revision 1beafedd and completed successfully .
    450 records added, 450 records removed in the database
    2706 pages scraped
  • Auto ran revision 1beafedd and failed .
    349 records added, 349 records removed in the database
    2102 pages scraped
  • Manually ran revision 1beafedd and completed successfully .
    450 records added, 450 records removed in the database
    2706 pages scraped
  • Manually ran revision e8e2a846 and completed successfully .
    450 records added, 11 records removed in the database
    451 pages scraped
  • Manually ran revision 7e8b3b07 and failed .
    11 records added in the database
    13 pages scraped
  • Created on morph.io

Scraper code

Ruby

russia-duma-2016 / scraper.rb