tmtmtmtm / bolivia-diputados

Scrapes github.com, www.diputados.bo, hidemyass.com, and 2 other domains

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/table_unspanner.git  Installing rake 12.0.0  Installing ast 2.3.0  Installing public_suffix 2.0.4  Installing safe_yaml 1.0.4  Installing coderay 1.1.0  Installing unf_ext 0.0.7.2 with native extensions  Installing git 1.3.0  Installing hashdiff 0.3.1  Installing field_serializer 0.3.0  Installing httpclient 2.6.0.1  Installing method_source 0.8.2  Installing mime-types-data 3.2016.0521  Installing mini_portile2 2.1.0  Installing minitest 5.10.1  Installing vcr 3.0.3  Installing netrc 0.11.0  Installing open-uri-cached 0.0.5  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing rainbow 2.1.0  Installing require_all 1.3.3  Installing unicode-display_width 1.1.2  Installing ruby-progressbar 1.8.1  Installing sqlite3 1.3.10 with native extensions  Using bundler 1.11.2  Installing parser 2.3.3.1  Installing addressable 2.5.0  Installing crack 0.4.3  Installing mime-types 3.1  Installing nokogiri 1.7.0.1 with native extensions  Installing minispec-metadata 2.0.0  Installing minitest-around 0.4.0  Installing pry 0.10.1  Installing rubocop 0.46.0  Installing webmock 2.0.3  Installing unf 0.1.4  Installing minitest-vcr 1.4.0  Installing vcr-archive 0.3.0  Installing domain_name 0.5.20161129  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7)  Installing http-cookie 1.0.3  Installing sqlite_magic 0.0.3  Installing rest-client 2.0.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Using scraped 0.2.0 from https://github.com/everypolitician/scraped.git (at master@c3fc06e)  Using table_unspanner 0.1.0 from https://github.com/everypolitician/table_unspanner.git (at master@a70a98a)  Bundle complete! 15 Gemfile dependencies, 46 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (28.24s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 302 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (67 KB) Use the API

rows 10 / 260

name image area id party type term source dpto dip area_id
Lilly Gabriela Montaño Viaña
Santa Cruz
montanio.vl
MAS
Titular
2015
Santa Cruz
Plurinominal
Romina Guadalupe Perez Ramos
Cochabamba
perez.rr
MAS
Titular
2015
Cochabamba
Plurinominal
Victor Alonzo Gutierrez Flores
Cochabamba
gutierrez.fv
UD
Titular
2015
Cochabamba
Uninominal C - 20
C - 20
Gonzalo Aguilar Ayma
Oruro
aguilar.ag
MAS
Titular
2015
Oruro
Uninominal C - 29
C - 29
Sebastian Texeira Rojas
Pando
texeira.rs
MAS
Titular
2015
Pando
Uninominal C - 62
C - 62
Dulce Maria Araujo Dominguez
Pando
araujo.dd
UD
Titular
2015
Pando
Plurinominal
Ginna Maria Torrez Saracho
Tarija
torrez.sg
PDC
Titular
2015
Tarija
Uninominal C - 41
C - 41
Alicia Canqui Condori
Chuquisaca
canqui.ca
MAS
Titular
2015
Chuquisaca
Plurinominal
Elmar Callejas Ruiz
Chuquisaca
callejas.re
MAS
Suplente
2015
Chuquisaca
Plurinominal
Francisco Cuellar Rios
Chuquisaca
cuellar.rf
MAS
Titular
2015
Chuquisaca
Uninominal C - 2
C - 2

Statistics

Average successful run time: half a minute

Total run time: 14 minutes

Total cpu time used: 2 minutes

Total disk space used: 311 KB

History

  • Auto ran revision 6c0c7c93 and completed successfully .
    1 record updated in the database
    9 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    4 records added, 197 records updated in the database
    12 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    1952 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    208 records updated in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and failed .
    nothing changed in the database
  • Auto ran revision 6c0c7c93 and failed .
    nothing changed in the database
  • Auto ran revision 6c0c7c93 and failed .
    nothing changed in the database
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran and failed .
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 6c0c7c93 and completed successfully .
    256 records added, 256 records removed in the database
    7 pages scraped
  • Manually ran revision e1265a32 and completed successfully .
    256 records added, 256 records removed in the database
    1 page scraped
  • Manually ran revision 9a6e066a and completed successfully .
    256 records added in the database
    1 page scraped
  • Created on morph.io

Scraper code

Ruby

bolivia-diputados / scraper.rb