everypolitician-scrapers / twitter-colombia-senate-list

Scraper to run through a twitter List of Colombian Senators

Scrapes api.twitter.com


Colombian Senators twitter scraper

This wee scraper runs through a twitter List of Colombian senators for the EveryPolitician project.

Intended to run on morph.io.

Contributors davewhiteland

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.2.4 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/...  Fetching dependency metadata from https://rubygems.org/..  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing buftok 0.2.0  Installing coderay 1.1.1  Installing addressable 2.4.0  Installing dotenv 2.1.1  Installing unf_ext 0.0.7.2 with native extensions  Installing equalizer 0.0.10  Installing multipart-post 2.0.0  Installing http-form_data 1.0.1  Installing http_parser.rb 0.6.0 with native extensions  Installing httpclient 2.8.0  Installing json 1.8.3 with native extensions  Installing thread_safe 0.3.5  Installing method_source 0.8.2  Installing naught 1.1.0  Installing slop 3.6.0  Installing sqlite3 1.3.11 with native extensions  Installing simple_oauth 0.3.1  Using bundler 1.11.2  Installing faraday 0.9.2  Installing unf 0.1.4  Installing memoizable 0.4.2  Installing pry 0.10.3  Installing domain_name 0.5.20160615  Installing http-cookie 1.0.2  Installing http 1.0.4  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing twitter 5.16.0  Bundle complete! 4 Gemfile dependencies, 28 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (16.03s)  Cleaning up the bundler cache.   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.2.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 115 times by everypolitician wfdd davewhiteland

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (21 KB) Use the API

rows 10 / 88

id name twitter image
2951995276
Jaime Amin Hernandez
JaimeAminH
2848989880
MYRIAM PAREDES
senadoramyriamp
2688799753
Senador Senén Niño
SenadorSenen
2687968392
Susana Correa
SusanaCorreaBor
2411541594
ThaniaVega Senadora
ThaniaVegaCD
2298487140
Javier Tato Alvarez
JTatoAlvarez
2281216915
Yamina Pestana Rojas
SenadoYaminaP
2249369569
Mario Fernández
Marioferalco
2237754745
Andres Garcia Zuccar
AGarciaZuccardi
2219053756
Musa Besaile Fayad
MusaBesaileFa

Statistics

Average successful run time: half a minute

Total run time: about 1 hour

Total cpu time used: 2 minutes

Total disk space used: 52 KB

History

  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    7 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    6 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran and failed .
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    7 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    168 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    23 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    13 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    611 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    7 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    6859 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    2 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    766 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    4 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    33 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
  • Auto ran revision 9fbf079f and failed .
    20 records added, 20 records removed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    268 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    9 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
  • Auto ran revision 9fbf079f and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Auto ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    29 pages scraped
  • Manually ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Manually ran revision 9fbf079f and completed successfully .
    88 records added, 88 records removed in the database
    5 pages scraped
  • Manually ran revision 9fbf079f and completed successfully .
    88 records added in the database
  • Manually ran revision 9fbf079f and failed .
    nothing changed in the database
  • Created on morph.io