everypolitician-scrapers / twitter-colombia-senate-list

Scraper to run through a twitter List of Colombian Senators

Scrapes api.twitter.com, api.morph.io, en.wikipedia.org, and 2 other domains

README.md

Colombian Senators twitter scraper

This wee scraper runs through a twitter List of Colombian senators for the EveryPolitician project.

Intended to run on morph.io.

Contributors davewhiteland

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/response/raise_error.rb:15:in `on_complete': Invalid or expired token. (Twitter::Error::Unauthorized) from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:9:in `block in call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:57:in `on_complete' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:8:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/request/url_encoded.rb:15:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/request/multipart.rb:14:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/request/multipart_with_file.rb:19:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/rack_builder.rb:139:in `build_response' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:377:in `run_request' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:140:in `get' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/request.rb:33:in `perform' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/cursor.rb:29:in `initialize' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/utils.rb:107:in `new' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/utils.rb:107:in `perform_get_with_cursor' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/lists.rb:430:in `cursor_from_response_with_list' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/lists.rb:248:in `list_members' from scraper.rb:20:in `<main>'

Data

Downloaded 939 times by everypolitician wfdd davewhiteland

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (21 KB) Use the API

rows 10 / 97

id name twitter image
155964060
#VoteBien
Vote_Bien
https://pbs.twimg.com/profile_images/633691618579759104/8zZXAyV5.jpg
91447035
German Hoyos
GermanHoyos
https://pbs.twimg.com/profile_images/426709195719593984/RKfEe3m_.jpeg
67462607
Carlos Enrique Soto
senadorsoto
https://pbs.twimg.com/profile_images/771842845737189376/WoS7KDGx.jpg
58982725
Eugenio Prieto
EugenioPrieto
https://pbs.twimg.com/profile_images/809238329099243520/K4IcOgyE.jpg
61097151
Álvaro Uribe Vélez
AlvaroUribeVel
https://pbs.twimg.com/profile_images/479052171837984768/mlO43FWa.jpeg
2219053756
Musa Besaile Fayad
MusaBesaileFa
https://pbs.twimg.com/profile_images/890358623699959808/yRa72mXy.jpg
818359970072817664
Mauricio Delgado Senador
DelgadoMSenador
https://pbs.twimg.com/profile_images/941329428000493568/4OjwkQTP.jpg
2951995276
JAIME AMIN
JaimeAminH
https://pbs.twimg.com/profile_images/974526161203052545/6pi8Isix.jpg
2848989880
Myriam Paredes Aguirre
senadoramyriamp
https://pbs.twimg.com/profile_images/973529912807186434/KIK0ChnI.jpg
2688799753
Senén Niño
SenadorSenen
https://pbs.twimg.com/profile_images/981883636881510400/gxr0K0Qx.jpg

Statistics

Average successful run time: less than a minute

Total run time: 26 days

Total cpu time used: 12 minutes

Total disk space used: 43.6 KB

History

  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history