everypolitician-scrapers / twitter-colombia-senate-list

Scraper to run through a twitter List of Colombian Senators

Scrapes api.twitter.com, api.morph.io, en.wikipedia.org, and 2 other domains


Colombian Senators twitter scraper

This wee scraper runs through a twitter List of Colombian senators for the EveryPolitician project.

Intended to run on morph.io.

Contributors davewhiteland

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/response/raise_error.rb:15:in `on_complete': Invalid or expired token. (Twitter::Error::Unauthorized) from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:9:in `block in call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:57:in `on_complete' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/response.rb:8:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/request/url_encoded.rb:15:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/request/multipart.rb:14:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/request/multipart_with_file.rb:19:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/rack_builder.rb:139:in `build_response' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:377:in `run_request' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:140:in `get' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/request.rb:33:in `perform' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/cursor.rb:29:in `initialize' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/utils.rb:107:in `new' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/utils.rb:107:in `perform_get_with_cursor' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/lists.rb:430:in `cursor_from_response_with_list' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-5.16.0/lib/twitter/rest/lists.rb:248:in `list_members' from scraper.rb:20:in `<main>'

Data

Downloaded 939 times by everypolitician wfdd davewhiteland

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (21 KB) Use the API

rows 10 / 97

Statistics

Average successful run time: less than a minute

Total run time: 26 days

Total cpu time used: 12 minutes

Total disk space used: 43.6 KB

History

  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbf079f and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history