everypolitician-scrapers / twitter-mexico-diputados-friends

Scraping member accounts of Mexican Chamber of Deputies, who are all friends of the official Chamber on twitter

Scrapes api.twitter.com

Contributors davewhiteland

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.2.4 [1G-----> Installing dependencies using bundler 1.11.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching version metadata from https://rubygems.org/... [1G Fetching dependency metadata from https://rubygems.org/.. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Installing addressable 2.4.0 [1G Installing coderay 1.1.1 [1G Installing buftok 0.2.0 [1G Installing dotenv 2.1.1 [1G Installing multipart-post 2.0.0 [1G Installing equalizer 0.0.10 [1G Installing unf_ext 0.0.7.2 with native extensions [1G Installing http-form_data 1.0.1 [1G Installing http_parser.rb 0.6.0 with native extensions [1G Installing httpclient 2.8.0 [1G Installing json 1.8.3 with native extensions [1G Installing thread_safe 0.3.5 [1G Installing method_source 0.8.2 [1G Installing naught 1.1.0 [1G Installing slop 3.6.0 [1G Installing sqlite3 1.3.11 with native extensions [1G Installing simple_oauth 0.3.1 [1G Using bundler 1.11.2 [1G Installing faraday 0.9.2 [1G Installing unf 0.1.4 [1G Installing memoizable 0.4.2 [1G Installing pry 0.10.3 [1G Installing domain_name 0.5.20160615 [1G Installing http-cookie 1.0.2 [1G Installing http 1.0.4 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing twitter 5.16.0 [1G Bundle complete! 4 Gemfile dependencies, 28 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (17.32s) [1G Cleaning up the bundler cache. [1G [1G ###### WARNING: [1G You have not declared a Ruby version in your Gemfile. [1G To set your Ruby version add this line to your Gemfile: [1G ruby '2.2.4' [1G # See https://devcenter.heroku.com/articles/ruby-versions for more information. [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/rest/response/raise_error.rb:15:in `on_complete': Rate limit exceeded (Twitter::Error::TooManyRequests) from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/response.rb:9:in `block in call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/response.rb:57:in `on_complete' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/response.rb:8:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/request/url_encoded.rb:15:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/request/multipart.rb:14:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/rest/request/multipart_with_file.rb:19:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/rack_builder.rb:139:in `build_response' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/connection.rb:377:in `run_request' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/connection.rb:140:in `get' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/rest/request.rb:33:in `perform' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/cursor.rb:47:in `fetch_next_page' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:13:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from scraper.rb:22:in `<main>'

Data

Downloaded 22 times by SmartVMDev octopusinvitro antoniomilanese

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (58 KB) Use the API

rows 10 / 331

id name twitter image
177347934
Hortensia Aragón C.
hortensia_ac
https://pbs.twimg.com/profile_images/527929958778146816/72Q83JyK.jpeg
981619484
David López
David_Lopez_Gtz
https://pbs.twimg.com/profile_images/378800000075192658/a7de9e4e6a553cf1437b66cec34325cf.jpeg
388353434
Gerardo Ruiz Esparza
gruizesp
https://pbs.twimg.com/profile_images/726936959604527104/t7wA-W6S.jpg
3252830282
Sofía González
SofGonzalez
https://pbs.twimg.com/profile_images/732637190342115328/rNksZe-B.jpg
276423983
Paola Félix Díaz
LaraPaola1
https://pbs.twimg.com/profile_images/786406068737888256/JHUuHWri.jpg
32226455
Aurelio Nuño
aurelionuno
https://pbs.twimg.com/profile_images/783022420399497216/0cVR1lM9.jpg
301703296
Soraya Flores
Soraya_flores
https://pbs.twimg.com/profile_images/787092521339846656/LinCUaeG.jpg
620271778
Jasmin Bugarin
JasminBugarin
https://pbs.twimg.com/profile_images/664546691509411841/JVZkwBu5.jpg
150376942
Valeria Guzmán
valeria_guzman_
https://pbs.twimg.com/profile_images/791469465275817984/vrYSF8NR.jpg
56804739
JoseRefugio Sandoval
JOSEREFUGIOSR
https://pbs.twimg.com/profile_images/710449847774482432/VGl_CwVn.jpg

Statistics

Total run time: about 2 hours

Total cpu time used: 5 minutes

Total disk space used: 80.5 KB

History

  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    nothing changed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • ...
  • Created on morph.io

Show complete history