everypolitician-scrapers / twitter-mexico-diputados-friends

Scraping member accounts of Mexican Chamber of Deputies, who are all friends of the official Chamber on twitter

Scrapes api.twitter.com

Contributors davewhiteland

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.2.4 [1G-----> Installing dependencies using bundler 1.11.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching version metadata from https://rubygems.org/... [1G Fetching dependency metadata from https://rubygems.org/.. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Installing addressable 2.4.0 [1G Installing coderay 1.1.1 [1G Installing buftok 0.2.0 [1G Installing dotenv 2.1.1 [1G Installing multipart-post 2.0.0 [1G Installing equalizer 0.0.10 [1G Installing unf_ext 0.0.7.2 with native extensions [1G Installing http-form_data 1.0.1 [1G Installing http_parser.rb 0.6.0 with native extensions [1G Installing httpclient 2.8.0 [1G Installing json 1.8.3 with native extensions [1G Installing thread_safe 0.3.5 [1G Installing method_source 0.8.2 [1G Installing naught 1.1.0 [1G Installing slop 3.6.0 [1G Installing sqlite3 1.3.11 with native extensions [1G Installing simple_oauth 0.3.1 [1G Using bundler 1.11.2 [1G Installing faraday 0.9.2 [1G Installing unf 0.1.4 [1G Installing memoizable 0.4.2 [1G Installing pry 0.10.3 [1G Installing domain_name 0.5.20160615 [1G Installing http-cookie 1.0.2 [1G Installing http 1.0.4 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing twitter 5.16.0 [1G Bundle complete! 4 Gemfile dependencies, 28 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (17.32s) [1G Cleaning up the bundler cache. [1G [1G ###### WARNING: [1G You have not declared a Ruby version in your Gemfile. [1G To set your Ruby version add this line to your Gemfile: [1G ruby '2.2.4' [1G # See https://devcenter.heroku.com/articles/ruby-versions for more information. [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/rest/response/raise_error.rb:15:in `on_complete': Rate limit exceeded (Twitter::Error::TooManyRequests) from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/response.rb:9:in `block in call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/response.rb:57:in `on_complete' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/response.rb:8:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/request/url_encoded.rb:15:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/request/multipart.rb:14:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/rest/request/multipart_with_file.rb:19:in `call' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/rack_builder.rb:139:in `build_response' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/connection.rb:377:in `run_request' from /app/vendor/bundle/ruby/2.2.0/gems/faraday-0.9.2/lib/faraday/connection.rb:140:in `get' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/rest/request.rb:33:in `perform' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/cursor.rb:47:in `fetch_next_page' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:13:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/twitter-5.16.0/lib/twitter/enumerable.rb:14:in `each' from scraper.rb:22:in `<main>'

Data

Downloaded 29 times by SmartVMDev octopusinvitro antoniomilanese

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (58 KB) Use the API

rows 10 / 331

id name twitter image
id
177347934
name
Hortensia Aragón C.
twitter
hortensia_ac
image
https://pbs.twimg.com/profile_images/527929958778146816/72Q83JyK.jpeg
id
981619484
name
David López
twitter
David_Lopez_Gtz
image
https://pbs.twimg.com/profile_images/378800000075192658/a7de9e4e6a553cf1437b66cec34325cf.jpeg
id
388353434
name
Gerardo Ruiz Esparza
twitter
gruizesp
image
https://pbs.twimg.com/profile_images/726936959604527104/t7wA-W6S.jpg
id
3252830282
name
Sofía González
twitter
SofGonzalez
image
https://pbs.twimg.com/profile_images/732637190342115328/rNksZe-B.jpg
id
276423983
name
Paola Félix Díaz
twitter
LaraPaola1
image
https://pbs.twimg.com/profile_images/786406068737888256/JHUuHWri.jpg
id
32226455
name
Aurelio Nuño
twitter
aurelionuno
image
https://pbs.twimg.com/profile_images/783022420399497216/0cVR1lM9.jpg
id
301703296
name
Soraya Flores
twitter
Soraya_flores
image
https://pbs.twimg.com/profile_images/787092521339846656/LinCUaeG.jpg
id
620271778
name
Jasmin Bugarin
twitter
JasminBugarin
image
https://pbs.twimg.com/profile_images/664546691509411841/JVZkwBu5.jpg
id
150376942
name
Valeria Guzmán
twitter
valeria_guzman_
image
https://pbs.twimg.com/profile_images/791469465275817984/vrYSF8NR.jpg
id
56804739
name
JoseRefugio Sandoval
twitter
JOSEREFUGIOSR
image
https://pbs.twimg.com/profile_images/710449847774482432/VGl_CwVn.jpg

Statistics

Total run time: about 2 hours

Total cpu time used: 5 minutes

Total disk space used: 80.5 KB

History

  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    nothing changed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • Auto ran revision 78084771 and failed .
    300 records added, 300 records removed in the database
    16 pages scraped
  • ...
  • Created on morph.io

Show complete history