everypolitician-scrapers / italy-twitter-list

Scrapes api.twitter.com

Contributors octopusinvitro ondenman tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.3.4 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/.. [1G Fetching dependency metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby [1G Fetching https://github.com/everypolitician/twitter_list [1G Fetching public_suffix 3.0.0 [1G Fetching buftok 0.2.0 [1G Using bundler 1.15.2 [1G Fetching unf_ext 0.0.7.4 [1G Installing buftok 0.2.0 [1G Fetching equalizer 0.0.11 [1G Installing public_suffix 3.0.0 [1G Installing equalizer 0.0.11 [1G Fetching multipart-post 2.0.0 [1G Installing multipart-post 2.0.0 [1G Installing unf_ext 0.0.7.4 with native extensions [1G Fetching http-form_data 1.0.3 [1G Installing http-form_data 1.0.3 [1G Fetching http_parser.rb 0.6.0 [1G Fetching httpclient 2.8.3 [1G Installing http_parser.rb 0.6.0 with native extensions [1G Installing httpclient 2.8.3 [1G Fetching thread_safe 0.3.6 [1G Installing thread_safe 0.3.6 [1G Fetching naught 1.1.0 [1G Installing naught 1.1.0 [1G Fetching sqlite3 1.3.13 [1G Installing sqlite3 1.3.13 with native extensions [1G Fetching simple_oauth 0.3.1 [1G Installing simple_oauth 0.3.1 [1G Fetching faraday 0.11.0 [1G Installing faraday 0.11.0 [1G Fetching addressable 2.5.2 [1G Installing addressable 2.5.2 [1G Fetching memoizable 0.4.2 [1G Installing memoizable 0.4.2 [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20170404 [1G Installing domain_name 0.5.20170404 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching http 2.2.2 [1G Installing http 2.2.2 [1G Fetching twitter 6.1.0 [1G Installing twitter 6.1.0 [1G Using twitter_list 0.0.2 from https://github.com/everypolitician/twitter_list (at master@90832b6) [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby (at morph_defaults@fc50176) [1G Bundle complete! 3 Gemfile dependencies, 24 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (19.71s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G ###### WARNING: [1G You have not declared a Ruby version in your Gemfile. [1G To set your Ruby version add this line to your Gemfile: [1G ruby '2.3.4' [1G # See https://devcenter.heroku.com/articles/ruby-versions for more information. [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/response/raise_error.rb:13:in `on_complete': Invalid or expired token. (Twitter::Error::Unauthorized) from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/response.rb:9:in `block in call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/response.rb:61:in `on_complete' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/response.rb:8:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/request/retry.rb:116:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/request/url_encoded.rb:15:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/request/multipart.rb:14:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/request/multipart_with_file.rb:21:in `call' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/rack_builder.rb:139:in `build_response' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/connection.rb:377:in `run_request' from /app/vendor/bundle/ruby/2.3.0/gems/faraday-0.11.0/lib/faraday/connection.rb:140:in `get' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/request.rb:33:in `perform' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/cursor.rb:29:in `initialize' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/utils.rb:107:in `new' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/utils.rb:107:in `perform_get_with_cursor' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/lists.rb:430:in `cursor_from_response_with_list' from /app/vendor/bundle/ruby/2.3.0/gems/twitter-6.1.0/lib/twitter/rest/lists.rb:248:in `list_members' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/twitter_list-90832b604c79/lib/twitter_list/scraper.rb:22:in `people' from scraper.rb:13:in `<main>'

Data

Downloaded 77 times by everypolitician Aliossandro SmartVMDev ondenman tviani921

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (82 KB) Use the API

rows 10 / 481

id name twitter image
1728345799
Paola Pinna
PaoPinna
https://pbs.twimg.com/profile_images/577424776211361792/RG7OnfYq.jpeg
1283591790
Federico Ginato
FedericoGinato
https://pbs.twimg.com/profile_images/3405536321/3b1ebbfc6de9a8b689a695cd9d2ce1df.jpeg
2405206161
Luigi Cesaro
Cesaro_FI
https://pbs.twimg.com/profile_images/443785746454183936/Ki0_iaR7.jpeg
2398174219
Paolo Fontanelli
Paolo_Font
https://pbs.twimg.com/profile_images/446331043864272896/PqNKcxqg.jpeg
2396420483
Maino Marchi
MMarchi57
https://pbs.twimg.com/profile_images/442608570514046976/hHn2b9sK.jpeg
2389507018
irene manzi
ManziIrene
https://pbs.twimg.com/profile_images/785904018027675648/DBDrCYQN.jpg
2378358620
Sofia Amoddio
SofiaAmoddio
https://pbs.twimg.com/profile_images/442210874606886912/fvgh_goL.jpeg
2370933860
GessicaRostellato
GeRostellato
https://pbs.twimg.com/profile_images/955888182947713025/kXnifARL.jpg
2351867430
Sergio Pizzolante
pizzolante_s
https://pbs.twimg.com/profile_images/436163795044409346/uYGQ9yRC.jpeg
2310613162
Maurizio Bianconi
On_Bianconi
https://pbs.twimg.com/profile_images/939154821348777984/i4bb_cQs.jpg

Statistics

Average successful run time: less than a minute

Total run time: 24 days

Total cpu time used: 22 minutes

Total disk space used: 104 KB

History

  • Auto ran revision 12632f13 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 12632f13 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 12632f13 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 12632f13 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 12632f13 and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

italy-twitter-list