askandtheanswer / basic_twitter_scraper_571

Basic Twitter Scraper

Scrapes search.twitter.com

Search Twitter to find the latest news and world events faster. Find popular people, hashtags and photos for any topic you can imagine.


Forked from ScraperWiki

Contributors askandtheanswer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper code and running... Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=1 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=2 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=3 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=4 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=5 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=6 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=7 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=8 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=9 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=10 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=11 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=12 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=13 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=14 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=15 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=16 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=17 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=18 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=19 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=20 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=21 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=22 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=23 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=24 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=25 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=26 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=27 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=28 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=29 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=30 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=31 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=32 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=33 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=34 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=35 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=36 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=37 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=38 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=39 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=40 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=41 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=42 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=43 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=44 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=45 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=46 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=47 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=48 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=49 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=50 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=51 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=52 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=53 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=54 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=55 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=56 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=57 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=58 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=59 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=60 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=61 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=62 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=63 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=64 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=65 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=66 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=67 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=68 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=69 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=70 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=71 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=72 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=73 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=74 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=75 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=76 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=77 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=78 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=79 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=80 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=81 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=82 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=83 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=84 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=85 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=86 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=87 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=88 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=89 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=90 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=91 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=92 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=93 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=94 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=95 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=96 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=97 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=98 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=99 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%23dkpol&rpp=100&lang=en&page=100

Data

Downloaded 2 times by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (42 KB) Use the API

rows 10 / 200

text id from_user
RT @sciencewitch: This is Turkey. We're a big marvellous mosaic. You can't change that. #occupygezi #direngeziparkı #occupyturkey http://t.co/ZwIIkH24Ys
342003879224950784
awakencordy
-Who's chopper is this? -It's Tayyip's baby. -Who's Tayyip? - #tayyip is dead baby,Tayyip is dead. #direngeziparkı http://t.co/vOAyTNvPpQ
342003807045185536
AnjeliqueMrs
#direngeziparkı Reasons why this happened http://t.co/UGgge6G4lF
342003556603273216
cyberpound
RT @GurkanOzturan: Protesters establish an open air #library in #GeziParkı for everyone to read #direngeziparkı #occupygezi #books #read http://t.co/lK0nhveAuC
342003166256181249
muhomol
RT @sciencewitch: This is Turkey. We're a big marvellous mosaic. You can't change that. #occupygezi #direngeziparkı #occupyturkey http://t.co/ZwIIkH24Ys
342003005543026689
ohdidi2
RT @sciencewitch: This is Turkey. We're a big marvellous mosaic. You can't change that. #occupygezi #direngeziparkı #occupyturkey http://t.co/ZwIIkH24Ys
342002952917090304
SesilTok
RT @GurkanOzturan: Protesters establish an open air #library in #GeziParkı for everyone to read #direngeziparkı #occupygezi #books #read http://t.co/lK0nhveAuC
342002790266179584
SeldaDogan
RT @sciencewitch: This is Turkey. We're a big marvellous mosaic. You can't change that. #occupygezi #direngeziparkı #occupyturkey http://t.co/ZwIIkH24Ys
342002608896094209
merkezmasa
"çapuling is good for your freedom and it's also good for democracy" (@ Taksim Gezi Parkı #DirenGeziParkı) http://t.co/SaTuJ8XFha
342002451047673856
Eve_Lester
@Valimutlu Police use of force against #direngeziparkı protestors is excessive, unacceptable & breaks international HR standards @aforgutu
342002159073763328
begosisima

Statistics

Average successful run time: less than 20 seconds

Total run time: less than 20 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 59.8 KB

History

  • Manually ran revision 99bc983d and completed successfully .
    nothing changed in the database
    100 pages scraped
  • Forked from ScraperWiki

Scraper code

Python

basic_twitter_scraper_571 / scraper.py