WilliamHartPhD / research_nrb_twitter_scraper

Research "nrb" Twitter Scraper

Scrapes search.twitter.com and docs.google.com

Search Twitter to find the latest news and world events faster. Find popular people, hashtags and photos for any topic you can imagine.

Forked from ScraperWiki

Contributors

Last run completed successfully 2018-09-21.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=1 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=2 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=3 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=4 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=5 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=6 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=7 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=8 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=9 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=10 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=11 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=12 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=13 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=14 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=15 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=16 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=17 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=18 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=19 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=20 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=21 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=22 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=23 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=24 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=25 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=26 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=27 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=28 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=29 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=30 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=31 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=32 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=33 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=34 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=35 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=36 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=37 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=38 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=39 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=40 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=41 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=42 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=43 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=44 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=45 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=46 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=47 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=48 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=49 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=50

Data

Downloaded 0 times

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.6 MB) Use the API

rows 10 / 153224

text	id	from_user
@brandoncologne not racist but I despise this mofo	153944082698342402	ShelbyGees
im not racist but some black people are really rude	152440265687306240	SELLMAJ
"I'm not racist but...." 😂😂😂😂😂	151399630440116224	tattedlowe
😂😂 from the porn I've seen it's mostly still pink lol 😂😂 RT @LivingGoodChris Black pussy? I'm not racist but nah I can't .	151399233621196800	tattedlowe
I'm.not racist but white people be stinkin yo	151365130230317056	CallMeNetra
"I'm not racist, but for a second I thought I was in Africa"	151364929809694720	rachaellllynnnn
RT @DailyQuail: Comin' over here, takin' our Amazon products! http://t.co/2nweyyfo Bonus points for "I'm not racist but..."	151362807345065984	JonnyJonez
I'm not racist but that shit just got me tight this ain't segregation fuck she teaching her children?	151362800290234368	NONCHALANT_SHAY
RT @DailyQuail: Comin' over here, takin' our Amazon products! http://t.co/2nweyyfo Bonus points for "I'm not racist but..."	151362517241823235	resolutereader
RT @DailyQuail: Comin' over here, takin' our Amazon products! http://t.co/2nweyyfo Bonus points for "I'm not racist but..."	151360245795532800	JohnNor

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: 18 minutes

Total disk space used: 25.6 MB

History

Auto ran revision ba730000 and completed successfully 2018-09-21.

run time 11 s

nothing changed in the database

51 pages scraped
Auto ran revision ba730000 and completed successfully 2018-09-20.

run time 11 s

nothing changed in the database

50 pages scraped
Auto ran revision ba730000 and completed successfully 2018-09-19.

run time 10 s

nothing changed in the database

50 pages scraped
Auto ran revision ba730000 and completed successfully 2018-09-18.

run time 11 s

nothing changed in the database

50 pages scraped
Auto ran revision ba730000 and completed successfully 2018-09-17.

run time 11 s

nothing changed in the database

72 pages scraped
...
Forked from ScraperWiki 2014-03-17

Show complete history

Scraper code

Python

research_nrb_twitter_scraper / scraper.py

git clone URL