WilliamHartPhD / research_nrb_twitter_scraper

Research "nrb" Twitter Scraper

Scrapes search.twitter.com, www.chambredesrepresentants.ma, and chambredesrepresentants.ma

Search Twitter to find the latest news and world events faster. Find popular people, hashtags and photos for any topic you can imagine.

Forked from ScraperWiki

Contributors

Last run completed successfully 2018-05-21.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=1 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=2 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=3 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=4 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=5 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=6 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=7 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=8 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=9 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=10 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=11 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=12 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=13 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=14 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=15 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=16 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=17 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=18 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=19 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=20 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=21 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=22 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=23 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=24 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=25 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=26 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=27 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=28 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=29 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=30 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=31 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=32 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=33 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=34 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=35 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=36 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=37 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=38 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=39 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=40 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=41 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=42 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=43 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=44 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=45 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=46 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=47 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=48 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=49 Oh dear, failed to scrape http://search.twitter.com/search.json?q=%22not%20racist%20but%22&rpp=100&lang=en&page=50

Data

Downloaded 0 times

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.6 MB) Use the API

rows 10 / 153224

text	id	from_user
@brandoncologne not racist but I despise this mofo	153944082698342402	ShelbyGees
im not racist but some black people are really rude	152440265687306240	SELLMAJ
"I'm not racist but...." 😂😂😂😂😂	151399630440116224	tattedlowe
😂😂 from the porn I've seen it's mostly still pink lol 😂😂 RT @LivingGoodChris Black pussy? I'm not racist but nah I can't .	151399233621196800	tattedlowe
I'm.not racist but white people be stinkin yo	151365130230317056	CallMeNetra
"I'm not racist, but for a second I thought I was in Africa"	151364929809694720	rachaellllynnnn
RT @DailyQuail: Comin' over here, takin' our Amazon products! http://t.co/2nweyyfo Bonus points for "I'm not racist but..."	151362807345065984	JonnyJonez
I'm not racist but that shit just got me tight this ain't segregation fuck she teaching her children?	151362800290234368	NONCHALANT_SHAY
RT @DailyQuail: Comin' over here, takin' our Amazon products! http://t.co/2nweyyfo Bonus points for "I'm not racist but..."	151362517241823235	resolutereader
RT @DailyQuail: Comin' over here, takin' our Amazon products! http://t.co/2nweyyfo Bonus points for "I'm not racist but..."	151360245795532800	JohnNor

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: 16 minutes

Total disk space used: 25.6 MB

History

Auto ran revision ba730000 and completed successfully 2018-05-21.

run time 26 s

nothing changed in the database

874 pages scraped
Auto ran revision ba730000 and completed successfully 2018-05-20.

run time 16 s

nothing changed in the database

50 pages scraped
Auto ran revision ba730000 and completed successfully 2018-05-19.

run time 13 s

nothing changed in the database

52 pages scraped
Auto ran revision ba730000 and completed successfully 2018-05-18.

run time 13 s

nothing changed in the database

179 pages scraped
Auto ran revision ba730000 and completed successfully 2018-05-17.

run time 12 s

nothing changed in the database

50 pages scraped
...
Forked from ScraperWiki 2014-03-17

Show complete history

Scraper code

Python

research_nrb_twitter_scraper / scraper.py

git clone URL