SuzanaK / basic_twitter_scraper_with_geocode

Twitter Scraper with geocoding and date

Scrapes search.twitter.com

Search Twitter to find the latest news and world events faster. Find popular people, hashtags and photos for any topic you can imagine.


Contributors SuzanaK

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 27, in <module> for result in result_json['results']: KeyError: 'results'

Data

Downloaded 1 time by SuzanaK

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18 KB) Use the API

rows 10 / 15

text to_user_id_str in_reply_to_status_id id profile_image_url_https source geocode id_str from_user_name metadata profile_image_url to_user from_user from_user_id to_user_id iso_language_code to_user_name created_at location in_reply_to_status_id_str from_user_id_str place geo
text
@WillMcAvoyACN vs. Europe (exl Eastern Europe) & a few areas of Asia. But what is your guess as to WHY violent crime for us is worse?
to_user_id_str
617825073
in_reply_to_status_id
332643922750869505
id
332644719144337408
profile_image_url_https source
<a href="http://twitter.com/download/iphone">Twitter for iPhone</a>
geocode
37.781157,-122.398720,25mi
id_str
332644719144337408
from_user_name
James Wilder
metadata
{'result_type': 'recent'}
profile_image_url to_user
WillMcAvoyACN
from_user
jamesdwilder
from_user_id
55937627
to_user_id
617825073
iso_language_code
en
to_user_name
Will McAvoy
created_at
Thu, 09 May 2013 23:54:15 +0000
location
San Francisco, CA
in_reply_to_status_id_str
332643922750869505
from_user_id_str
55937627
place
geo
text
Have you taught abroad in #Vienna?! Help us out and write a teach guide for @GoOverseas! #TEFL #ESL #Austria #Europe http://t.co/rqP3sIOgdY
to_user_id_str
in_reply_to_status_id
id
332643913460510720
profile_image_url_https source
<a href="http://bufferapp.com">Buffer</a>
geocode
37.781157,-122.398720,25mi
id_str
332643913460510720
from_user_name
Rachel Overseas
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
TeachReviews
from_user_id
371015517
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:51:03 +0000
location
Berkeley, CA
in_reply_to_status_id_str
from_user_id_str
371015517
place
geo
text
@AutoPublication Are you in Canada or Europe?
to_user_id_str
152360033
in_reply_to_status_id
332630126565158912
id
332639936018776064
profile_image_url_https source
<a href="http://itunes.apple.com/us/app/twitter/id409789998?mt=12">Twitter for Mac</a>
geocode
37.781157,-122.398720,25mi
id_str
332639936018776064
from_user_name
aerbook
metadata
{'result_type': 'recent'}
profile_image_url to_user
AutoPublication
from_user
aerbook
from_user_id
183055043
to_user_id
152360033
iso_language_code
en
to_user_name
AutoPublication
created_at
Thu, 09 May 2013 23:35:15 +0000
location
San Francisco, CA
in_reply_to_status_id_str
332630126565158912
from_user_id_str
183055043
place
geo
text
RT @Crunchyroll: News: "Dead or Alive 5 Ultimate" Confirmed for North America and Europe http://t.co/utfovVcNJ0
to_user_id_str
in_reply_to_status_id
id
332639402784337920
profile_image_url_https source
<a href="http://twitter.com/download/iphone">Twitter for iPhone</a>
geocode
37.781157,-122.398720,25mi
id_str
332639402784337920
from_user_name
Ryan Gendreau
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
evilshadowx
from_user_id
36159823
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:33:08 +0000
location
Wishing I was in Japan
in_reply_to_status_id_str
from_user_id_str
36159823
place
geo
text
RT @Crunchyroll: News: "Dead or Alive 5 Ultimate" Confirmed for North America and Europe http://t.co/utfovVcNJ0
to_user_id_str
in_reply_to_status_id
id
332639387978436608
profile_image_url_https source
<a href="http://levelupstudio.com/plume">Plume for Android</a>
geocode
37.781157,-122.398720,25mi
id_str
332639387978436608
from_user_name
Kristina
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
ChibiUFO
from_user_id
35598437
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:33:04 +0000
location
Canada-Land
in_reply_to_status_id_str
from_user_id_str
35598437
place
geo
text
News: "Dead or Alive 5 Ultimate" Confirmed for North America and Europe http://t.co/utfovVcNJ0
to_user_id_str
in_reply_to_status_id
id
332639128321667072
profile_image_url_https source
<a href="http://www.crunchyroll.com">Crunchyroll</a>
geocode
37.781157,-122.398720,25mi
id_str
332639128321667072
from_user_name
Crunchyroll
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
Crunchyroll
from_user_id
28023330
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:32:02 +0000
location
San Francisco, CA
in_reply_to_status_id_str
from_user_id_str
28023330
place
geo
text
Europe stocks end higher after US data http://t.co/oCUF0K6ZRL
to_user_id_str
in_reply_to_status_id
id
332638394066808832
profile_image_url_https source
<a href="http://www.snsanalytics.com">SNS Analytics</a>
geocode
37.781157,-122.398720,25mi
id_str
332638394066808832
from_user_name
MarketWatch News
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
MarketWatchNews
from_user_id
200896018
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:29:07 +0000
location
San Francisco
in_reply_to_status_id_str
from_user_id_str
200896018
place
geo
text
Happy Europe Day! Register .EU, your European Identity, for just $2.99 during our #sale! http://t.co/2PbPYmZoVH @Euregistry
to_user_id_str
in_reply_to_status_id
id
332636914261831680
profile_image_url_https source
<a href="http://twitter.com/">web</a>
geocode
37.781157,-122.398720,25mi
id_str
332636914261831680
from_user_name
Dynadot
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
Dynadot
from_user_id
89060745
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:23:15 +0000
location
San Mateo, CA
in_reply_to_status_id_str
from_user_id_str
89060745
place
geo
text
I think I might go to Central Europe next summer :o
to_user_id_str
in_reply_to_status_id
id
332635594591174657
profile_image_url_https source
<a href="http://twitter.com/download/iphone">Twitter for iPhone</a>
geocode
37.781157,-122.398720,25mi
id_str
332635594591174657
from_user_name
CarouselSniperVictim
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
EricParkerAsc
from_user_id
870195673
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:18:00 +0000
location
in_reply_to_status_id_str
from_user_id_str
870195673
place
{'type': 'CITY', 'id': '51d80bae0d6cb453', 'full_name': 'Fairview'}
geo
{'type': 'Point', 'coordinates': [37.6866996929, -122.0547432772]}
text
Yet another brazen robbery. - Focus Turns to 3 Suspects in Belgian Diamond Robbery, via @nytimes http://t.co/sbJ5y2j11P
to_user_id_str
in_reply_to_status_id
id
332634567586488320
profile_image_url_https source
<a href="http://itunes.apple.com/us/app/nytimes/id284862083?mt=8&uo=4">NYTimes on iOS</a>
geocode
37.781157,-122.398720,25mi
id_str
332634567586488320
from_user_name
Dushka Zapata
metadata
{'result_type': 'recent'}
profile_image_url to_user
from_user
DushkaAmateur
from_user_id
20890666
to_user_id
iso_language_code
en
to_user_name
created_at
Thu, 09 May 2013 23:13:55 +0000
location
San Francisco
in_reply_to_status_id_str
from_user_id_str
20890666
place
geo

Statistics

Total run time: less than 5 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 37.5 KB

History

  • Manually ran revision bf5147e7 and failed .
    nothing changed in the database
    1 page scraped
  • Created on morph.io