cdhekne / ratemyprofessors

RateMyProfessors

Scrapes www.ratemyprofessors.com

Rate My Professors is the best college professor reviews and ratings source based on student feedback. Over 1.4 million professors & 15 million reviews. Find & rate

Contributors cdhekne

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... ASU Traceback (most recent call last): File "scraper.py", line 15, in <module> response = scraperwiki.scrape("http://www.ratemyprofessors.com/SelectTeacher.jsp?sid=%s&pageNo=%s" % (sid,str(i))) File "/app/.heroku/src/scraperwiki/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Data

Downloaded 40 times by cdhekne katharineclark awasthia MikeRalphson taigezhang AndreasBayerl kbbodner xunzhou Poindexter007 ryoboua valeriechizhang SamuraiViking gadevishal9 chrispagz jumarmartin

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (717 KB) Use the API

rows 10 / 7490

Name Overall Quality Total Ratings Hot Easiness Department College
Pei,
3.8
4
Not Hot
3.2
Biology
Duke
Richman, Laura
4.3
6
Hot
3.8
Psychology
Duke
Abrahamson, Michael
4.5
1
Hot
2.0
Physical Education
Harvard
Baron, Evalyn
5.0
1
Hot
3.0
Theater
Harvard
Bier, Sara
4.5
2
Not Hot
2.0
Geology
Harvard
Blaney, Paul
2.8
4
Not Hot
1.2
Psychology
Harvard
Carter, Ken
3.6
9
Not Hot
2.9
Psychology
Harvard
Coulthard, Anita
4.5
3
Not Hot
2.7
Music
Harvard
Crickmer, Janet
4.5
3
Hot
2.3
Education
Harvard
Damer, Ed
2.9
18
Not Hot
1.8
Philosophy
Harvard

Statistics

Average successful run time: 30 minutes

Total run time: 16 days

Total cpu time used: about 8 hours

Total disk space used: 738 KB

History

  • Manually ran revision 49d026d7 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 49d026d7 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 49d026d7 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 49d026d7 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 49d026d7 and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

ratemyprofessors