noahzheutlin / metacritic_scraper

Metacritic Scraper


Contributors noahzheutlin

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 14, in <module> html = scraperwiki.scrape(url) File "/app/.heroku/src/scraperwiki/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Data

Downloaded 3 times by csgnyc

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.06 MB) Use the API

rows 10 / 16178

url date_scraped score type title
/movie/devil
2011-03-22T00:55:29.821784
44
dvds/release-date/new-releases
Devil
/movie/wall-street-money-never-sleeps
2011-03-22T00:55:29.855791
59
dvds/release-date/new-releases
Wall Street: Money Never Sleeps
/movie/salt
2011-03-22T00:55:29.896490
65
dvds/release-date/new-releases
Salt
/movie/easy-a
2011-03-22T00:55:29.904561
72
dvds/release-date/new-releases
Easy A
/movie/i-am-you
2011-03-22T00:55:36.096505
-1
movies/release-date/theaters
In Her Skin
/movie/orgasm-inc
2011-03-22T00:55:36.153386
67
movies/release-date/theaters
Orgasm Inc.
/movie/vidal-sassoon-the-movie
2011-03-22T00:55:36.271930
62
movies/release-date/theaters
Vidal Sassoon: The Movie
/movie/poetry
2011-03-22T00:55:36.333963
87
movies/release-date/theaters
Poetry
/movie/even-the-rain
2011-03-22T00:55:37.129292
68
movies/release-date/theaters
Even the Rain (Tambien la Lluvia)
/movie/cold-weather
2011-03-22T00:55:37.258478
63
movies/release-date/theaters
Cold Weather

Statistics

Total run time: less than 10 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 3.08 MB

History

  • Manually ran revision f0b84e6f and failed .
    nothing changed in the database
  • Manually ran revision 884aafb6 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

metacritic_scraper