Cristoph / metacritic_scraper_2

Metacritic Scraper

Scrapes www.metacritic.com and www.gov.uk


A modified scraper to collate video game review data from Metacritic.

Data includes:

-Title
-Publisher
-Release Date
-Metascore
-ESRB Rating

Currently set to: PSP

Forked from ScraperWiki

Contributors Cristoph

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 9, in <module> html = scraperwiki.scrape(url) File "/app/.heroku/src/scraperwiki/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Statistics

Total run time: half a minute

Total cpu time used: less than 5 seconds

Total disk space used: 16.7 MB

History

  • Manually ran revision cf3ddc5e and failed .
    nothing changed in the database
    5 pages scraped
  • Forked from ScraperWiki

Scraper code

Python

metacritic_scraper_2 / scraper.py