ykyaw / metacritic_scraper

Metacritic Scraper


A modified scraper to collate video game review data from Metacritic.

Data includes:

-Title
-Publisher
-Release Date
-Metascore
-ESRB Rating

Currently set to: PSP

Forked from ScraperWiki

Last run failed with status code 1.

Console output of last run

Traceback (most recent call last): File "/repo/scraper.py", line 9, in <module> html = scraperwiki.scrape(url) File "/usr/local/lib/python2.7/dist-packages/scraperwiki-0.3.7-py2.7.egg/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/usr/lib/python2.7/urllib2.py", line 406, in open response = meth(req, response) File "/usr/lib/python2.7/urllib2.py", line 519, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python2.7/urllib2.py", line 444, in error return self._call_chain(*args) File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain result = func(*args) File "/usr/lib/python2.7/urllib2.py", line 527, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Data

Downloaded 11 times by dplineberry MikeRalphson prajendr Salindurthas

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (16.7 MB) Use the API

rows 10 / 15575

publisher rating title url genre score release type image
MumboJumbo
E
7 Wonders of the Ancient World
/game/psp/7-wonders-of-the-ancient-world
Miscellaneous, Puzzle, General
51
Apr 23, 2007
0
Nordcurrent
-1
101-in-1 Megamix
/game/psp/101-in-1-megamix
Miscellaneous, Compilation
-1
Sep 21, 2010
0
EA Sports
E
2010 FIFA World Cup South Africa
/game/psp/2010-fifa-world-cup-south-africa
Sports, Traditional, Soccer, Sim
69
Apr 27, 2010
0
StormBASIC Games
-1
3, 2, 1...Supercrash!
/game/psp/3-2-1supercrash!
Miscellaneous, Puzzle, General
-1
Nov 9, 2010
0
Warner Bros. Interactive Entertainment
M
300: March to Glory
/game/psp/300-march-to-glory
Action, Beat-'Em-Up
55
Feb 27, 2007
0
Sanuk Games
E
3D Twist & Match
/game/psp/3d-twist-match
Miscellaneous, Puzzle, Matching, Puzzle
-1
Apr 12, 2011
0
Invictus Games
-1
4x4 Jam
/game/psp/4x4-jam
Driving, General
-1
Jul 6, 2010
0
_No Company, Grip Games
E
5-in-1 Arcade Hits
/game/psp/5-in-1-arcade-hits
Miscellaneous, Puzzle, General
-1
Jul 6, 2010
0
Digital Leisure Inc.
-1
5-in-1 Solitaire
/game/psp/5-in-1-solitaire
Miscellaneous, Board Games
-1
Jan 18, 2011
0
Vivendi Games
M
50 Cent: Bulletproof G Unit Edition
/game/psp/50-cent-bulletproof-g-unit-edition
Action Adventure, Modern
52
Aug 29, 2006
0

Statistics

Total run time: less than 5 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 16.7 MB

History

  • Manually ran revision c0b52e95 and failed .
    nothing changed in the database
  • Forked from ScraperWiki

Scraper code

Python

metacritic_scraper / scraper.py