ykyaw / metacritic_scraper

Metacritic Scraper


A modified scraper to collate video game review data from Metacritic.

Data includes:

-Title
-Publisher
-Release Date
-Metascore
-ESRB Rating

Currently set to: PSP

Forked from ScraperWiki

Contributors ykyaw

Last run failed with status code 1.

Console output of last run

Traceback (most recent call last): File "/repo/scraper.py", line 9, in <module> html = scraperwiki.scrape(url) File "/usr/local/lib/python2.7/dist-packages/scraperwiki-0.3.7-py2.7.egg/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/usr/lib/python2.7/urllib2.py", line 406, in open response = meth(req, response) File "/usr/lib/python2.7/urllib2.py", line 519, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python2.7/urllib2.py", line 444, in error return self._call_chain(*args) File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain result = func(*args) File "/usr/lib/python2.7/urllib2.py", line 527, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Data

Downloaded 10 times by dplineberry MikeRalphson prajendr

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (16.7 MB) Use the API

rows 10 / 15575

publisher rating title url genre score release type image
MumboJumbo
E
7 Wonders of the Ancient World
/game/psp/7-wonders-of-the-ancient-world
Miscellaneous, Puzzle, General
51
Apr 23, 2007
0
Nordcurrent
-1
101-in-1 Megamix
/game/psp/101-in-1-megamix
Miscellaneous, Compilation
-1
Sep 21, 2010
0
EA Sports
E
2010 FIFA World Cup South Africa
/game/psp/2010-fifa-world-cup-south-africa
Sports, Traditional, Soccer, Sim
69
Apr 27, 2010
0
StormBASIC Games
-1
3, 2, 1...Supercrash!
/game/psp/3-2-1supercrash!
Miscellaneous, Puzzle, General
-1
Nov 9, 2010
0
Warner Bros. Interactive Entertainment
M
300: March to Glory
/game/psp/300-march-to-glory
Action, Beat-'Em-Up
55
Feb 27, 2007
0
Sanuk Games
E
3D Twist & Match
/game/psp/3d-twist-match
Miscellaneous, Puzzle, Matching, Puzzle
-1
Apr 12, 2011
0
Invictus Games
-1
4x4 Jam
/game/psp/4x4-jam
Driving, General
-1
Jul 6, 2010
0
_No Company, Grip Games
E
5-in-1 Arcade Hits
/game/psp/5-in-1-arcade-hits
Miscellaneous, Puzzle, General
-1
Jul 6, 2010
0
Digital Leisure Inc.
-1
5-in-1 Solitaire
/game/psp/5-in-1-solitaire
Miscellaneous, Board Games
-1
Jan 18, 2011
0
Vivendi Games
M
50 Cent: Bulletproof G Unit Edition
/game/psp/50-cent-bulletproof-g-unit-edition
Action Adventure, Modern
52
Aug 29, 2006
0

Statistics

Total run time: less than 5 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 16.7 MB

History

  • Manually ran revision c0b52e95 and failed .
    nothing changed in the database
  • Forked from ScraperWiki

Scraper code

Python

metacritic_scraper / scraper.py