By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Gaming - Is it time we fixed the review system?

To be honest, I always liked how GamePro used to do it in their magazine (I think it's changed now.

Games used to have 4 scores ranked out of 5, along with a "challenge" ranking for how hard the game is. Funfactor, graphics, sound, and control were the categories ranked on a 5 point scale.



Currently playing: Uncharted: Drake's Fortune, NBA2k11, Metal Gear Solid, Picross 3d

Around the Network
Twistedpixel said:
loves2splooge said:

I think the big problem is that game critics buy into hype WAY MORE than film critics. But film critics aren't perfect either. They have their own snobbish elitist arthouse bias. Movies that are intended to be low-brow but do a great job of being what it's intended to be (a fun low-brow movie) are often given shitty ratings (ie. 1-2 stars) because the reviewer itself has a bias in favor of the artsy high-brow stuff. A big reason for this I think has to do with the immaturity and low emotional intelligence of the average 'hardcore gamer' compared to the average movie buff IMO. Whenever a game reviewer gives a 'controversial' score for a game, you see fanboys rage on internet forums, call the reviewer all sorts of nasty things, pester the reviewer with hate mail, etc. It's no wonder society perceives hardcore gamers to be losers. Movie review readers tend to conduct themselves with a lot more maturity and class than hardcore gamers. These kind of hate-on backlashes probably have a lot to do with reviewers giving out inflated scores.

At the end of the day, it's all about opinion. There is no point in reviewers pretending to be objective because they're not supposed to be objective. This is why I don't rip into reviewers (like many fanboys do) when a reviewer gives a game I like a low score. For eg. If a reviewer wants to downgrade an Ace Attorney game because it "doesn't have a lot of real gameplay" (I've seen this used a lot when reviewing visual novels), fine. I strongly disagree with this view but I respect their opinion and the diversity of opinions you see among the many different reviewers listed on metacritic. A game like Ace Attorney isn't for everyone. And I think gamers have a right to know that when they read reviews. If I wrote a fanboy-esque review of the game, giving it a 10/10 and not pointing out things about the game that many people may find annoying (ie. the mainstream gamer), who am I helping? I'm just preaching to the choir (like-minded Ace Attorney fanboys like me). I'm not doing anything of positive benefit to gamers this way except make a lot of like-minded fanboys feel bigger in the pants.

I would like to see the scale be more like the ones film critics use (where 50%, 2/4, 2.5/5 is average) to prevent out of control score inflation. But hey, it's not a big deal. What I'm more concerned about is this whole idea people promote that reviews need to "objective". That is bullshit. Yes, you shouldn't write outright factual lies in the article (ie. saying that the game doesn't have so-and-so feature when really it does) but there's going to be a lot of subjectivity involved in giving a review. That's the reality. I may feel that a particular game is a great game but my reasons for thinking it's a great game may very well be reasons for disliking the game to another person.

Tell that to the Avatards!

In any case the problems with reviews for games also stem out of the fact that people rely on them so much because people just love to rock in their game shop first day a game is out and buy a $60 game straight up. That means that publishers like Sony, Microsoft, EA, Eidos, Activision etc want to control this process because hype, advertising, and reviewer pressure gets them their payola first day or week of release. Noone really cares what a movie reviewer says because they people rely on other information as well.

Game reviewers fall into the 'hype' crowd WAY more than movie goers.  If anything, movie critics will downscore a movie because its 'too popular' (like Ebert) while game reviewers will automatically give a game a 9.0 or above simply because they're scared of alienating their readers.  Is either side right?  Not really, as its just two sides of an extreme.



Six upcoming games you should look into:

 

  

Good lord is it time

ATTACK!!!



I would prefer that we go to text based reviews only. With a pros and cons list at the end. The score system is pretty lame.

There are some games that I feel are awesome, but it is hard to give them the same score.



Twistedpixel said:
loves2splooge said:

I think the big problem is that game critics buy into hype WAY MORE than film critics. But film critics aren't perfect either. They have their own snobbish elitist arthouse bias. Movies that are intended to be low-brow but do a great job of being what it's intended to be (a fun low-brow movie) are often given shitty ratings (ie. 1-2 stars) because the reviewer itself has a bias in favor of the artsy high-brow stuff. A big reason for this I think has to do with the immaturity and low emotional intelligence of the average 'hardcore gamer' compared to the average movie buff IMO. Whenever a game reviewer gives a 'controversial' score for a game, you see fanboys rage on internet forums, call the reviewer all sorts of nasty things, pester the reviewer with hate mail, etc. It's no wonder society perceives hardcore gamers to be losers. Movie review readers tend to conduct themselves with a lot more maturity and class than hardcore gamers. These kind of hate-on backlashes probably have a lot to do with reviewers giving out inflated scores.

At the end of the day, it's all about opinion. There is no point in reviewers pretending to be objective because they're not supposed to be objective. This is why I don't rip into reviewers (like many fanboys do) when a reviewer gives a game I like a low score. For eg. If a reviewer wants to downgrade an Ace Attorney game because it "doesn't have a lot of real gameplay" (I've seen this used a lot when reviewing visual novels), fine. I strongly disagree with this view but I respect their opinion and the diversity of opinions you see among the many different reviewers listed on metacritic. A game like Ace Attorney isn't for everyone. And I think gamers have a right to know that when they read reviews. If I wrote a fanboy-esque review of the game, giving it a 10/10 and not pointing out things about the game that many people may find annoying (ie. the mainstream gamer), who am I helping? I'm just preaching to the choir (like-minded Ace Attorney fanboys like me). I'm not doing anything of positive benefit to gamers this way except make a lot of like-minded fanboys feel bigger in the pants.

I would like to see the scale be more like the ones film critics use (where 50%, 2/4, 2.5/5 is average) to prevent out of control score inflation. But hey, it's not a big deal. What I'm more concerned about is this whole idea people promote that reviews need to "objective". That is bullshit. Yes, you shouldn't write outright factual lies in the article (ie. saying that the game doesn't have so-and-so feature when really it does) but there's going to be a lot of subjectivity involved in giving a review. That's the reality. I may feel that a particular game is a great game but my reasons for thinking it's a great game may very well be reasons for disliking the game to another person.

Tell that to the Avatards!

In any case the problems with reviews for games also stem out of the fact that people rely on them so much because people just love to rock in their game shop first day a game is out and buy a $60 game straight up. That means that publishers like Sony, Microsoft, EA, Eidos, Activision etc want to control this process because hype, advertising, and reviewer pressure gets them their payola first day or week of release. Noone really cares what a movie reviewer says because they people rely on other information as well.

OK yeah Avatar is an exception to the rule. lol. Everyone is going nuts for that movie. Oh god I'm sick of hearing about Avatar. lol. All this 3D hype bullshit. The story from what I've read doesn't seem to be anything interesting. Not interested in checking it out. Maybe I'll pirate it but I'm not going to go to one of those IMAX places or whatever and pay a fortune to see this thing just because it's zomg 3D. The 3D gimmick is so old but it looks like it's making a comeback.



Around the Network
Kenryoku_Maxis said:
Twistedpixel said:

Tell that to the Avatards!

In any case the problems with reviews for games also stem out of the fact that people rely on them so much because people just love to rock in their game shop first day a game is out and buy a $60 game straight up. That means that publishers like Sony, Microsoft, EA, Eidos, Activision etc want to control this process because hype, advertising, and reviewer pressure gets them their payola first day or week of release. Noone really cares what a movie reviewer says because they people rely on other information as well.

Game reviewers fall into the 'hype' crowd WAY more than movie goers.  If anything, movie critics will downscore a movie because its 'too popular' (like Ebert) while game reviewers will automatically give a game a 9.0 or above simply because they're scared of alienating their readers.  Is either side right?  Not really, as its just two sides of an extreme.

I suspect the answer isn't as simple as that.

Games which have high review scores tend to be popular amongst their particular genres. Very few titles score above 90 on metacritic and fail to sell more than 2M units. You could almost say that its a like-ability score rather than a score judging the qualities of the game itself. Scores like 50% for FFXIII from Edge are more an indication that the userbase which finds FF games in general appealing isn't totally satisfied with the game and lower popularity yields lower sales for the game overall.

Movie reviewers seem to review to their own standards or to standards which aren't reflected in the general public. Critical appeal doesn't mean that a movie is going to make money or please the general audiences or even appeal to them. So one can say movie reviews themselves are as irrelevant to the general public as reviewers for games are to the Wii audiences.

I suspect the biggest complaints which can be laid at game reviewers feets are that they are working for the industry as much as the reader and that they are too quick to give out high scores when they ought to have a realistic scoring grade. At present games are scored for the people who are definately getting the title in question or very tempted to, whereas they ought to be a guide for people who may not be directly interested in the series in question. Reviews for games are meant to be a buyers guide, but not for buyers who have already made up their minds!

 



Do you know what its like to live on the far side of Uranus?

Twistedpixel said:
Kenryoku_Maxis said:
Twistedpixel said:

Tell that to the Avatards!

In any case the problems with reviews for games also stem out of the fact that people rely on them so much because people just love to rock in their game shop first day a game is out and buy a $60 game straight up. That means that publishers like Sony, Microsoft, EA, Eidos, Activision etc want to control this process because hype, advertising, and reviewer pressure gets them their payola first day or week of release. Noone really cares what a movie reviewer says because they people rely on other information as well.

Game reviewers fall into the 'hype' crowd WAY more than movie goers.  If anything, movie critics will downscore a movie because its 'too popular' (like Ebert) while game reviewers will automatically give a game a 9.0 or above simply because they're scared of alienating their readers.  Is either side right?  Not really, as its just two sides of an extreme.

I suspect the answer isn't as simple as that.

Games which have high review scores tend to be popular amongst their particular genres. Very few titles score above 90 on metacritic and fail to sell more than 2M units. You could almost say that its a like-ability score rather than a score judging the qualities of the game itself. Scores like 50% for FFXIII from Edge are more an indication that the userbase which finds FF games in general appealing isn't totally satisfied with the game and lower popularity yields lower sales for the game overall.

Movie reviewers seem to review to their own standards or to standards which aren't reflected in the general public. Critical appeal doesn't mean that a movie is going to make money or please the general audiences or even appeal to them. So one can say movie reviews themselves are as irrelevant to the general public as reviewers for games are to the Wii audiences.

I suspect the biggest complaints which can be laid at game reviewers feets are that they are working for the industry as much as the reader and that they are too quick to give out high scores when they ought to have a realistic scoring grade. At present games are scored for the people who are definately getting the title in question or very tempted to, whereas they ought to be a guide for people who may not be directly interested in the series in question. Reviews for games are meant to be a buyers guide, but not for buyers who have already made up their minds!

 

Amd ultimately, reviewers shouldn't be trying to influence people to buy or not buy a game.  Just reporting what is there through a system of reporting what the content is.  And likewise, they shouldn't be using their reviews as some sort of indirect way to 'influence the gaming industry', as it seems any reviewers have been trying to do this gen.  Especially in reference to Nintendo and Japanese based games as a whole.



Six upcoming games you should look into:

 

  

I see now that Ebert gave Avatar 4 stars. I figured that someone like him would snob this kind of movie but I guess not. Sad to see that even the film critics are buying into hype like this.



loves2splooge said:
I see now that Ebert gave Avatar 4 stars. I figured that someone like him would snob this kind of movie but I guess not. Sad to see that even the film critics are buying into hype like this.

Ebert seems to have a heavy bias towards all animation and CGI.  Always using worlds like 'fun' and 'plesant romp' to describe it.  I guess he just thinks everything with a hint of 'animation' (CG or otherwise) automatically = good.  And I guess, in some limited way, Avatar counts towards that too.  Though I certainly wouldn't put it in that category.  That's like calling Jurassic Park a CG movie.



Six upcoming games you should look into:

 

  

Personally, I think there is a very easy way to fix the review system:

Use an IMDB-style peer-review system. Going further than simply blind reviews, require user IDs for players reviewing the game.

For example, if I owned an Xbox 360 and wanted to review Deadly Premonition. In order to rate the game, the website would scan my gamercard (the one I tie into my reviewer account) to ensure that I indeed own the game.

That way, you'd only get reviews by users that have played and beaten the game. It could go even further with PSN/XBL IDs and check for achievements/trophies that are earned when you complete the game, to weight reviews by users that actually completed the game vs. those that may show that they are halfway through the game.

I think it'd go a long way for professional journalism, too. I hate it when someone reviews a game when its obvious they didn't play it long enough. For once, I'd love to see the reviewers gamercard to see exactly what achievements they unlocked to prove or disprove if they even beat the title in the first place.



Back from the dead, I'm afraid.