By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Gaming - Review Inflation

Khuutra said:
Onyxmeth, would you say that the ideal scoring system - at least in theory - would be to drop a scoring system altogether?

Absolutely. That would fix almost every problem. It's not that scoring is a bad thing either. It's just that the people in this artistic field(if gaming truly is an art) are not responsible enough to be dealing with numbers. It would have to be something many publications were in agreement with though. Having one or two sites do it would be useless.



Tag: Became a freaking mod and a complete douche, coincidentally, at the same time.



Around the Network
Onyxmeth said:
Khuutra said:
Onyxmeth, would you say that the ideal scoring system - at least in theory - would be to drop a scoring system altogether?

Absolutely. That would fix almost every problem. It's not that scoring is a bad thing either. It's just that the people in this artistic field(if gaming truly is an art) are not responsible enough to be dealing with numbers. It would have to be something many publications were in agreement with though. Having one or two sites do it would be useless.

We are in general agreement, then.

Though I do disagree on one point: get two or three sites that are big enough, and when they change it will make a difference.



Khuutra said:
Onyxmeth said:
Khuutra said:
Onyxmeth, would you say that the ideal scoring system - at least in theory - would be to drop a scoring system altogether?

Absolutely. That would fix almost every problem. It's not that scoring is a bad thing either. It's just that the people in this artistic field(if gaming truly is an art) are not responsible enough to be dealing with numbers. It would have to be something many publications were in agreement with though. Having one or two sites do it would be useless.

We are in general agreement, then.

Though I do disagree on one point: get two or three sites that are big enough, and when they change it will make a difference.

Well if it's IGN, Gamespot and Game Informer, I suppose that could be enough to spark some change. If we're talking about Giant Bomb, VGChartz and Eurogamer though, not a shot in hell.



Tag: Became a freaking mod and a complete douche, coincidentally, at the same time.



Onyxmeth said:

It's because the there is no accountability and because most publications don't have any clue as to how to review games. They review games like they are software like Windows 7 and not like they are art. There is just far to much agreement between reviewers, which is unprecedented and wholy unique for gaming. There isn't a movie, book or album, even the year's best that won't have a wide range of reviews starting in the 90+ and with a low end under the 50s. So there are two ways to look at this. The first is that games are not art, and reviewers are correct to review them the way they do, or that games are art and reviewers need to extract the artistic merit of each release and not rate them like they would software.

Secondly, unlike other areas of critical review, game reviewers seem to be scared of one another and scared to buck the trend. It doesn't matter where you go, even on VGChartz. We've formulated a certain way to judge games and that has caused us to be in general agreement. Reviewers pick up on this and adjust the way they review. This in turn has narrowed the field in which to review games. Very bad games that no one should play take up 50% of the potential scoring. Effectively, they've condensed the scoring. I see it like this:

95-100=Classic
90-94=Amazing
85-89=Great
80-84=Good
70-79=Average

60-69=Below Average/Mediocre
50-59=Bad
40-49=Shovelware Level 1
30-39=Shovelware Level 2
20-29=Shovelware Level 3
10-19=Shovelware Level 4
0-9=Shovelware Level 5

Notice how much of the general scoring is used to categorize games no one wants to play anyways? Really, what's the difference between the games in that bottom half anyways? Effectively, there's very little difference between a game that is a 45 and a game that is a 25. If both are practically unplayable messes (which is another sign that games get reviewed on general performance and functionality), then why have such a long range to seperate them? Why not use a 10-20 point scale for games of that quality and open up the rest of the field?

Lastly, you have pressure to one up the next guy to entice people to read your website/magazine, and you do that by having sensationalistic reviews. There's one publication that recently gave Uncharted 2 an 11...out of 10. It's that type of one-upsmanship that will cripple any chance of game reviewing to be legitimately worth reading. Not to mention how much emphasis is put on game reviews to bring in readership. Do you think Rolling Stone or Entertainment Weekly has to advertise on their cover almost every month that a certain big name movie, book or album is getting reviewed? Absolutely not. Now look at gaming magazines and tell me what you see on the front cover. "FIRST EXCLUSIVE REVIEW OF HALO 3: ODST!"

Hey now 7.9 is good on my scale you don't hit average until the 5 range.  But in general I'd have to admit that the "average" game has a bit more work put into it and a bit more fun which temps many people (myself included) to give a game an above average reccomendation (see the monthly blockbuster hit title every month, it may be average but man will it usually be fun)



MaxwellGT2000 - "Does the amount of times you beat it count towards how hardcore you are?"

Wii Friend Code - 5882 9717 7391 0918 (PM me if you add me), PSN - MaxwellGT2000, XBL - BlkKniteCecil, MaxwellGT2000

It's because of the many flaws (imo) in the scoring system that I simply can't trust scores and the only good information I get is from reading the review. Drop the scores and force people to actually read the reviews (yes, I'm that evil...)



Around the Network

It's not that reviewers think most games are better than average, they think they are on average better.



forest-spirit said:
It's because of the many flaws (imo) in the scoring system that I simply can't trust scores and the only good information I get is from reading the review. Drop the scores and force people to actually read the reviews (yes, I'm that evil...)


Other people are saying this too, and it's not that I disagree, but I don't agree either. Unfortunately, to rely on a critic's score, you need to know the critic well. Observe how he/she rates other games. Just looking at a number will not help at all.

Metacritic stuff is just awful, don't even look at that.

My suggestion, find a few critics you trust, and really observe/analyze how they rate, what they think of as good or bad in a game. Some things will be small quirky things, but maybe you have the same small quirky likes/dislikes.



I was diheartened when the community here chose the 100 point scale for this website's reviews.... although the poll did I think have 2 different ones that are essentially the same scoring system (0.0, 0.1, 0.3 through to 9.9, 10.0.... and out of 100 are the same thing)

Out of 5 or less if a score is somehow vitally needed.



Onyxmeth said:

It's because the there is no accountability and because most publications don't have any clue as to how to review games. They review games like they are software like Windows 7 and not like they are art. There is just far to much agreement between reviewers, which is unprecedented and wholy unique for gaming. There isn't a movie, book or album, even the year's best that won't have a wide range of reviews starting in the 90+ and with a low end under the 50s. So there are two ways to look at this. The first is that games are not art, and reviewers are correct to review them the way they do, or that games are art and reviewers need to extract the artistic merit of each release and not rate them like they would software.

Secondly, unlike other areas of critical review, game reviewers seem to be scared of one another and scared to buck the trend. It doesn't matter where you go, even on VGChartz. We've formulated a certain way to judge games and that has caused us to be in general agreement. Reviewers pick up on this and adjust the way they review. This in turn has narrowed the field in which to review games. Very bad games that no one should play take up 50% of the potential scoring. Effectively, they've condensed the scoring. I see it like this:

95-100=Classic
90-94=Amazing
85-89=Great
80-84=Good
70-79=Average
60-69=Below Average/Mediocre
50-59=Bad
40-49=Shovelware Level 1
30-39=Shovelware Level 2
20-29=Shovelware Level 3
10-19=Shovelware Level 4
0-9=Shovelware Level 5

Notice how much of the general scoring is used to categorize games no one wants to play anyways? Really, what's the difference between the games in that bottom half anyways? Effectively, there's very little difference between a game that is a 45 and a game that is a 25. If both are practically unplayable messes (which is another sign that games get reviewed on general performance and functionality), then why have such a long range to seperate them? Why not use a 10-20 point scale for games of that quality and open up the rest of the field?

Lastly, you have pressure to one up the next guy to entice people to read your website/magazine, and you do that by having sensationalistic reviews. There's one publication that recently gave Uncharted 2 an 11...out of 10. It's that type of one-upsmanship that will cripple any chance of game reviewing to be legitimately worth reading. Not to mention how much emphasis is put on game reviews to bring in readership. Do you think Rolling Stone or Entertainment Weekly has to advertise on their cover almost every month that a certain big name movie, book or album is getting reviewed? Absolutely not. Now look at gaming magazines and tell me what you see on the front cover. "FIRST EXCLUSIVE REVIEW OF HALO 3: ODST!"


This standard comes way back from the n64 days.  The console had a very limited catalog of games, but you will all agree that those games where some of the best ever made, most of them easily and deservingly making it into the high and mid 90's in most reliable reviews.  If a game had less than 90, you weren't going to buy it, because there were too many good games out there, so forget about even thinking that someone would buy a game with a 60% or 70% score.  This is why the 70's began to be taken as an avarage instead of the 50's.  The standards were just too high.

The PS2 only solidified this mentality.  Too many good games to be caring about anything under the 80's mark. 



                                                                           

I'd say that Average is about 6.5-7.0