specialk said:
It gives you all the data you need to do it yourself. i.e. average score, number of positive, negative, mixed reviews. Quotations from the reviews itself. It doesn't take too much reading and looking into to determine what's what. You can do all sorts of things to make the average score itself "better" or "more accurate", but just a score alone will always be imperfect. Even if you could develop a system for weeding people out, you still lose valuable information. For example, if you could limit reviews to only people who have finished the game, you're biasing towards people who thought the game was good enough to be worth finishing. You're losing out on the opinion of everyone who dropped out 5 hours in. |
You're putting too much faith on people's honesty. Anyone could pretend they've finished a game or are big fans of the developers and then give it a low score because in reality they've never played the game and probably own a rival console. That's why user scores or reviews are meaningless. People lie.
And this is what the Metacritic founder said when LittleBigPlanet got swarmed with haters back in 2008:
"My advice for our faithful users is to focus your attention on the Metascore for this game and not the thousands of user votes, most of which have been submitted before said users have played the game. This is a gaming community, and if people want to stuff the ballot box, there’s not much I can do at this point."
That was the final nail in the coffin for me.