Khuutra said:
Except that you don't actually know who's getting more weight, here. There's no transparency to the system. We don't even know if the weight is the same for sites between different reviews. I don't hold one reviewer's set of opinions as being inherently higher than others. IGN's been around for about 15 years or so now (probably longer), but they still employ some of the worst reviewers in the industry. Giving them higher weight because of their age or popularity doesn't add to the veracity of metascore, it subtracts from it. Keep in mind that the age of a publication has almost nothing to do with the experience of its reviewers, though it often has something to do with the experience of its editorial staff. No, I prefer a simple mean average, unweighted, so I can see how the game actually reviewed. If I want to just look at a few sites, I'll just look at a few sites. If I just want to average a few sites, I'll do that. If I want to weight a few sites, as we do in our heads by giving more prominence to certain publications (Edge and Eurogamer for me, though I still disagree with them a lot), then I'll do that. Review aggregates should leave the averages alone, or be transparent in how they weight them. |
That's why I said "It's a strange system and one I'm uncomfortable with, but I see why they do it".
I completely agree with you though. Age of site =/= knowledge of staff. Staff get recycled every year or so, and, even if they don't, everyone has their own opinion. You can't aggregate that...unless everyone was to use exactly the same scale with exactly the same meaning for each score (e.g. 10 perfection, 9 amazing, 8 great, 7 good, 6 above average, 5 average, 4 below average, 3 poor, 2 bad, 1 terrible, 0 never happened). That way the weighting system could work, prvided we had enough reliable information to extrapolate from.
At this moment, we don't, and thus sites like Metacritic are useless aside from compling reviews to read, not the overall score.
Also- UK commercial. I like. Straight to the point. We should have more ads like this...
http://www.youtube.com/watch?v=q0m3j0AYyaA







