| Machina said: I wrote a couple of the reviews quoted in this thread. I also happen to track all of these stats, so without trying to sound my own trumpet I know more about this than anyone else on the site. Whilst your examples are clearly cherry picked, you are actually correct that, when compared with Metacritic across the board, VGC is above average for Wii games, and roughly on par for PS3 & 360 games. Now, the question is why? And the answer you've come up with is a site bias. I don't agree (I also don't agree with ioi's explanation that it's our scoring system, I find that even less convincing than yours to be honest). This is my explanation: In the case of reviews it's not a case of the site itself being biased - there's no way you could orchestrate such a bias amongst 18 different people (that's roughly how many active reviewers we have) and 5 different content editors. It's my view that the scoring differences are less about console preference, and more about how harsh or lenient the reviewer who happens to review a particular game (and own a particular console) is. I'll use Torillian as an example because I know he won't mind. His main console is the PS3 and his secondary console the Wii. I don't think anyone would accuse him of being anti-PS3 (and if they do they're plain wrong), but he's one of our harsher scorers. Given that he writes far more PS3 reviews for the site than anyone else, the end result is that for PS3 reviews we tend to be roughly in-line with Metacritic. This clearly fits my explanation better than yours (and it's the case with every single one us by the way) - is he anti-PS3? Or, more plausibly, is he one of our harsher reviews who happens to mainly review PS3 games because he actually prefers the PS3? You'll find this with our primary Wii reviewers as well - there are some who score harshly when compared with Metacritic (O-D-C is a good example), and then there are those who score generously (I won't give an example since I don't think it's fair to do so without their permission, but you could easily work it out for yourself). In short, I think the reason for the difference is the harshness/leniency of the main reviewers and which consoles they happen to own and enjoy, quite the opposite to idea of the site seeking to bump up scores for Wii games and penalise PS360 games. |
Thank you for clarifying that Machina. I think all of your answers actually partially add up to the reason why the reviews are the way they are. A combination of harsher reviewers for PS3/X360, atendency to favour gameplay over graphics, and the fact that reviews cannot be compared across platforms.
I started this topic in my mind likely to never read another VGChartz review, or at most give it very little weighting in my mind. However now after reading what you, the reviewers have to say, i see justification, in that reviews cannot be compared across systems, something i have always done, and something i believe most people do. At the end of the day i feel this topic has actually produced a fair debate and i thank you ioi for not immediately closing the thread down and allowing me to further put forward my point of view.
