Profrektius said:
Yea, I have been thinking about the average of metascores and how it has some problems. Some sites like Gamespot seem to be doing it wrong, they are supposed to specify a platform they played it on and it would only count for that unless indicated they played the other versions too, but from their review it appears they only played one version, yet they claim the review for all three platforms. (By the way, I wouldn't worry about the score yet, I imagine more reviews will come after the game actually releases, and the metascore might change significantly.) There are also problems of Arkham Knight kind of cases, where the PC version messing up drags the score down significalty due to performace issues on one of the platforms. It could be argued that we have to able to predict any potential issues any platform might have and account for it, but as in the case of Arkham Knight, there wasn't really sufficient info available to predict such a thing. Similarily now with Quantum Break, once the PC version gets enough reviews, will drag the score down, due to performance problems. (This could have been predicted due to UWP, Win 10 and lack of PC info, but is that what these predictions are really about?) As well as simply one platform having significantly less reviews, yet being weighed equally with other platforms when the average is taken. While I will not change the rules in the middle of a month, if I would change them I could change them starting with May (as you need to inform people beforehand about the rules). One of the alternatives I was thinking, was to only count the version with the most reviews. No doubt this could have problems too (Like what if two versions have vastly different scores, and both have many reviews, but I would then have to completely ignore the version with for example 2 less reviews. And obviously I couldn't go case by case basis, as involving subjectivity in scoring here is a not a good idea.). Would you prefer such a method, or what were you thinking exactly? What other methods do you think could work? |
Well the other problem is Metacritic weights individual scores too, so we have no idea what weighting they give the Gamespot score compared the the Jimquisition. But you could perhaps weight the metascores by taking account of the number of reviews on each platform.
“The fundamental cause of the trouble is that in the modern world the stupid are cocksure while the intelligent are full of doubt.” - Bertrand Russell
"When the power of love overcomes the love of power, the world will know peace."
Jimi Hendrix