| Picko said: Firstly, in statistical terms OoT does not really have enough reviews for those reviews to be a reliable indicator of the games quality. Worth noting that basically no game does but the like ot OoT are particularly bad and no real meaning can be obtained by looking at the "average". Secondly, even looking at the "raw" scores there is very little difference between any of the top ten. This is particularly so given the first point I made, there is no statistically significant difference between their raw scores and no conclusions can be made about which game is better. Sad I know. Thirdly, looking at standard deviations is probably more relevant than raw scores, even acknowledging for my first point. SMG actually has a lower standard deviation, than GTA IV or OoT, based purely on raw scores and according to my brief analysis we can expect 95% of all scores to be 91.30 or higher out of a 100. This compares with: GTA IV (PS3) 91.48 GTA IV (360) 90.52 OoT (N64) 91.26 However, adjusted for statistical outliers (which I defined as reviews that were 2.5 or more standard deviations away from the mean) the results change somewhat. GTA IV (PS3) 92.78 GTA IV (360) 92.58 OoT (N64) 91.26 SMG(Wii) 91.30 That is to say, on average we expect 95% of all reviews for GTA IV (PS3) to be 92.78% or higher once outliers have been adjusted for. Adjusting for outliers reduces the standard deviation thereby reducing the range of the 95 per cent confidence intervals. If you were analysing an average game outliers would also include unusually high scores, as well as unusually low scores. Interesting note, GTA IV (PS3 and 360) and OoT (N64) are the only games released (that I could find) where over half their reviews were 100%. The next closest is Soul Calibur with 48.15%. A further interesting note, GTA IV (360) has as many 100% scores as OoT has reviews (although one or two are not counted as part of the analysis). How anyone could argue that OoT having a raw score higher than GTA IV as indicative of it being better is quite simply beyond me. Overall, there are clearly many ways to determine what game is the best reviewed. Looking at the average (adjusted for outliers) is undoubtedly superior than the Gamerankings way of looking at a purely unweighted average. By the measure GTA IV (PS3) still has quite an advantage over OoT. |
Very nice. Couldn't agree more.
Try to be reasonable... its easier than you think...











