For countless centuries, gamers have asked the question of "What Impact do reviews have on the sales of games?" Some say that positive reviews are the nectar that games need to thrive, while others say that games sell based on brand name and word of mouth. So in order to settle this debate for once and for all, I decided to try and determine the exact numerical relationship between game review scores and a game's sales.
To start, I decided to work with a platform that has both been closely followed by the online gaming community, thus guaranteeing hundreds of games with Metascores and sales numbers on VGChartz, and yet is mostly a "finished" platform, with few notable releases in recent years: the PSP. I was also considering the Wii, but figured that the bundling of games on the Wii made the PSP a better choice.
The Plan
- First, open up a VGChartz page showing the Top 1000 best-selling PSP games. This includes 5/6 of retail PSP titles to sell at least 10,000 copies, and also eliminates games that have probably not been well tracked.
- Next, open up Metacritic's list of every PSP game to ever be reviewed in the West. In order to have a Metascore, four reputable Western reviewers need to have given it a review.
- Games with Metascores of under 51 are excluded, mostly due to logistical and software error reasons.
- In total, this gives us exactly 460 games. These 460 games not only have tracked sales and reviews, but also represent over 200 million copies of games sold. This is about 70% of all PSP software sales, which is not bad considering how many games were released only in Japan (particularly Monster Hunter 3 Portable, which is about 2% by itself) and thus never got Metascores.
- Games are then categorized by Metascore, both each individual point and in groups of 5 or more points. Each category then gets its average sales per game calculated.
The Results:
I'm going to show the graphs first, then the tables,
| Score | Number of Titles | Combined Sales | Average Sales |
| 91 | 1 | 3.13 | 3.13 |
| 90 | 1 | 1.02 | 1.02 |
| 89 | 3 | 3.56 | 1.186666667 |
| 88 | 5 | 13.7 | 2.74 |
| 87 | 6 | 4.87 | 0.811666667 |
| 86 | 5 | 7.52 | 1.504 |
| 85 | 3 | 4.45 | 1.483333333 |
| 84 | 6 | 2.54 | 0.423333333 |
| 83 | 10 | 8.28 | 0.828 |
| 82 | 11 | 6.46 | 0.587272727 |
| 81 | 12 | 11.67 | 0.9725 |
| 80 | 16 | 6.99 | 0.436875 |
| 79 | 19 | 8.19 | 0.431052632 |
| 78 | 17 | 5.83 | 0.342941176 |
| 77 | 13 | 2.86 | 0.22 |
| 76 | 9 | 3.31 | 0.367777778 |
| 75 | 17 | 6.64 | 0.390588235 |
| 74 | 22 | 12.9 | 0.586363636 |
| 73 | 17 | 9.18 | 0.54 |
| 72 | 19 | 8.76 | 0.461052632 |
| 71 | 8 | 6.63 | 0.82875 |
| 70 | 17 | 7.51 | 0.441764706 |
| 69 | 15 | 6.28 | 0.418666667 |
| 68 | 24 | 8.65 | 0.360416667 |
| 67 | 14 | 3.1 | 0.221428571 |
| 66 | 12 | 2.79 | 0.2325 |
| 65 | 13 | 5.03 | 0.386923077 |
| 64 | 18 | 8.56 | 0.475555556 |
| 63 | 20 | 4.88 | 0.244 |
| 62 | 8 | 1.1 | 0.1375 |
| 61 | 13 | 2.31 | 0.177692308 |
| 60 | 11 | 3.87 | 0.351818182 |
| 59 | 9 | 3.19 | 0.354444444 |
| 58 | 12 | 1.82 | 0.151666667 |
| 57 | 12 | 2.92 | 0.243333333 |
| 56 | 7 | 0.88 | 0.125714286 |
| 55 | 7 | 1.08 | 0.154285714 |
| 54 | 7 | 0.6 | 0.085714286 |
| 53 | 3 | 0.86 | 0.286666667 |
| 52 | 8 | 2.79 | 0.34875 |
| 51 | 10 | 1.11 | 0.111 |
| Score | Number of Titles | Combined Sales | Average Sales |
| 86 Plus | 21 | 33.8 | 1.60952381 |
| 81 to 85 | 42 | 33.4 | 0.795238095 |
| 76 to 80 | 74 | 27.18 | 0.367297297 |
| 71 to 75 | 83 | 44.11 | 0.531445783 |
| 66 to 70 | 82 | 28.33 | 0.345487805 |
| 61 to 65 | 72 | 21.88 | 0.303888889 |
| 56 to 60 | 51 | 12.68 | 0.248627451 |
| 51 to 55 | 35 | 6.44 | 0.184 |
Observations:
The results of this study are interesting to say the least.
- First of all, the best-reviewed games DID sell the best. These included games like Grand Theft Auto, God of War, and Metal Gear Solid. Games with a Metascore of 86 or more sold over twice as much on average as games rated only 81 to 85.
- HOWEVER, after reaching the mid-70's, average game sales did not continue to decline at the same constant rate as previously. Games rated 71 to 75 on Metacritic sold about 0.17 million MORE than their 76 to 80 counterparts. This can be explained by games like Gran Turismo, Monster Hunter Freedom 2, LEGO titles, and various sports games, which scored in the lower 70's range.
- You'd expect this to be the anamoly, but the 61 to 70 range didn't sell that much worse than the 76 to 80 range. Games in the 61 to 70 range included licensed games, sports and racing games, Call of Duty, Final Fantasy, and console ports.
- Sales below 60 continued to fall at a surprisingly slow rate compared to the 76+ games' rate.51 to 55 games only sold about 40% less than games rated 10 points higher.
- Incidentally, these are larger trends. It is VERY difficult to determine what the next point of data will be like, simply because any next game could have been a big seller despite reviews.
Conclusions:
First of all, it appears that there IS a positive correlation between the review scores of games and their sales, at least on the PSP. However, said relationship loses most of its impact once you stop working with the upper tiers of games. In other words, getting a 77 on your game instead of 87 is MUCH worse than getting a 67 instead of a 77.
What this means is that BOTH sides of the argument are right. Although high-scoring reviews certainly seem to help a game, they are NOT necessary for them to sell decently.
So yeah. I'll probably add more stuff to the OP later, but this took me much of the night to do and I'm tired.
Love and tolerate.
