By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Sony Discussion - The Impact of Reviews on the Sales of PSP Games

Tagged games:

For countless centuries, gamers have asked the question of "What Impact do reviews have on the sales of games?" Some say that positive reviews are the nectar that games need to thrive, while others say that games sell based on brand name and word of mouth. So in order to settle this debate for once and for all, I decided to try and determine the exact numerical relationship between game review scores and a game's sales.

To start, I decided to work with a platform that has both been closely followed by the online gaming community, thus guaranteeing hundreds of games with Metascores and sales numbers on VGChartz, and yet is mostly a "finished" platform, with few notable releases in recent years: the PSP. I was also considering the Wii, but figured that the bundling of games on the Wii made the PSP a better choice.

 

The Plan

  • First, open up a VGChartz page showing the Top 1000 best-selling PSP games. This includes 5/6 of retail PSP titles to sell at least 10,000 copies, and also eliminates games that have probably not been well tracked.
  • Next, open up Metacritic's list of every PSP game to ever be reviewed in the West. In order to have a Metascore, four reputable Western reviewers need to have given it a review.
  • Games with Metascores of under 51 are excluded, mostly due to logistical and software error reasons.
  • In total, this gives us exactly 460 games. These 460 games not only have tracked sales and reviews, but also represent over 200 million copies of games sold. This is about 70% of all PSP software sales, which is not bad considering how many games were released only in Japan (particularly Monster Hunter 3 Portable, which is about 2% by itself) and thus never got Metascores.
  • Games are then categorized by Metascore, both each individual point and in groups of 5 or more points. Each category then gets its average sales per game calculated.

 

The Results:

I'm going to show the graphs first, then the tables,

 

 

Score Number of Titles Combined Sales Average Sales
91 1 3.13 3.13
90 1 1.02 1.02
89 3 3.56 1.186666667
88 5 13.7 2.74
87 6 4.87 0.811666667
86 5 7.52 1.504
85 3 4.45 1.483333333
84 6 2.54 0.423333333
83 10 8.28 0.828
82 11 6.46 0.587272727
81 12 11.67 0.9725
80 16 6.99 0.436875
79 19 8.19 0.431052632
78 17 5.83 0.342941176
77 13 2.86 0.22
76 9 3.31 0.367777778
75 17 6.64 0.390588235
74 22 12.9 0.586363636
73 17 9.18 0.54
72 19 8.76 0.461052632
71 8 6.63 0.82875
70 17 7.51 0.441764706
69 15 6.28 0.418666667
68 24 8.65 0.360416667
67 14 3.1 0.221428571
66 12 2.79 0.2325
65 13 5.03 0.386923077
64 18 8.56 0.475555556
63 20 4.88 0.244
62 8 1.1 0.1375
61 13 2.31 0.177692308
60 11 3.87 0.351818182
59 9 3.19 0.354444444
58 12 1.82 0.151666667
57 12 2.92 0.243333333
56 7 0.88 0.125714286
55 7 1.08 0.154285714
54 7 0.6 0.085714286
53 3 0.86 0.286666667
52 8 2.79 0.34875
51 10 1.11 0.111

 

Score Number of Titles Combined Sales Average Sales
86 Plus 21 33.8 1.60952381
81 to 85 42 33.4 0.795238095
76 to 80 74 27.18 0.367297297
71 to 75 83 44.11 0.531445783
66 to 70 82 28.33 0.345487805
61 to 65 72 21.88 0.303888889
56 to 60 51 12.68 0.248627451
51 to 55 35 6.44 0.184

 

Observations:

The results of this study are interesting to say the least.

  • First of all, the best-reviewed games DID sell the best. These included games like Grand Theft Auto, God of War, and Metal Gear Solid. Games with a Metascore of 86 or more sold over twice as much on average as games rated only 81 to 85.
  • HOWEVER, after reaching the mid-70's, average game sales did not continue to decline at the same constant rate as previously. Games rated 71 to 75 on Metacritic sold about 0.17 million MORE than their 76 to 80 counterparts. This can be explained by games like Gran Turismo, Monster Hunter Freedom 2, LEGO titles, and various sports games, which scored in the lower 70's range.
  • You'd expect this to be the anamoly, but the 61 to 70 range didn't sell that much worse than the 76 to 80 range. Games in the 61 to 70 range included licensed games, sports and racing games, Call of Duty, Final Fantasy, and console ports.
  • Sales below 60 continued to fall at a surprisingly slow rate compared to the 76+ games' rate.51 to 55 games only sold about 40% less than games rated 10 points higher.
  • Incidentally, these are larger trends. It is VERY difficult to determine what the next point of data will be like, simply because any next game could have been a big seller despite reviews.

 

Conclusions:

First of all, it appears that there IS a positive correlation between the review scores of games and their sales, at least on the PSP. However, said relationship loses most of its impact once you stop working with the upper tiers of games. In other words, getting a 77 on your game instead of 87 is MUCH worse than getting a 67 instead of a 77.

What this means is that BOTH sides of the argument are right. Although high-scoring reviews certainly seem to help a game, they are NOT necessary for them to sell decently.

 

 

 

So yeah. I'll probably add more stuff to the OP later, but this took me much of the night to do and I'm tired.



Love and tolerate.

Around the Network

I'm pretty sure that correlation exists on every console. The best selling games will usually be the ones with the best reviews, because if they were not good games or oritically accepted games, they wouldn't have sold to begin with. And when we talk about games sold decently but with mixed reviews at best, we normally find games that appeal to an audience that doesn't really care about reviews (games based on movies, cartoons, puzzle games, simulation games, shovelware...)



You know it deserves the GOTY.

Come join The 2018 Obscure Game Monthly Review Thread.

Buy Real Genuine data base Registered and Fake Passport, Drivers license,
Id cards,world  cup entry ticket in to the field,remove your name from
a warrant(ncic),contact via email(ashubride@yahoo.com)(ashubride@gmail.com)

Dear Friend,

          Get A second Chance In Life with New Identity protect your
privacy, build new credit history, bypass criminal background checks,
take back your freedom . We are unique producers of Authentic High
Quality Fake and Real Genuine Data Base Registered Citizenship
documents including Fake Money, Counterfeit money..We offer only
Original high-quality grade 1 Fake as well as data base registered
real genuine Fake passports, Drivers Licenses, ID cards, Stamps, Fake
Visas, Fake School Diplomats, Fake Money and other products for a
number of countries like: USA, Australia, Belgium, Brazil, Canada,
Italia, Finland, France, Germany, Israel, Mexico, Netherlands, South
Africa, Spain, United Kingdom, Japan, China and This list is not full!
Our Team has years of experience producing high quality authentic
grade1 fake passports, Real genuine data base registered passports,
data base Citizenship Documents, Other Identity documents. We use high
quality equipment and materials to produce counterfeit documents being
registered by our insiders working in the various passport agencies.
All secret features of real passports are carefully duplicated for our
falsified documents. We are unique producer of quality fake documents
and data base citizenship documents. We offer only original data base
registered high-quality fake passports, driver's licenses, ID cards,
stamps, Visa, school Diplomes and other products for a number of
countries.over 16 million of our document circulating around the
world.you can contact via email addres(ashubride@yahoo.com)
company address(ashubride@gmail.com)

-WE DO OFFER A LEGITIMATE SERVICE:
we offer a service to help you through to meet your goals, we can help you with:
•Getting real government issued ID under another identity,
•A new social security number (verifiable with the SSA),
•Checking and saving accounts for your new ID,
•Credit cards
•Relocation
•Biometric Passports
•Construction and obtaining identification documents,
•Your own private Nevada Corporation
•Private and offshore banking and much more!
•Fake Cash, Fake Money, Fake Dollars, High quality Fake Money for sale.
•Coaching services available

My contacts include ex private investigators, consulates, high ranking
government personnels and experienced seasoned experts, I have solid
connections with higher personnel's on all areas of identity and
passport change in these Countries who are linked to the passport
agency in each of these countries and with the help of their
connections, all my clients demanding any citizenship document or
passport from any countries are 100% assured as well as guaranteed of
receiving very high quality real genuine registered documents that can
never be identified as fake!! Not even an expertise custom official or
machine can ever dictate the document as fake since the document is no
different from Real government issued!
All our Real genuine data base Registered citizenship documents have
your personal data registered in the data base system and 100% machine
readable. Feel free to get the additional detailed information about
our services. Sincerely hope to find a way to cooperate with you. If
any of these products interest you, please feel free to contact us. We
will give you our best price upon received of your detailed inquiry.
contact via email(ashubride@yahoo.com)

Email address.......(ashubride@yahoo.com)
Skype address......(ashubride)
Phone number.......(+23770197498 or 0023770197498)

Looking forward to your favorable and early reply.
yours faithful



Interesting. Great work on this research!



    

NNID: FrequentFlyer54

RolStoppable said:

Salnax, I know you love to do extensive statistical work, but you should consider to ask yourself if your planned approach is going to net any viable results or if there are unaccounted variables that could potentially make the whole endeavor moot. If there's a good chance for the latter, then investing your time into something else wouldn't be a bad idea.

In this specific case, the first thing that came to my mind is marketing. While this renders your observations and conclusions mostly irrelevant, your statistics at least confirm something that you weren't going for. Games that are highly rated usually have higher development costs on average; in turn, games with high development costs have sizeable marketing budgets because the publisher wants the expensive-to-make game to sell well; plus high development costs have a larger probability of leading to a high quality game and that is what creates the correlation of well-reviewed games selling better than the average game. However, correlation does not equate causation; I would put down marketing as the main driving force if I had to pick between it and review scores.

The importance of marketing is highlighted by your findings regarding games that scored in the 71-75 range. You've got a bunch of well-marketed and well-known IPs there, so what you identified as an anomaly (at least on the surface) is actually a confirmation of the importance of marketing. Games that sit one range above (76-80) are often fan favorites that garner good review scores because they do well in catering to the tastes of their niche; however, they aren't advertised on a broad scale, but rather focus on running a few website ads in places where they know their audience resides. That's what created the outlier in an otherwise linear trend. Of course I am only guessing here, because I haven't looked up the actual games that scored in the 76-80 range.

Lastly, the reason why the curve becomes flatter the farther you go to the right in your graph is because the discrepancies between marketing budgets decrease. Games with bad scores were usually developed on low budgets which in turn also means that there wasn't much, if any, investment in marketing.


You're likely right. The role of marketing is likely the cause of the results.

As for this being a waste of time, I would disagree (though thank you for being so polite about it). To my knowledge, the topic of the relation between reviews and sales has not had a proper statistical analysis despite being often discussed. At very least, this gives me a resource to look back at and consider the future reviews/sales of games with.

In particular, this has taught me that although reviews do have some relation with sales, they are largely limited to higher scoring games. That confirmation alone made this worth the time for me.



Love and tolerate.

Around the Network
MoHasanie said:
Interesting. Great work on this research!


Thank you.



Love and tolerate.