By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Gaming Discussion - Two actual reasons reviews aren't that credible.

Publishers Basing Royalties On Metacritic Scores

Stephen Totilo of MTV Multiplayer continues his week-long look at video game review practices by exploring the practice of game publishers withholding certain bonuses and/or royalties if the game doesn't achieve a certain Metacritic average. Basically a publisher agrees to finance the development of a game as long as the developer in these sort of situation agrees to Metacritic score limit stipulations that could theoretically see a low-scoring game that sells millions (any children's licensed title really) hardly earning the devs a dime.

Totilo talks to some pretty big names about the practice, including GameSpot's former employee Jeff Gerstmann, who explains why the practice is so disturbing.

I’ve gotten e-mails from developers over the years who have said, ‘I don’t think you realize what you’re doing to me with this review’ because my review knocked them out of the range of some bonus that they were up for...

It's really a ridiculous practice that almost always works in the publisher's favor. Luckily it isn't as widespread as it once was, but it does give you interesting insight into why some developers will defend their games as if their lives depended on it. Sometimes they might.

Low Metacritic Scores Cause Game Publishers To Withhold Developer Royalties
[MTV Multiplayer]

 

More On "Faking Quality" And Metacritic

Whenever we hear about the travails of a video game company, snark abounds, and ultimately, the chorus cries, "Why don't you just make some games that don't suck?"

Easy to say from the outside looking in, but independent game developer Matthew of the Magical Wasteland blog shared his insider experience with an unidentified major publisher to explain that it's not always so simple, even when executives "talk the talk" about quality control.

Matthew cited the institution of bonuses for developers based on Metacritic scores, similar to the practice of hinging developer royalties on good scores that MTV Multiplayer's Stephen Totilo recently investigated.

Said Matthew:

Armed with the knowledge that higher review scores meant more money for them, game producers were thus encouraged to identify the elements that reviewers seemed to most notice and most like – detailed graphics, scripted set piece battles, “robust” online multiplayer, “player choice,” and more, more of everything. Like a food company performing a taste test to find out that people basically like the saltiest, greasiest variation of anything and adjusting its product lineup accordingly, the big publishers struggled to stuff as much of those key elements as possible into every game they funded.

The result, said Matthew, was that development became rushed and disjointed, all in the pursuit of the mighty Metacritic review score.

Multiplayer modes were suddenly tacked on late in development. More missions and weapons were added to bulk up their offering – to be created by outsource partners. Level-based games suddenly turned into open-world games.

Before you cry in despair, keep in mind that all these people wanted in the end was the best game possible – or, more precisely, the best-reviewed game possible.

Matthew's entire story is well worth a read, even with the (logical) absence of his career specifics. I find it ironic that the games press, many of whom are indirectly responsible for those scores, so rarely gets opportunities like these to look inside the developers' experience.

You Can’t Fake Quality, But That Never Stops Them from Trying [Magical Wasteland]

 

 

 

 

 

 



A flashy-first game is awesome when it comes out. A great-first game is awesome forever.

Plus, just for the hell of it: Kelly Brook at the 2008 BAFTAs

Around the Network

Well we all know what happened to Jeff when he tried to be honest.




So....reviewers are soft on some developers....shocking new twist in the gaming industry!



I hope my 360 doesn't RRoD
         "Suck my balls!" - Tag courtesy of Fkusmot

Don't see why fans of this industry are so focused on reviews. Do you need to read a load of reviews before you buy an album or watch a film?



yeah i dont check reviews that much,i dont really care about them



tag:"reviews only matter for the real hardcore gamer"

Around the Network
Shameless said:
Don't see why fans of this industry are so focused on reviews. Do you need to read a load of reviews before you buy an album or watch a film?

Well as some stated on other threads, games cost more, so you want more assurance that your money will be better spent.

Also, in the past, game reviewers have been actual gamers, so they tended to review more in line most gamer's tastes, unlike movie critics, so they got a reputation for credibility. 



A flashy-first game is awesome when it comes out. A great-first game is awesome forever.

Plus, just for the hell of it: Kelly Brook at the 2008 BAFTAs

I recall in the mid-late 90's that Fox Interactive began this process by giving bonuses to teams that garnered the best reviews. The initial practice was in earnest. They simply wanted to give the developers and incentive to work harder but it blossomed into something shadier.

Publishers wanted highs cores to validate their ad funding in media and developers wanted high scores to garner bonuses. Both began pressuring media outlets to publish higher scores.

Ever notice how a mid quality game is a 75% now instead of a 50% like the term suggest (50% being middle ground)? Now you know why.



The rEVOLution is not being televised

LordTheNightKnight said:
Shameless said:
Don't see why fans of this industry are so focused on reviews. Do you need to read a load of reviews before you buy an album or watch a film?

Well as some stated on other threads, games cost more, so you want more assurance that your money will be better spent.

Also, in the past, game reviewers have been actual gamers, so they tended to review more in line most gamer's tastes, unlike movie critics, so they got a reputation for credibility.


 Unlike movie critics? Are you trying to say they don't watch movies or something? 



Shameless said:
Don't see why fans of this industry are so focused on reviews. Do you need to read a load of reviews before you buy an album or watch a film?

There is definatly a need for reviews, and there is money to be had from it.

Come on, games are expensive and alot of people need to know what a game is like before investing their hard earned cash into it.




Viper1 said:
I recall in the mid-late 90's that Fox Interactive began this process by giving bonuses to teams that garnered the best reviews. The initial practice was in earnest. They simply wanted to give the developers and incentive to work harder but it blossomed into something shadier.

Publishers wanted highs cores to validate their ad funding in media and developers wanted high scores to garner bonuses. Both began pressuring media outlets to publish higher scores.

Ever notice how a mid quality game is a 75% now instead of a 50% like the term suggest (50% being middle ground)? Now you know why.

The old Four Point Scale



A flashy-first game is awesome when it comes out. A great-first game is awesome forever.

Plus, just for the hell of it: Kelly Brook at the 2008 BAFTAs