By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Gaming - "Pro Reviews Failing"

A very interesting read:

"Over the past couple of months, I’ve noticed a change in the landscape of reviews around the internet. Traditionally, there were a number of large sites that could be trusted to “professionally” review a game. You know who I mean without me needing to name them. I think this has begun to change.

It’s going to be very difficult to talk about this subject without naming names but in the interests of professionalism I will try to avoid specifically calling anyone out on what I believe to be their shoddy work.

It first struck me a month or so ago when I read a review on the website of a magazine which I have genuine respect for. The review was for a game I had just reviewed myself and it was abundantly clear that the reviewer working for this website had not played the game in question for longer than an hour or two.

He mentioned things in the review which simply weren’t true and the only reasonable explanation was that he hadn’t got to the part of the game which made them untrue yet. I was shocked and more than a little disappointed. The website in question even issued a statement claiming that their guy had finished the game and standing behind the review. I understand that it’s important to back your staff but surely not at the expense of honesty or reputation when the evidence is so clearly contrary?

This brings us to the seemingly growing trend of not actually playing the games that you are supposedly reviewed. No outlet will ever admit to this (except us) because if you come out and say “yes, we reviewed that game without actually playing it to its fullest” then you are admitting that you sold the game – and your readers – short. I am reasonably sure of at least one growing outlet that definitely does not play the games it posts reviews for. How can you adequately pass objective judgement on something if you don’t know all it has to offer? You can’t. It’s dishonest and it harms our industry.

In my opinion, this happened just this week with an extremely poorly-written appraisal of an upcoming Move title from one of the big outlets. The reviewer misquoted controls (which have since been edited out, mostly – without referencing the original mistake) and claimed that they were detracting from his enjoyment of the game without actually knowing what those buttons were supposed to be doing. It’s like me saying that a piano is out of tune because I can’t play Rachmaninoff’s third on it. I can’t play the piano and I’ve never tried to learn so why blame the piano makers?

So why bother? The answer is simple: traffic. If you don’t cover as many games as possible you limit your chances at search engine hits and you seem less professional to your readership because you have gaps in your coverage. You see, contrary to what some might want you to believe, high traffic is essential to profitability with a website. If you don’t have the traffic then advertisers don’t want to pay you for adverts, no matter what your advertising model is.

This is the reason for those sites which post multiple sensationalist headlines out of one interview. It’s the reason for most of those sites which post the “announcement of an upcoming announcement” news stories. It’s the reason why many outlets focus on negative stories: negativity is popular. It’s also the reason, sadly, that some sites or writers rig their reviews. All of which brings us nicely to the sites that post artificially low scores for highly anticipated titles.

Now, I’m not suggesting that simply because a title is highly anticipated, it should automatically get a positive score. That is just as bad as the negative scoring trick used by some, it deceives your readers. We try to use the full scope of our review scale on TheSixthAxis and we occasionally moan when it’s clear that others are only using the top third. It is fairly obvious though, that sometimes writers and outlets will purposefully approach a game negatively in the anticipation that it will create a bit of conflict and drive a lot of traffic.

Various outlets have been accused of this and, while it’s not always a fair accusation, I think that it does occasionally have a solid basis in truth. It happens too often and scores from individuals are often too disparate in comparison to the general consensus to be a coincidence. This would be easily accounted for if it was a rare occurrence but certainly not at the regularity with which it happens.

I’ve always been of the opinion that some of the most talented writing on the internet is on small, independent blogs. It genuinely annoys me each year when the nominations for the Games Media Awards are announced in the UK and they’re the same limited selection of outlets, owned by the same couple of publishers or media outlets. Independent outlets and the talent they employ don’t get noticed by most.

So how does that leave the future of games reviews? Well, there are talented people out there who are willing to work for free when they’re not on freelance assignment (Jen Allen and others at Resolution, Lewis Denby and of course, certain TSA staffers all immediately spring to mind) so there’s no shortage of youth and enthusiasm. We just need the established industry giants to take notice. Or we’ll overthrow them."

Source

I'm going to have to agree with this guy.  It sucks he can't name names, but I think most can figure out who he's talking about. 

So do you agree or disagree?



Around the Network

They only realized this in the past couple of months?

 

Seriously?



Monster Hunter: pissing me off since 2010.

Games are scored on hype? Medal of Honor, Lost Planet 2, The Fight: Lights Out, Fable III and others underscoring in most opinions beg to differ. The only professional review source that consistently fails is Gameinformer



Mr Khan said:

They only realized this in the past couple of months?

 

Seriously?

Yea, I've noticed it going on for longer than that, too.

@ LordDeDeDe

Well, IGN fails quite a bit, as well.  The most recent example is The Fight.  If you compare their review to a few others, it seems more like they played the game for about an hour without fully watching the tutorials, and then preceded to write a review.  The reviewer was wrong about how you're supposed to block.  He thought you had to hit the O button, when that actually recalibrates your arms.  To really block you just have to raise your arms up like in real life.  They also failed to mention online multiplayer, even though they felt its absence in previous Move titles was a huge missed opportunity.  As the article states, it seems like the larger sites are just rushing out more reviews just so they can have more of them, thus creating more traffic.  Their reputation be damned.



Would he happen to be talking about IGN's recent Rorona Atelier review?

 

This seems to happen with most jRPGs on the market, which is why I tend to just use Amazon Japan's ratings.



"Naturally the common people don't want war: Neither in Russia, nor in England, nor for that matter in Germany. That is understood. But, after all, IT IS THE LEADERS of the country who determine the policy and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is TELL THEM THEY ARE BEING ATTACKED, and denounce the peacemakers for lack of patriotism and exposing the country to danger. IT WORKS THE SAME IN ANY COUNTRY."  --Hermann Goering, leading Nazi party member, at the Nuremberg War Crime Trials 

 

Conservatives:  Pushing for a small enough government to be a guest in your living room, or even better - your uterus.

 

Around the Network

vgchartz the ONLY source for reviews



Generally I find if destructoid and IGN both review it badly then its a good game,  (FF13, Atelier Rorona and Castlevania this year to name a few) only notable exception I can think of this year is bayonetta (which was great despite good reviews) This whole gaming forum scene is pretty new to me but thats the system i used to work off before discovering N4G, (never joined a forum nor posted there but went off it pretty quickly because of the sheer negativity in their comments sections) and then came to this forum. But in my early days of having limited exposure to gaming media, only doing the opposite IGN and destructoid said served me right 85% of the time. I think its just a matter of understanding reviewers and the site they write for's biases. I knew I liked what they (IGN and destructoid) hated and hated what they liked (but still bought dragon age, heavy rain and ME2 whilst on a masochistic streak, proved this theory totally btw) so it all kind of worked in the end albeit a bit twisted-ly. Its all opinion, so once you know how yours relates to that of any certain site you can get 'accurate' reviews even if its not in the way the reviewers intend.  



PLAYSTATION NATION LADY OF JRPGS

Favourite Games of 2013 1.Tomb Raider(PS3) 2.Atelier Ayesha(PS3) 3.Virtues Last Reward (Vita)

the move game is the Fight and it was IGN, Were the reviewer didn't know how to block and said random stuff which is false because iwaggle3d guy showed how it worked and it was not that case.

IGN is a repeat offender 



Of Course That's Just My Opinion, I Could Be Wrong

FinalEvangelion said:

Would he happen to be talking about IGN's recent Rorona Atelier review?

 

This seems to happen with most jRPGs on the market, which is why I tend to just use Amazon Japan's ratings.

Never actually played that game.  What did IGN get wrong in their review?



I personally find Gamespot overall a complete joke. Their reviews are rubbish and I never trust them.

Of course this doesn't apply only to Gamespot but their reviews suck shit.