By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Gaming Discussion - Game Informer Bias - CONFIRMED!

I understand the Bias..it's everywhere..didn't you notice G4? they also hate the Wii

almost every hard-core game reviewer or journalist brings the Wii into a review randomly, just to bash it's brains..

it's okay...after the HD consoles die it'll all be fine ^_^



Around the Network
Words Of Wisdom said:
Grampy said:
Words Of Wisdom said:

Do games for each console need to have the same average score for the source to not be biased?

Not at all. A source appears biased when it's scores are badly out of synch with all other reviewers.

If  Magazine A rates PS3 games higher than the average of all other reviwers 90% of the time and the Wii lower 90% that would tend to show a bias.

If the magazine was Playstation Fanatic then that's acceptable. When it's essentially an advertisement for the largest game retailer, it is not acceptable.

 

What's the point of having multiple review sources if you want them all to be "in sync?"

I think you're missing the point, it's not that they all judge the same, or judge with the same toughness, it's a consistent pattern of always voting one system high and another low time after time. You may remember an incident at an olympics skating tournament where it became obvious that one judge would always give a perfect score to one particular country even if they fell several times while giving another very low score to groups from other countries even if they skated flawlessly. It lead to a complete overhaul of the scoring system, although it is arguebly still badly flawed.

No one is asking for perfect uniformity but if a magqzine gave SMG, Zelda, SSBB, MK Wii all 2 out of 10. Gave GTA IV, MGS and Elder Scrolls on the PS3 all 2 out of 10  and then gave Coffeetime Crosswords, Frogger II, and Pirates vs. Ninja Dodgeball on the Xbox all 10 out 0f 10. Would it cross your mind that they might have some slight bias towards the XBox?

 



All:

Site Statistics
Coverage: 3DO, DC, DS, GB, GBA, GBC, GC, GEN, JAG, MOBILE, N64, NGE, PC, PS, PS2, PS3, PSP, SAT, SCD, SNES, WII, X360, XBOX
Last Article: 10/1/2008
Number of All Reviews: 4411
Number of All Other Articles: 6440
Site's Avg Score for All: 7.3
Site's Avg Ratio For All: 72.8%
GR Avg Ratio for All titles this site has reviewed: 71.9%
Difference: 0.9%
Number of All Reviews Higher than the Average: 2584
Number of All Reviews Lower than the Average: 1827
Percentage of All Reviews Higher: 58.6%
Average Article Vote for All: 3.8 Stars
Total Article Votes for All: 2198
Total Hits for All Articles: 106582
Total Traffic sent to site from Reviews, News and Files since 4/27/02: 109482

XBox 360:

Site Statistics
Coverage: 3DO, DC, DS, GB, GBA, GBC, GC, GEN, JAG, MOBILE, N64, NGE, PC, PS, PS2, PS3, PSP, SAT, SCD, SNES, WII, X360, XBOX
Last X360 Article: 10/1/2008
Number of X360 Reviews: 248
Number of X360 Other Articles: 881
Site's Avg Score for X360: 7.4
Site's Avg Ratio For X360: 74.2%
GR Avg Ratio for X360 titles this site has reviewed: 72.2%
Difference: 1.9%
Number of X360 Reviews Higher than the Average: 157
Number of X360 Reviews Lower than the Average: 91
Percentage of X360 Reviews Higher: 63.3%
Average Article Vote for X360: -- Stars
Total Article Votes for X360: 0
Total Hits for X360 Articles: 0
Total Traffic sent to site from Reviews, News and Files since 4/27/02: 109482

PS3:

Site Statistics
Coverage: 3DO, DC, DS, GB, GBA, GBC, GC, GEN, JAG, MOBILE, N64, NGE, PC, PS, PS2, PS3, PSP, SAT, SCD, SNES, WII, X360, XBOX
Last PS3 Article: 10/1/2008
Number of PS3 Reviews: 137
Number of PS3 Other Articles: 582
Site's Avg Score for PS3: 8.2
Site's Avg Ratio For PS3: 76.6%
GR Avg Ratio for PS3 titles this site has reviewed: 72.6%
Difference: 4.0%
Number of PS3 Reviews Higher than the Average: 97
Number of PS3 Reviews Lower than the Average: 40
Percentage of PS3 Reviews Higher: 70.8%
Average Article Vote for PS3: -- Stars
Total Article Votes for PS3: 0
Total Hits for PS3 Articles: 0
Total Traffic sent to site from Reviews, News and Files since 4/27/02: 109482

Wii:

Site Statistics
Coverage: 3DO, DC, DS, GB, GBA, GBC, GC, GEN, JAG, MOBILE, N64, NGE, PC, PS, PS2, PS3, PSP, SAT, SCD, SNES, WII, X360, XBOX
Last WII Article: 10/1/2008
Number of WII Reviews: 138
Number of WII Other Articles: 206
Site's Avg Score for WII: 6.7
Site's Avg Ratio For WII: 67.1%
GR Avg Ratio for WII titles this site has reviewed: 67.7%
Difference: -0.6%
Number of WII Reviews Higher than the Average: 72
Number of WII Reviews Lower than the Average: 66
Percentage of WII Reviews Higher: 52.2%
Average Article Vote for WII: -- Stars
Total Article Votes for WII: 0
Total Hits for WII Articles: 0
Total Traffic sent to site from Reviews, News and Files since 4/27/02: 109482

 

 

From the looks of it they are harder on the Wii than they are for the PS3 and XBox 360, and they may favour the PS3 to a certain extent, but they are far from being the most biased site on the internet.



Grampy said:
Words Of Wisdom said:
Grampy said:
Words Of Wisdom said:

Do games for each console need to have the same average score for the source to not be biased?

Not at all. A source appears biased when it's scores are badly out of synch with all other reviewers.

If  Magazine A rates PS3 games higher than the average of all other reviwers 90% of the time and the Wii lower 90% that would tend to show a bias.

If the magazine was Playstation Fanatic then that's acceptable. When it's essentially an advertisement for the largest game retailer, it is not acceptable.

 

What's the point of having multiple review sources if you want them all to be "in sync?"

I think you're missing the point, it's not that they all judge the same, or judge with the same toughness, it's a consistent pattern of always voting one system high and another low time after time. You may remember an incident at an olympics skating tournament where it became obvious that one judge would always give a perfect score to one particular country even if they fell several times while giving another very low score to groups from other countries even if they skated flawlessly. It lead to a complete overhaul of the scoring system, although it is arguebly still badly flawed.

No one is asking for perfect uniformity but if a magqzine gave SMG, Zelda, SSBB, MK Wii all 2 out of 10. Gave GTA IV, MGS and Elder Scrolls on the PS3 all 2 out of 10  and then gave Coffeetime Crosswords, Frogger II, and Pirates vs. Ninja Dodgeball on the Xbox all 10 out 0f 10. Would it cross your mind that they might have some slight bias towards the XBox?

 

You see, I don't see a lower Wii average as inherently indicative of bias.

If I have to review 3lbs of shovelware, you can expect a consistently low average among them and those low scores will affect the larger population.  Most people will acknowledge that the Wii is getting the most shovelware this generation as it is the most successful so it only makes sense for that to show in the average score area.  That's not an insult to the great games the Wii has but rather just a reasonable expectation.

In fact, I would be more suspiscious of websites with high Wii averages.  Are they not reviewing many Wii games?  Do they just magically find only the good ones?  Are they giving shovelware games high scores?  Very odd.



Grampy said:
I think the sample was random since I took the first ten games listed in alphabetical order and I don't believe a game is affected by alphabetical position.

!0 may or may not be significant given the relatibly small number of reviews available from any one magazine on any one platform. I was almost half way through the aplphabet in some cases but I doubt seriously that a larger sample is going to change things when 90% of the reviews are high. I do a lot of scientific research and while we of course use larger samples, patterns that show up this distinctly at ten random samples seldom cahnge that dramatically.

It was enough of a sample to put IGN within .4 points of perfect average, significantly raising my faith in the reviewers at IGN.

I also was impressed with how fair, even tough the fanboy publications were in comparison to Game Informer. That was a major surprise. My kudo's to their professionalism and balamce.

If I can find the time I will do a more in detail analysis but I'm willing to bet Grandma's virginity that Game Informer won't improve significantly. I do judge Game Informer differently because they are owned and supplied by a huge retailer that uses them as an inducement to get customer loyalty. I think they carry therefore a greater burden to be fair than a completely independant source and certainly a Fanboy magazine; and yet they seem to under perform both.

And what's the beef with the signature exactly? I spent several hours doing it. It was all meant in good fun but if it offends, I will certainly remove it. I've had it for several weeks and no one has complained before.

The issue is that your doing pseudo-statistics, not real statistics, which deprives your results the theoretically proven descriptive capabilities of actual statistics. 

You haven't "confirmed" anything because all your tests are statistically invalid. 

Heck even calling them tests (all you've done is display different trends and never analyzed if the difference between the trends is mathematically significant) isn't correct.

 



Around the Network

Of course GI is bias. They've always been bias haha. They don't hide it either. It's blatant.



I agree that trends this marked at even 10 pieces of data aren't going to magically reverse themselves with a larger sample. It's sad to see a magazine so blatantly off the mark.

About the sig, Grandpa, could you speed it up. It looks awesome, it just goes SO slow.



I've thought this quite ssome time ago.


To the OP: I wish your sig would go a bit faster dude/dudet......



4 ≈ One

Game Informer has always been biased. It's such a crap magazine too. I get it in the mail because I have an edge card from gamestop but I don't even read it, it goes straight into the trash.

I laughed when they gave No More Heroes a 6/10 and complained that the game was too hard and too violent yet they gave GTA4 a 10/10.



Wetcoaster said:
Game Informer has always been biased. It's such a crap magazine too. I get it in the mail because I have an edge card from gamestop but I don't even read it, it goes straight into the trash.

I laughed when they gave No More Heroes a 6/10 and complained that the game was too hard and too violent yet they gave GTA4 a 10/10.

Wow, didn't know they did that.  That's pretty damn blatant