By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Gaming Discussion - ioi speaks out about ergh "VGC analysts"

Max King of the Wild said:
Lawlight said:
Aielyn said:
Lawlight said:
2000 data points for worldwide numbers? Well, that would expect that big inaccuracies.

If we assume a reasonably unbiased sampling for those 2000 data points, then you would expect a margin of error at 95% confidence of 2.2%, assuming an infinite population. Smaller for the real population. That is, 95% of the time you would expect the random sample's mean to be within 2.2% of the real mean.

Seriously, if you don't understand basic statistics, don't get involved in this discussion, you're in over your head.


I don't care how you try to justify it with statistics - 2000 data points will not give you anywhere near accurate enough data - but we've seen that already.


I must have been incorrect with the 2000 data points. I thought ioi said that figure earlier in the thread but he is saying he didnt. Still, I take SW sales with a grain of salt on this site and I started to when Sven said those things in 2009. I started seeing a lot of things when I looked that didn't make sense.

It's not that I don't care for the figures and think no one should. Thats not it. I just cant stand the people who take them as gosspel and try to use it to prove points. When it becomes a focal point in an arguement it gets kinda annoying. 

In any case, software numbers are often proven to be off when the npd report is released and gaf starts getting the numbers.



Around the Network
Lawlight said:
In any case, software numbers are often proven to be off when the npd report is released and gaf starts getting the numbers.

You *do* realise that NPD uses the exact same methodology as VGChartz, right? They collect a sample, and report on numbers by scaling it up.

And the great irony in all of this is that NPD doesn't even do people the service of telling them how many retailers they use in their monthly sample, so despite the protestations of so many anti-VGC people, there's no way to know whether VGChartz or NPD has a higher sample size.

Simply put, if you assert that the NPD numbers are "right", that where NPD disagrees with VGChartz it must be VGChartz that is wrong, then you're demonstrating your complete ignorance of the situation.



Aielyn said:
Lawlight said:
In any case, software numbers are often proven to be off when the npd report is released and gaf starts getting the numbers.

You *do* realise that NPD uses the exact same methodology as VGChartz, right? They collect a sample, and report on numbers by scaling it up.

And the great irony in all of this is that NPD doesn't even do people the service of telling them how many retailers they use in their monthly sample, so despite the protestations of so many anti-VGC people, there's no way to know whether VGChartz or NPD has a higher sample size.

Simply put, if you assert that the NPD numbers are "right", that where NPD disagrees with VGChartz it must be VGChartz that is wrong, then you're demonstrating your complete ignorance of the situation.


I have no doubt that NPD has way more resources and is more accurate than vgchartz. Which one would you trust more?



Lawlight said:

I have no doubt that NPD has way more resources and is more accurate than vgchartz. Which one would you trust more?

Let's suppose that VGChartz had 2000 retailers in the US, and NPD had 5 times as many, at 10000, just for the sake of argument. Then rather than a 95% confidence margin of error of 2.2%, it's now just under 1%. In other words, while "more accurate", it's not exceptionally accurate.

And you have "no doubt" that NPD has "way more resources"... but you have no evidence, and no reasoning to justify the claim... at least, none that you have provided to us.

So here's your challenge - provide solid evidence that NPD has more resources than VGChartz with regards to video game sales data collection.



Aielyn said:
Lawlight said:

I have no doubt that NPD has way more resources and is more accurate than vgchartz. Which one would you trust more?

Let's suppose that VGChartz had 2000 retailers in the US, and NPD had 5 times as many, at 10000, just for the sake of argument. Then rather than a 95% confidence margin of error of 2.2%, it's now just under 1%. In other words, while "more accurate", it's not exceptionally accurate.

And you have "no doubt" that NPD has "way more resources"... but you have no evidence, and no reasoning to justify the claim... at least, none that you have provided to us.

So here's your challenge - provide solid evidence that NPD has more resources than VGChartz with regards to video game sales data collection.

If first parties didn't think that NPD was the most accurate source of data for NA, they wouldn't be quoting the numbers everytime NPD releases their report. I wish someone had a collection of the comparisons of NPD vs VGChartz numbers. VGC's purpose is to fill the gap for system wars for when official numbers are not available. I still recall the sensationalist "DS becomes best selling system of all time".



Around the Network
Lawlight said:
If first parties didn't think that NPD was the most accurate source of data for NA, they wouldn't be quoting the numbers everytime NPD releases their report. I wish someone had a collection of the comparisons of NPD vs VGChartz numbers. VGC's purpose is to fill the gap for system wars for when official numbers are not available. I still recall the sensationalist "DS becomes best selling system of all time".

So I call for solid evidence, and you give me "publishers quote NPD"? Really? How does that prove *greater* accuracy. All it proves is that they find NPD to be accurate enough for their purposes. It says nothing about NPD vs VGChartz, it says nothing about resources, and it says nothing about the actual level of accuracy.

But more than that, you refer to "official numbers" once again - which proves that you haven't been paying attention to what anybody else has been saying. There is no "official number" available. NPD is an ESTIMATE. Same with Chart-Track, Media-Create, Famitsu, etc. They all use estimates, and it's the publishers' PR arms that use those numbers for their press releases.

I'm going to challenge you, this time, to do something much simpler. Just repeat after me: "NPD does not provide official numbers".

 

EDIT: By the way, here's Pachter revealing something about his private talks with publishers regarding NPD numbers: http://www.ps3center.net//news/5235/pachter-npd-can-and-has-been-wrong/

"... However, analyst Michael Pachter has said that whilst console manufacturers usually tell him that the NPD numbers only have a 1-2% margin of error, that is not the case for some software sales. He says that publishers have told him that the "NPD does a crappy job.""

The best part is that this quite neatly backs up the suggestion that NPD probably has somewhere around 2400-9600 retailers in their sample set, as 1-2% error with 95% confidence is the expected amount at that sample size. Assuming ioi isn't lying about the number of retailers he gets data from (and I don't see any reason to disbelieve him), and that US retailers make up somewhere around 40% of the set, this puts VGChartz in very much the same ballpark, statistics-wise, with NPD.

I don't generally trust Pachter when it comes to anything that is even remotely resembling PR, such as comments about how certain platforms or games will do. But I see no way that the comments quoted in the link above could operate in such a manner, and thus see no reason to distrust him here.



Lawlight said:
Aielyn said:
Lawlight said:

I have no doubt that NPD has way more resources and is more accurate than vgchartz. Which one would you trust more?

Let's suppose that VGChartz had 2000 retailers in the US, and NPD had 5 times as many, at 10000, just for the sake of argument. Then rather than a 95% confidence margin of error of 2.2%, it's now just under 1%. In other words, while "more accurate", it's not exceptionally accurate.

And you have "no doubt" that NPD has "way more resources"... but you have no evidence, and no reasoning to justify the claim... at least, none that you have provided to us.

So here's your challenge - provide solid evidence that NPD has more resources than VGChartz with regards to video game sales data collection.

If first parties didn't think that NPD was the most accurate source of data for NA, they wouldn't be quoting the numbers everytime NPD releases their report. I wish someone had a collection of the comparisons of NPD vs VGChartz numbers. VGC's purpose is to fill the gap for system wars for when official numbers are not available. I still recall the sensationalist "DS becomes best selling system of all time".


NPD releases monthly numbers 10 days or more after month's end: this alone gives them more time to refine data, a little more for last week, a lot more for the previous ones. Add to this that doing a monthly total naturally filters out variance better than weekly numbers. BTW, giving monthly numbers NPD is able to adjust at least 3 weekly numbers a month before even releasing them added together in the monthly total. If you compare monthly VGC numbers at the same time NPD releases them, so with VGC having the same time as NPD to adjust the data of the first three weeks of the month, they should be percentually closer, on average.



Stwike him, Centuwion. Stwike him vewy wuffly! (Pontius Pilate, "Life of Brian")
A fart without stink is like a sky without stars.
TGS, Third Grade Shooter: brand new genre invented by Kevin Butler exclusively for Natal WiiToo Kinect. PEW! PEW-PEW-PEW! 
 


I keep hearing "blah blah blah, don't matter numbers, method or validity, I believe different then I'm right". In other news, "my sacred escriture says my god is the only one, so he is''.



duduspace11 "Well, since we are estimating costs, Pokemon Red/Blue did cost Nintendo about $50m to make back in 1996"

http://gamrconnect.vgchartz.com/post.php?id=8808363

Mr Puggsly: "Hehe, I said good profit. You said big profit. Frankly, not losing money is what I meant by good. Don't get hung up on semantics"

http://gamrconnect.vgchartz.com/post.php?id=9008994

Azzanation: "PS5 wouldn't sold out at launch without scalpers."