By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Sales Discussion - What are VGChartz' sources for weekly US numbers?

gebx said:

Alvar said:

Yes, but obviously the npd numbers have an order of magnitude lower error margin (as far as I understand it they have numbers from 60% of the market or something like that). And as I also said previously, VG-Chartz accuracy may be enough to warrant some discussion around the numbers, but don't assume they are correct numbers, since they could very well be off by a significant amount.


I don't think anyone assumes that the numbers are 100% accurate, but Vgcharts tries to get these numbers as accurate as possible.

Also this is the best and most indepth website on sales figures for videogames. No other website even comes close, so really if someone can find a website that offers what they do, and more accurately then please do provide a weblink.

Well, my guess would be that some people actually do assume it is correct :)

I agree that it is a good website in that regard, and there could be some good discussions on the forums. I would personaly change some things around to make it more clear what it is about and change some other stuff too :p

But I'm not gonna try to tell anyone how they should run their web-page.



Around the Network
Alvar said:
Bodhesatva said:
Alvar said:
Bodhesatva said:
Alvar said:
Avinash_Tyagi said:
Alvar said:
Its called educated guessing. Same for the Europe and Japanese numbers. It may be fun to create some discussion around, but don't bet your farm on any of these numbers to actually be correct.

Actually its based on what retailers they do get data from and then extrapolation for the rest


Thats why its an educated guess, they extrapolate from a very small set of data. That doesnt make it any less of a guesstimate.


Uh, yes it does make it less of a guesstimate. Do you have any education in statistics at all? The margin of error drops dramatically and rapidly as your sample size grows. In most cases, 30 samples is enough to regularly get you within 10 percent of the correct answer.

 

If you think there is no difference between "just guessing with no data" and "estimating based on some data," then I'm afraid you need to go back to school.


Yes, I have higher degree of education in statistics. And yes, bad wording on the "less of a guesstimate", I should have probably said that it still makes it a guesstimate, or that doesnt make it a non-guesstimate. That was my point anyway. And if you read my first sentence I did say that is what makes it an educated guess.


Glad to hear we can agree then! Obviously it's just an estimate. So are the NPD's figures. Given that (almost) all VGChartz numbers were within 10 percent of NPD's for the month, I'd say those estimates are getting pretty good.


Yes, but obviously the npd numbers have an order of magnitude lower error margin (as far as I understand it they have numbers from 60% of the market or something like that). And as I also said previously, VG-Chartz accuracy may be enough to warrant some discussion around the numbers, but don't assume they are correct numbers, since they could very well be off by a significant amount.

 

I'd definitely agree with this. Although I'd change one minor thing: you say that we shouldn't assume that VGCharts' numbers are "correct" -- I'd change that to "exact," or "almost exact," as NPD's numbers aren't correct either, they're just more exact.



http://i14.photobucket.com/albums/a324/Arkives/Disccopy.jpg%5B/IMG%5D">http://i14.photobucket.com/albums/a324/Arkives/Disccopy.jpg%5B/IMG%5D">

gebx said:
Alvar said:
Bodhesatva said:
Alvar said:
Bodhesatva said:
Alvar said:
Avinash_Tyagi said:
Alvar said:

 


 


 


 


 


Yes, but obviously the npd numbers have an order of magnitude lower error margin (as far as I understand it they have numbers from 60% of the market or something like that). And as I also said previously, VG-Chartz accuracy may be enough to warrant some discussion around the numbers, but don't assume they are correct numbers, since they could very well be off by a significant amount.


I don't think anyone assumes that the numbers are 100% accurate, but Vgcharts tries to get these numbers as accurate as possible.

Also this is the best and most indepth website on sales figures for videogames. No other website even comes close, so really if someone can find a website that offers what they do, and more accurately then please do provide a weblink.

Well, I just question the value of providing weekly numbers when those numbers are difficult or impossible to get even for professional marketing firms like NPD. And even NPD's monthly numbers are called into question at times, and they have, what, 65% coverage? With additional polling to further establish purchase patterns? I would much rather see VGChartz provide officially released numbers from recognized sales agencies rather than speculating independently. A 10% margin of error is pretty huge when you're talking about hundreds of thousands of units, and I know for a fact that on some months VGChartz' average margin of error is even higher.



Bump? 



What?

Listen buddy, bump a thread if you've got something to add...I figured your question has been well answered by now anyway.



LEFT4DEAD411.COM
Bet with disolitude: Left4Dead will have a higher Metacritic rating than Project Origin, 3 months after the second game's release.  (hasn't been 3 months but it looks like I won :-p )

Around the Network
BenKenobi88 said:
What?

Listen buddy, bump a thread if you've got something to add...I figured your question has been well answered by now anyway.

Not really. No one's really said anything about how VGChartz assembles its weekly North American sales figures, except to say that, "They have sources," which doesn't really help anything.

And then there's also my last post, where I question the wisdom of providing weekly sales figures at all. I wanted to bring attention back to that point, hence the bump.



I'll speak to this.

I asked ioi directly the other day how much sales coverage he has in the Americas - it is increasing constantly - but it is no where near NPD coverage.  Still, the data is representative, and statistically sound because when dealing with data spread out from tens of thousands of stores selling videogames and videogame hardware across the continent, even 1% representation would equal over 1,000 stores - more than enough to have estimates for sales trends.  Now, whether or not ioi is getting partial samples or full data from the retail channels he does cover is something we don't know.  Statistically, the greater the sample size, the more nuance you see in trends and change. 

It is also possible to elimiiate gaps - for instance I would guess ioi can estimate PS2 numbers now because he has added stores that sell alot of that console still, while before the stores covered did not sell many/any PS2's, as it varies across the USA.

I don't think I'm allowed to reveal the numerical estimate of retail coverage ioi thinks he has...but it has roughly doubled since he started providing the American charts, which is why the margin of error for everything was quite accurate when compared to NPD last month.  He has passed what I consider the necessary threshold for accurate figures in the past few weeks, and in the coming weeks should approach a figure that allows us to see more of the aforementioned nuances that histrorically only professional agencies could provide.



People are difficult to govern because they have too much knowledge.

When there are more laws, there are more criminals.

- Lao Tzu

TheSource said:

I'll speak to this.

I asked ioi directly the other day how much sales coverage he has in the Americas - it is increasing constantly - but it is no where near NPD coverage. Still, the data is representative, and statistically sound because when dealing with data spread out from tens of thousands of stores selling videogames and videogame hardware across the continent, even 1% representation would equal over 1,000 stores - more than enough to have estimates for sales trends. Now, whether or not ioi is getting partial samples or full data from the retail channels he does cover is something we don't know. Statistically, the greater the sample size, the more nuance you see in trends and change.

It is also possible to elimiiate gaps - for instance I would guess ioi can estimate PS2 numbers now because he has added stores that sell alot of that console still, while before the stores covered did not sell many/any PS2's, as it varies across the USA.

I don't think I'm allowed to reveal the numerical estimate of retail coverage ioi thinks he has...but it has roughly doubled since he started providing the American charts, which is why the margin of error for everything was quite accurate when compared to NPD last month. He has passed what I consider the necessary threshold for accurate figures in the past few weeks, and in the coming weeks should approach a figure that allows us to see more of the aforementioned nuances that histrorically only professional agencies could provide.


Thank you!

That's more what I was looking for. Obviously I would've liked to know more specific figures, but I can understand why that might be kept confidential. In any case, I'm curious now as to how much VGChartz' deviation from NPD numbers has changed over time.



TheSource has posted a few news articles showing the difference in percentages between NPD and VGCharts. The first NPD after American charts went weekly was off by a large margin, but the most recent NPD saw the weekly charts much closer to what was reported. I imagine, as ioi collects more and more data from more sources, you will see more accurate representations. I'm certain TheSource will provide another breakdown to show the differences between VGC and NPD for May when the time comes.



archmagus-21 said:
gebx said:
Alvar said:
Bodhesatva said:
Alvar said:
Bodhesatva said:
Alvar said:
Avinash_Tyagi said:
Alvar said:

 


 


 


 


 


Yes, but obviously the npd numbers have an order of magnitude lower error margin (as far as I understand it they have numbers from 60% of the market or something like that). And as I also said previously, VG-Chartz accuracy may be enough to warrant some discussion around the numbers, but don't assume they are correct numbers, since they could very well be off by a significant amount.


I don't think anyone assumes that the numbers are 100% accurate, but Vgcharts tries to get these numbers as accurate as possible.

Also this is the best and most indepth website on sales figures for videogames. No other website even comes close, so really if someone can find a website that offers what they do, and more accurately then please do provide a weblink.

Well, I just question the value of providing weekly numbers when those numbers are difficult or impossible to get even for professional marketing firms like NPD. And even NPD's monthly numbers are called into question at times, and they have, what, 65% coverage? With additional polling to further establish purchase patterns? I would much rather see VGChartz provide officially released numbers from recognized sales agencies rather than speculating independently. A 10% margin of error is pretty huge when you're talking about hundreds of thousands of units, and I know for a fact that on some months VGChartz' average margin of error is even higher.

 

You say you'd much rather VGC provide "official" numbers from "recognized" sales agences rather than speculating independently.   So you would rather VGC be "dependent" on other organization's data?  What, exactly, is the value in that?

Do you realize the irony of that statement?  NPD numbers are "official" in only one way: They are the official NPD numbers.  Beyond that, they are a statistical estimation of sales.  Period.  They are "recognized" in that they report their "official" numbers and are pretty much the only game in town.  NPDs numbers are "independent" in that they gather data, statisically analyze it, and report it but are completely dependent on the data they gather from retail and distribution channels.

VGC's sampling data, estimating, statisically projecting, etc. is no different than NPD and it doesn't make their numbers any less independent or dependent as well as any more or less official.  VGC most certainly is estimating sales (just like NPD is an estimate) on a smaller budget and a smaller data set but that doesn't make VGC's numbers any less "offical"...

You said you have a higher degree in statistics.  While my degree isn't in statistics, I have taken quite a number in my studies in support of my chosen field.  There is no doubt that a larger sample will reduce deviation, but it is entirely possible to create fairly high quality estimates with small sample sizes.  If the entire population was acting independently, sample size would have to be huge.  Since, in every entry in the sales charts for both hardware and software, each and every entry is a "single" sku, the need for sampling is to account for overall variances between different stores and regions.  Given past history of how each area in the U.S. along with how close each store tracks compared to others, it would be quite possible to get a pretty darn high i.e. 90% confidence with a very small sample size.   Only ioi knows his statistical methods and I'm sure he won't be sharing them with us.  (I certainly wouldn't)

Give it six more months and see how things are going in terms of his predictions.  As with anything statistical, over time we'll know more accurately how well his sales statistics compare to other data.  So far I'm fairly impressed with his results given the resources and time involved to produce such data. 



I hate trolls.

Systems I currently own:  360, PS3, Wii, DS Lite (2)
Systems I've owned: PS2, PS1, Dreamcast, Saturn, 3DO, Genesis, Gamecube, N64, SNES, NES, GBA, GB, C64, Amiga, Atari 2600 and 5200, Sega Game Gear, Vectrex, Intellivision, Pong.  Yes, Pong.