I have seen that there is already another thread about this topic; however, I did not see anyone commenting about the potential impact of this patent, which came to my mind when I saw this for the first time last night.   As I wanted to emphasize and like to hear what others think about this particular way of thinking, I have decided to make this thread as on its own.

First of all, here is the original article from http://www.siliconera.com/2009/07/02/sony-patents-a-motion-control-system-that-uses-ordinary-objects-as-controllers/

Sony Patents A Motion Control System That Uses Ordinary Objects As Controllers

By Spencer . July 2, 2009 . 3:24pm

We saw Sony unveil a LED wand during their E3 press conference. The device in conjunction with an EyeToy camera brought motion control to the PlayStation 3. In addition to that Sony developed another motion control system that uses everyday objects.

 

A recently published patent from Sony details a system where a camera can dynamically map an object — any real world object — for use in a video game. The illustration has a U shape block, but the patent outlines other example objects “include items such as coffee mugs, drinking glasses, books, bottles, etc.” While these are given as examples the object mapping system is not limited to those objects, it can identify any three dimensional object.

 

Before using an object like the U shaped block the camera captures has to capture it. Figure 2 explains the system where players show the object, rotate it, and save a profile for it in a file. The system then analyzes movements and translates them into in game actions.

 

Here are some examples of how Sony could use this technology. The “virtual world light sword” in figure 3B is particularly interesting. When a player holds the U-shaped block up the sword is “on” and the blade will be extended in the game. When the U-shaped block is upside down the sword is “off”.

 

The system looks like Microsoft’s Project Natal, but instead of driving an imaginary steering wheel players can use an everyday item like a plate.

 

When I first read this article, the biggest question came to my mind was "Is this for PS3?"  "Is this for PS4?" OR "Is this for Natal?"

Let me start with the first two more obvious question.

PS3 vs. PS4

The figure 9 says "presenting an object to the depth camera."

As most you already know PS Eye unlike Microsoft Natal is NOT depth camera.  So if it is true that Sony has already completed their research about PS3 wand controller using PS Eye, this technology clearly will not work with it.  Given that Sony intends to release PSEye + Wand controller next Spring, it would be simply worst move for them to release this tech with PS3 in just 1-2 years afterward.  So this could be technology for PS4.

Though the chance of this happening is close to nil, what would be the best is to include this new depth recognition camera with Wand Controller when the SOny's motion controller is released in Spring 2010.  I myself already own PSEye; however, I believe majority of people still do not own PSEye so if this motion tech takes off as a smash hit, it is most likely that majority of people will end up buying Camera along with Wand Controller.  So I say instead of using PSEye, Sony should simply include this depth camera with Wand Controller.

Obviously, this will require Sony to first design & test Depth Camera.  So again, the chance of this is almost non-existent.

NATAL

When I asked myself "is this for Natal?" I didn't mean that Sony decided to work for MS instead I meant that Sony simply patented this idea to BLOCK the potential of Microsoft's Natal Project.  The biggest argument against natal so far seems like the lack of tactile feedback.  The solution to this seemed very easy until now that is.

Now that Sony patented this "object as controller" idea, I wonder MS is now limited to what they can do with Natal to provide tactile feedback. 

So was the Sony's intention with this Patent to ensure Natal to be a technology lacking tactile feedback; hence, not to become the ultimate motion controller?

 

What do you all think?

For everyday objects, i first thought it was considering augmented reality, but as reading further, it's not.

Since Sony has its wands already and using passive objects as controller, is a stupid (=not working) idea to begin with, it's unlikely that Sony intends to bring in into reality, especially when the wands, as active objects, correct the flaws the passive objects have.

What Sony likely wanted to do is:
1. Prevent the potential Natal to have the feature (no skateboard scans, sorry).
2. Use peoples own objects as objects in a game (like the skateboard in the Natal video).
If nothing else, it would be a feature in LBP 2.

Using a lot your own objects could bring a problem of the lack of VRAM/VRAM bandwidth due to possibly big size of the objects bitmaps/vector maps, so the feature may not be used in graphics heavy games -> you may not be able to scan and use your own assault rifle in Killzone 3.

microsoft showed this with their product already...it seems unlikely they would have overlooked some form of patent themselves.

Looks like Sony already had something for the PS2 back in the day.

MrBubbles said: microsoft showed this with their product already...it seems unlikely they would have overlooked some form of patent themselves.

And doesn't it make you wonder why M$ already said that Natal will not support the function?

On a side note, the tech Natal uses, is developed by an israeli company M$ just bought. The company may not have the incentive to patent everything you can do with it. And also, this could have been patented a long time ago already by anyone.
Also, there may be another reason for it not being a feature: running the demo software on latest Intel hardware, is a little different from running the same software on 360...