"An RGB projector that handles the task of extending the display beyond the television, wrapping the gamer's room in graphics. A depth camera, integrated into the peripheral, could be used to help map the user's environment, with the projected image corrected to compensate for furniture and other objects — instead of seeing a chair painted with light, the projected image would adjust in order to help your furniture blend in."
So how is it going to compensate for missing walls, large windows, dark surfaces etc. Transparent glasses like google's prototype video that project 3D images inside the environment would work much better.
You have some seriously valid questions, which the patent doesn't necessarily address.
As for dark walls, apparently it will sense the room color and compensate the image for the room color. So, it'll be REALLY interesting to see this thing work.
"5. The system of claim 3, wherein a camera is configured to detect color information by measuring color reflectivity from the environmental surface."
"6. The system of claim 5, further comprising instructions to compensate for a color of the environmental surface described by the color information so that the peripheral image appears as a color distortion-corrected extension of the primary image. "
That all being said, it is an accessory. It is not a require component of the console. If it doesn't work in your environment, bummer. However, if you have a room where it will work, then you have the opportunity to have an enhanced gaming experience. Yay you!
It seems like they took this technology
and thought up a patent for indoor use. (As you can see at the start all the windows have flat screens behind them to make it work)
And no matter what you do, you can't project onto a black surface, or glass. It would be interesting if you have a good room for it, until you check the prices of projectors with enough light output capable of projecting a 180 degree field of view.
You can buy a holodeck already btw, if you have 4x4x2.8 meters to spare
Michigan 3D lab is using the Kinect to move around in their Cave system
I see more potential in the Oculus Rift though. Kinect can help with position tracking and integrate obstacles into your viewpoint so you don't walk into stuff. No need to see the real thing.
I think we have two years before Microsoft announces any pricing, so we'll see. And I think this is just a part of a bigger picture that includes Project Fortaleza.
