This thread is specifically about the possibilities of how Nintendo’s new controller and cameras could deliver the illusion of a 3D experience, and is composed of info from two users: a thread started by alfredofroylan (link below) and a post on this thread by Pyro as Bill.
http://gamrconnect.vgchartz.com/thread.php?id=127407&page=1
Now, I’m not saying all the rumors we’ve been hearing are necessarily true, but keep in mind Nintendo’s recent foray into 3D. After reading the alleged Ubisoft employee’s comment: “the 3D features the system offers are revolutionary and stunning, because you don´t need any glasses or 3DTV to experience it! The controller with build in screen and camera plays a huge part of that hologram like 3D effect.”, many were quick to dismiss this as ludicrous and completely impossible with reasonably priced technology. However after Pyro referenced the youtube video below of essentially just a Wii camera (the remote) and the sensor bar reversed to achieve said effect (requiring no special screen or lenses), the possibilities started to become apparent to me.
http://www.youtube.com/watch?v=Jd3-eiid-Uw&feature=player_embedded
First off, this video is from back in 2007 using a now primitive method. Second, Kinect hacks have already shown us similar head-tracking techniques… requiring no sensors on your head. Now while the effect in the video is pretty much reserved for one and Kinect’s technique may (or may not) have its limitations, the end result is obviously 100% possible.
What if Nintendo’s new controller has what is essentially a mini-Kinect type camera inside, one that faces the holder and basically tracks where his/her head is the whole time? Obviously the camera (or cameras) wouldn’t be able to do full skeletal tracking; it doesn’t have to. All it has to do is constantly track where the user’s head is while they hold the controller in front of them like they normally would, and work in tandem with a camera by the TV.
EDIT: As many pointed out, multiplayer head tracking is impossible without multiple images being displayed. However this could explain the purpose of the rumored screen on the individual controllers. Furthermore, IGN's recent update stating, "Sources now confirm to IGN the new Nintendo controller allows players to stream entire games to the device from the console, saying it's like a miniature television." sounds like the controller's screen isn't for making games portable like many first assumed, but instead giving everyone their own view of the game being played on the TV, doing away with having to split the screen in a game of Mario Kart and, possibly, giving one player their own view of the 3D illusion from the TV image. Now a nice six inch screen in your hands does admittedly sound quite alluring...
