By using this site, you agree to our Privacy Policy and our Terms of Use. Close

Forums - Microsoft - The Next Xbox Could Transform Your Living Room Into One Massive 3D Display

Adinnieken said:
Chark said:
Adinnieken said:
This has nothing to do with the control scheme for games folks. It's an extended display. It doesn't matter if you use a game pad, fight stick, steering wheel, or Kinect, it would allow a game to extend the display. Working in conjunction with Kinect, it would be able to track body position, head position, or even eye position, but it essentially could or would replace the look functionality by allowing the player to simply look in the direction to see from that perspective.


You're thinking too hard. When you talk about perspective do you mean it would alter the projection to match your head position so say you look left at the wall lean your head forward and instead of you just looking at the same wall the image would move accordingly like you were actually leaning to look but past something. That would be pretty amazing but I fear the execution would be flawed. I'd be much happier with 360 degree gameplay a headset would provide.

EDIT: Oh and a headset could create perspective gameplay aswell with head tracking. Perhaps much more accurately too, all without the need of an ideal room for projection.

The display is 360°, so if you looked (turned your head) left you would see what is to your left.  It doesn't change the view on your primary display.  If you turn your character, you change the view.  So if you turned left what was to your left when you looked would now be on your primary display.  Turning would change the 360° display, you physically looking in a direction wouldn't change anything.  Understand, I'm assuming the use of a game pad, wheel, flight stick or some other type of physical controller.  Functionality with Kinect would depend on the game. 

Well it's not actually 360. Turn right around and you won't see anything, it is done by projector. Front left and right.

If that is what you meant by perspective you worded that wrong. You meant direction not perspective. What I described would be perspective viewing.

A set up like this would be best with a physical input, as can be learned from Kinect's shortcomings. Still, a 3D personally viewer using move and cameras would trump this set up on every point. Even when you throw in the glasses with this the 3D screens would do a much better job than the augmented reality those glasses would use. This just screams impractical and expensive, while a PlayStation version just screams expensive.

Microsoft is looking to improve Kinect, that's for sure. This though, doesn't look promising.



Before the PS3 everyone was nice to me :(

Around the Network
Dallinor said:
Adinnieken said:
thehusbo said:
As cool as it looks, technology like this is still years off. It would be far too expensive for your average person anyway.

Yes, because Microsoft was incapable of taking technology that was still years off, and far too expensive for the average person and selling it for $150 with Kinect.

The basic technology involved here is a projector capable of displaying a 360° image.  Hardly a lot of sophisticated technology.

Well I think it would depend on how much tech and research currently exists for something like this or if MS are doing most of it internally. For Kinect for example MS had to licence camera technology from an Israli company, purchase a 3D video camera company and a semiconductor company to produce the 3D sensors to make Kinect a reality.

These companies had done research and development surrounding the Kinect hardware tech already, so it was simply a case of MS reaching out and making some aquisitions and hammering out deals to secure the hardware.

As for the software, Rare created that. So this time around Rare may be working on the new tech involved in this and perhaps the other aquisitions MS made have shifted development to this as well.

Either way, I would still imagine even the software required for something like this might be a few years off at least.

Edit: I made a few mistakes in my first post.

Yes and no.  According to prior documents, it's being released in 2014.  So it's still a couple of years off.  However, if Microsoft had the idea of how things worked back in 2010, then my guess is that they've been working on it actively. 

As for Rare working on this, my answer would be a definitive affirmative.  There was a job posting back in 2010 or 2011, after Kinect was released, looking for someone capable of working on 3D interfaces.  The belief at the time was that it was strictly related to Kinect, however nothing ever materialized.

I don't think Microsoft would have patented it unless it was something they already have worked out.  Whether it is perfected or not is a different story, but my guess is the software is likely 75% there.  Meaning it does everything they say it does in the patent, but it probably doesn't work as well as they'd like.  But that's my guess. 

As to Kinect, what you fail to realize is that behind Kinect were years of research into the same technology.  Microsoft was working on a completely different technology that was featured in the movie "The Island" but with the same principle of depth sensing the user.  It had years of experience working on voice recognition with Windows and Office, and subsequently was built into Ford Sync.  These technologies weren't something new to Microsoft.  I doubt 3D projection is new to Microsoft either. 

Not saying your wrong, you could be, just saying I don't necessarily agree that this is way off in the future.  I think Microsoft has every intention to bring it to market in 2014.



iFlow said:
Adinnieken said:
iFlow said:
What if there is a chair or a lamp in the way...

How do you mean?


The device projects the graphics on all walls, right? So would someone have to move any objects out of the room in order for this to work? Because wouldn't the objects act like a body in front of a projector?

Yes they would. Now imagine a dog, cat, or your sister walking in the room. They would be the surfaces were the projection is going to.

This sound more like a protective patent for something else than in the description. 



Chark said:
Adinnieken said:
Chark said:
Adinnieken said:
This has nothing to do with the control scheme for games folks. It's an extended display. It doesn't matter if you use a game pad, fight stick, steering wheel, or Kinect, it would allow a game to extend the display. Working in conjunction with Kinect, it would be able to track body position, head position, or even eye position, but it essentially could or would replace the look functionality by allowing the player to simply look in the direction to see from that perspective.


You're thinking too hard. When you talk about perspective do you mean it would alter the projection to match your head position so say you look left at the wall lean your head forward and instead of you just looking at the same wall the image would move accordingly like you were actually leaning to look but past something. That would be pretty amazing but I fear the execution would be flawed. I'd be much happier with 360 degree gameplay a headset would provide.

EDIT: Oh and a headset could create perspective gameplay aswell with head tracking. Perhaps much more accurately too, all without the need of an ideal room for projection.

The display is 360°, so if you looked (turned your head) left you would see what is to your left.  It doesn't change the view on your primary display.  If you turn your character, you change the view.  So if you turned left what was to your left when you looked would now be on your primary display.  Turning would change the 360° display, you physically looking in a direction wouldn't change anything.  Understand, I'm assuming the use of a game pad, wheel, flight stick or some other type of physical controller.  Functionality with Kinect would depend on the game. 

Well it's not actually 360. Turn right around and you won't see anything, it is done by projector. Front left and right.

If that is what you meant by perspective you worded that wrong. You meant direction not perspective. What I described would be perspective viewing.

A set up like this would be best with a physical input, as can be learned from Kinect's shortcomings. Still, a 3D personally viewer using move and cameras would trump this set up on every point. Even when you throw in the glasses with this the 3D screens would do a much better job than the augmented reality those glasses would use. This just screams impractical and expensive, while a PlayStation version just screams expensive.

Microsoft is loking to improve Kinect, that's for sure. This though, doesn't look promising.

True, it isn't 360°, it's more like 350°.  It will project to the left and right behind you, but obviously not on you or directly behind you.  It will also project to the left and right of you.  It isn't simply a forward facing projector, it is a 360° projector.  There are other images that show how it won't project where the user is, but it will project behind the user.  So you could physically turn and look behind you and see if there is anything there.

Point of view was what I was referring to in terms of perspective.  In terms of a dictionary definition of perspective it's #1.  Perspective in terms of 3D is #3.  My use trumps your use, but I can't adequately address perspective in reference to 3D.  My take is that what this device will do is, from the users perspective (def. #1), display a 350° view (excluding the user) of the environment.

In terms of 3D, this would not provide a 3D environment.  It would provide the background of that environment.  You don't see far distant objects in 3D.  You see them in 2D.  As you get closer or as they come closer to you, you start to see them in 3D.  Based on the presentation documentation from Microsoft that leaked, it would appear that the Project Fortaleza glasses would provide the possibility for a 3D experience.  This is mentioned in the patent, as well.

The purpose of this device is simply to extend the 2D display.  As far as I know, it has no 3D capabilities as that would be VERY difficult to project a 3D image with a constantly modifying perspective (def. #3).

I don't see this really improving Kinect, but it simply utilizes it to make the game environment more immersive.  The problem this device solves is that it expands the entire gaming environment.  That is to say, the game world is no longer confined to a TV screen, but instead to an entire room.

I don't understand why you say it doesn't appear promising.  I would say differently.  In the right room, this would make gaming absolutely awesome.  It may not be great for everyone, but based on the fact that it isn't slated to be released with the next Xbox, I'm guessing it won't be necessary but rather an accessory that game developers can extend their game for.

The Project Fortaleza glasses will be where the 3D aspect comes in and at that time we'll see what it is capable of doing.



iFlow said:
Adinnieken said:
iFlow said:
What if there is a chair or a lamp in the way...

How do you mean?


The device projects the graphics on all walls, right? So would someone have to move any objects out of the room in order for this to work? Because wouldn't the objects act like a body in front of a projector?

No, it's actually addressed in the patent.

Basically, the device uses a Kinect (depth & RGB camera) to determine everything about the room, and then projects an image so that it properly displays on whatever it is projected onto, including dark fabrics or walls.  The image will properly distort to conform to whatever it's being projected onto so that from the user's point of view, it looks correct (undistorted).



Around the Network
Adinnieken said:
SvennoJ said:

"An RGB projector that handles the task of extending the display beyond the television, wrapping the gamer's room in graphics. A depth camera, integrated into the peripheral, could be used to help map the user's environment, with the projected image corrected to compensate for furniture and other objects — instead of seeing a chair painted with light, the projected image would adjust in order to help your furniture blend in."

So how is it going to compensate for missing walls, large windows, dark surfaces etc. Transparent glasses like google's prototype video that project 3D images inside the environment would work much better.

You have some seriously valid questions, which the patent doesn't necessarily address.

As for dark walls, apparently it will sense the room color and compensate the image for the room color.  So, it'll be REALLY interesting to see this thing work.

"5. The system of claim 3, wherein a camera is configured to detect color information by measuring color reflectivity from the environmental surface."

"6. The system of claim 5, further comprising instructions to compensate for a color of the environmental surface described by the color information so that the peripheral image appears as a color distortion-corrected extension of the primary image. "

That all being said, it is an accessory.  It is not a require component of the console.  If it doesn't work in your environment, bummer.  However, if you have a room where it will work, then you have the opportunity to have an enhanced gaming experience.  Yay you!

It seems like they took this technology

and thought up a patent for indoor use.
(As you can see at the start all the windows have flat screens behind them to make it work)

And no matter what you do, you can't project onto a black surface, or glass.
It would be interesting if you have a good room for it, until you check the prices of projectors with enough light output capable of projecting a 180 degree field of view.

You can buy a holodeck already btw, if you have 4x4x2.8 meters to spare


Michigan 3D lab is using the Kinect to move around in their Cave system


I see more potential in the Oculus Rift though. Kinect can help with position tracking and integrate obstacles into your viewpoint so you don't walk into stuff. No need to see the real thing.



SvennoJ said:
Adinnieken said:
SvennoJ said:
 

"An RGB projector that handles the task of extending the display beyond the television, wrapping the gamer's room in graphics. A depth camera, integrated into the peripheral, could be used to help map the user's environment, with the projected image corrected to compensate for furniture and other objects — instead of seeing a chair painted with light, the projected image would adjust in order to help your furniture blend in."

So how is it going to compensate for missing walls, large windows, dark surfaces etc. Transparent glasses like google's prototype video that project 3D images inside the environment would work much better.

You have some seriously valid questions, which the patent doesn't necessarily address.

As for dark walls, apparently it will sense the room color and compensate the image for the room color.  So, it'll be REALLY interesting to see this thing work.

"5. The system of claim 3, wherein a camera is configured to detect color information by measuring color reflectivity from the environmental surface."

"6. The system of claim 5, further comprising instructions to compensate for a color of the environmental surface described by the color information so that the peripheral image appears as a color distortion-corrected extension of the primary image. "

That all being said, it is an accessory.  It is not a require component of the console.  If it doesn't work in your environment, bummer.  However, if you have a room where it will work, then you have the opportunity to have an enhanced gaming experience.  Yay you!

It seems like they took this technology

and thought up a patent for indoor use.
(As you can see at the start all the windows have flat screens behind them to make it work)

And no matter what you do, you can't project onto a black surface, or glass.
It would be interesting if you have a good room for it, until you check the prices of projectors with enough light output capable of projecting a 180 degree field of view.

You can buy a holodeck already btw, if you have 4x4x2.8 meters to spare


Michigan 3D lab is using the Kinect to move around in their Cave system


I see more potential in the Oculus Rift though. Kinect can help with position tracking and integrate obstacles into your viewpoint so you don't walk into stuff. No need to see the real thing.

I think we have two years before Microsoft announces any pricing, so we'll see.  And I think this is just a part of a bigger picture that includes Project Fortaleza.



@ Adinniekin

I'm not saying it doesn't make for something amazing, just that there is better technology than projection that will give better results along with consistency. The 3D viewer has this concept beat and I would be dissapointed if Microsoft kept persuing the route shown above.

The ability to look left and right and have a huge surround display is great, something very exciting. Toss in sixaxis and a motion camera onto a 3D personal viewer and not only do you have the ability to look left and right you can do so while moving, no need to center yourself towards your tv. That and the viewer engulfs your entire range of vision, that 750" view mixed with true 360° scope and a move sharpshooter, priceless experience*. With individual eye 3D, depth can not get any better. All that without looking over to spot that target next to your lamp. Sure you can end up stumbling in your living room, but with a warning system when you get out of range and the ability to forgo turning around entirely by using analog sticks, there shouldn't be too much worry. Besides you could always invest in a rotating chair.

*Very expensive



Before the PS3 everyone was nice to me :(

I'd just be very surprised if Microsoft went this route with it. People are just not going to want to deal with the issues that arise with projection.

On a side note. Nextbox name confirmed, the Xbox 350!



Before the PS3 everyone was nice to me :(

Chark said:
I'd just be very surprised if Microsoft went this route with it. People are just not going to want to deal with the issues that arise with projection.

On a side note. Nextbox name confirmed, the Xbox 350!

They don't need to,this thing no chance bundle in nextbox,if it's really coming to next gen,i bet we will see that about 3~5 years after nextbox released(if they can make the price is $150 or cheaper...pretty hard i guess),like Kinect

But this time i doubt they will push it hard(if they really release this),because it will change nothing like Kinect,it just change what you see,not what you play