This is pretty cool and would solve Nintendo's "we can't do VR because we have a gamepad" problem. It's suicide for anything with local multiplayer, though.
You know, unless this tech was on the gamepad screen, and not (just) the TV screen.
Also, this will be a pain in the ass to program for for any game with a moving camera. Just think about it.