Lag will be a huge problem with this, at least if it is done now on today's technology.
The amount of processing you have to do to detect, analyse, interpret motions before even getting them into the game will make it useless for anything that requires reactions. Like sports.
Won't happen. Or if it does, it won't happen well.







