Without haptic feedback and something to stop you from reaching through things it will always remain a gimmick, only suited to a small subset of movements.
AR is more suited to this, overlay a control surface on a table and you can at least type on the table. Typing in thin air or will always suck. Yet maybe I'm wrong. Project a holographic switch or panel and maybe it won't feel so wrong to interact with that.







