Report: Xbone voice commands don't work like advertised. Requires repetition.

[Kresnik]

Despite what our best optimists would have you believe, it was never going to live up to the marketing.  That's the point of marketing - to make everything look fantastic; even when it isn't.

Still, it must work enough of the time for things like this to happen:

It'll get better with time.