The only real difference between ps4 and xbox one atm is Virtual reality vs backwards compatibility. Sony is looking towards the future while MS caters to the past. Both are quite niche in practice, 1.7% of ps4 owners own psvr vs less than 5% of game time is spend on BC on XBox One. Ofcourse VR costs you an arm and a leg while BC is free.
I'm all into VR, no time to play old games unless remastered for VR. I'm very much anticipating long gaming sessions in Skyrim VR. VR makes me feel like a kid again, discovering videogames, watching them evolve rapidly, something completely new almost every month.
However if I had an XBox One and still had my PGR discs (given away long ago unfortunately) I would definitely check it out, although probably only for a short while as once you've driven in VR it's hard to go back. My tardiness in picking up Wipeout Omega is proof of that. Yet BC can also make me feel like a kid again, although only briefly. Nostalgia quickly disappears for me once I actually start playing the game.
Anyway what would you rather have?