Should you go all digital: No
Can you redownload games you payed for: of course, they are linked to your account not the system
Pros/cons for blu* ray vs digital: Blu ray is physical, digital isn't. Other than that it's the same game.
You're doing this just to be uniform? That sounds a bit OCD. But whatever floats your boat.
This reason why I think this is a bad idea, and this goes for the PS4 as well, is because games currently are 30+ gb each digitally. Especially on the Xbone, where you can't upgrade your hard drive (unlike the ps4), you should watch your space.
I do prefer digital in general, due to my laziness of not changing disks. But the pros of physical owning for next gen FAR outweigh the cons. At least for now.

Currently own:
Currently playing: Witcher 3, Walking Dead S1/2, GTA5, Dying Light, Tomb Raider Remaster, MGS Ground Zeros