It's about 2X bigger than the competition, so it will take up way more space on the TV unit.
It has an inferior GPU and memory when compared to it's nearest competitor.
It's more expensive.
The packed in controller is inferior to the competition.
The system doesn't have anywhere near as many exclusives, be it games that are either outright exclusive to that one system or games that you can't get on the rival system.
Fewer and less established 1st party developers, with much less acclaim than the competition.
Smaller install base, thus the online community is way smaller than PS4.
MS doesn't seem to care to sort many of these issues out.
MS are all talk and no action.
No ability to swap out the internal HDD for a new one.
Weaker multiplats than PS4.
The cons seem absolutely clear, personally I've been open to MS showing me games that may interest me, but it's mostly the same old milked stuff, very little fresh ideas and practically nothing new from 1st party.
It doesn't have Horizon Zero Dawn (which has been outright stated to be coming next year), no Uncharted 4, Ratchet & Clank coming, along with amazing things like Dreams.
No No Man's Sky, no Bloodborne, no Tearaway Unfolded, no Driveclub, tonnes more you just can't play on it.
Lack of Sony's quality 1st party studios, that have been baking tonnes of exclusives and thinking about how to step up their game.
Hell even Wii U actually has a far bigger line-up of exclusives and other bonuses, like a cheaper price, smaller box, the Tablet Screen, rechargeable controllers. Nintendo's quality and proven studios.
I'd definitely buy a Wii U before I'd get an XB1 as my 2nd console. As for this nonsense about saying your PS4 has been gathering dust, I don't buy it. People don't spend money on something they have no interest in, especially a console, which quite frankly you could take that money and buy more multiplats for your XB1 or whatever system you game on, just buy more games for your chosen platform.
Just my personal perspective on the matter.