No, I never even played the old Banjo games though I hoped to one day. I actually played and enjoyed nuts and bolts on the 360 as my first Banjo game which has probably corrupted my taste in games for life.
I don't think there's anything that would make me switch from PlayStation to Xbox. The question in my case should have been what would make you buy an Xbox One aswell. Rare releasing decent games could do it, depends on the games.