You're missing games, just like the Wii U.
You wouldn't buy the console for the controller. That doesn't make any sense. You buy the console if and because you want to play Mario Kart/Smash Bros/Donkey Kong/etc. Once playing the game in the comfort of your own home, you realize that the GamePad is actually very nice and that off-tv play is awesome.
The Wii U isn't appealing to you because you haven't played any games that are appealing to you on it. You even said you liked Rayman Legends, but the second screen didn't "do anything" for you. So what? Suppose I played Rayman Legends on PS3, but the dual analogue and rumble of the DS3 didn't "do anything" for me. Would I say the PS3 isn't appealing to me?
I mean, it's not, but that has nothing to do with DualShock.
