I think people need to stop comparing it to the Wii period, Switch is not a casual-centric gaming device.
Sure it has some nods to that audience, but that's about it, it's a gaming hybrid device for people who need to have core games with them even when they go outside the house, which to me is a hardcore proposition in its own right. That's the "wow" of the Swtich, not that it can run some small simple game, the 3DS can do that too, it's that it can play a big giant adventure game like Zelda or Skyrim anywhere. As such it has appeal even to PS4/XBox gamers.
That's going to be the main appeal, it's what's driving adoption right now in Zelda.
If things like 1,2 Switch and Just Dance end up driving Switch adoption and selling tens of millions of copies, ok, then you can say otherwise, but right now, nope.
Even the marketing is basically majority focused on adult males, who are definitely not the novice gamer type.
The challenge for Nintendo now is to keep games like Zelda coming, games that really excite/interest enthusiast gamers. Switch will have to succeed on its own merits, it unlikely to have that Wii/DS casual appeal, but on the other hand it's wide functionality as a gaming device can bring more core gamers back towards buying one (perhaps in addition to a PS4) than other "failed" Nintendo platforms like GameCube did. So it has that going for it.