Nintendo's least successful era

[BasilZero]

N64 + GBC

WiiU+3DS I would say would have been the closest but the 3DS carried Nintendo in that specific generation far more than what the N64 or Game Boy Color did in their respective generation.

If you put home consoles on its own - WiiU for sure. Worst Nintendo system.