If we remove the temporary Wii craze which brought in an influx of casuals that have since left ...
NES - 62 million
SNES - 49 million
N64 -33 million
GameCube - 22 million
Wii U - 14 million
This is actually a fairly consistent and frightening drop. There's only so many Nintendo faithful left.