I wouldn't call Nintendo 64 a failure in terms of sales - though it was the start of a downward trend for Nintendo on that front (a trend only ignored by the Wii).
The actual console itself is of course, heavily overrated due to the amount of people who wear nostalgia goggles when looking at it. From a rational perspective that's not clouded by nostalgia (being as I never owned an N64 as a kid) it's an ok console with ok games. The only N64 game that I've played that truly holds up today is Ocarina of Time. As for the rest of them, I'm sure they were all great in their time period but they haven't aged well (and I've played most of the beloved N64 games, with the notable exception of Majora's Mask).
Don't worry Nintendo 64 fans, the Gamecube is even more overrated!