The N64 was easily one of Nintendo's worst consoles.

There were a handful of really great core Nintendo games on N64. Maybe even the best selection of core Nintendo games. But there was no selection outside of those games. For example, if you were an RPG fan, you got Quest 64 and Ogre Battle 64. And Quest 64 sucked. In terms of selection, even the Wii U has already surpassed N64.

There were also massive droughts every single year on the console where most often only 1 or 2 games got released in months that weren't December or November. I am not talking just good games, I am talking ALL games. There were about 300 total western released in the history of the console, only 234 of those were released in PAL territories. For comparison's sake, there were already over 200 games available on PSX before the N64 even launched. There are already 216 games available on Wii U, which is considered to be in a massive drought.

Not to mention the price of N64 games was much higher than any other major videogame system ever. I think only Neo Geo was higher. But Neo Geo wasn't a major videogame system.

I said all of the cool ones, didn't I? :P

no Perfect Dark or Goldeneye, Star Wars or any of the Turoks...nope not even close.

The Ram wasn't the issue, of course with a console, you can never have enough, especially as you approach the systems half-life.
Nintendo's solution to that however was the expansion pack which doubled the Ram.

The big issue was the limiting texture cache of which was an anemic 4KB, which resulted in small, low colour depth textures, hence once combined with trilinear filtering was why the Nintendo 64's textures all seemed blurry, low resolution and stretched, lacking much in the way of detail.
For some games it was better than the Playstation's more pixelated textures, depending on the games artistic style.

If you used mip-mapping on the Nintendo 64, then the texture cache was cut in half, developers did eventually work around that limitation with games like Perfect Dark and Conkers.

However, consdering it was Nintendo's first foray into fully 3D graphics for all their games, they did well and the cartridges did hold advantages like being more durable around children and having no load times. (With the cost of storage capacity.)
Not to mention it was also home to some of the best games of all time, I'm still waiting for a real successor to Lylat Wars and Perfect Dark. (Zero doesn't count!)

@bolded, I wonder if that is still possible today

Meh, maybe those games were cool 15 years ago. Goldeneye is on Wii, just not the N64 version. You can play Rogue Squadron 2 on Wii, much better than any Star Wars game on N64. Virtual Console also has the Super Star Wars titles.

Regardless, if you could own only one Nintendo console, but had access to its entire library, there's an obvious winner. Those few N64 games aren't going to outweigh the entire NES and SNES Virtual Console catalogues, much less the combined GameCube and Wii libraries in addition to that.

I could see someone making a case for the Wii U. Although it loses a massive collection of titles with the loss of GameCube backwards-compatibility, a good chunk of the GameCube's best games were re-released as Wii titles, making them accessible to Wii U owners.

Well yes, but then again the Nintendo 64 is the best console ever period, so obviously it's also the best Nintendo console.

Nope, gamecube was.

The reason Gen 5 was so good.  The jump from 2D to 3D made games so different from one generation to another.

Gamecube is the only home console Nintendo made worse than the N64.