It really depends how you look at it, it was a flop coming after the SNES and it sold much less than 1/3 the units the PS1 sold.
As for the amazing graphics, I would ask you, have you played the games on an emulator or the original console? because the texture filtering was horrible, texture resolution was too low all games looked extremely blurry, the frame rate were generally really low (many games are barely playable) and the sound was just too muffled in a lot of titles, because of the cart format (different topic, but this is part of the quality of the titles)...
As for the controller, I never liked it, the original dualshock was a much better design for integrating thumbstick controls (and it does so while introducing dualsticks and giving you access to the D-Pad at the same time as the left analog stick, this is the design that survived to this day).
As for the game library, it's OK, but compared to the other consoles available at the time (PS1 and Saturn) it's not very interesting to re-visit, I would say it has 2 or 3 important titles (mario 64, Zelda OOt and for some the MP portion of Golden Eye 64).
