I never grew up with an N64(I have played it though). It was always a weird system to me. Nintendo did a good job with their games on using it but when it came to third party game it always felt "off". Like the game had to adapt to the controller rather than the other way around. Also out of all the Nintendo controllers, it was definitely the weirdest controller. If you look at the controller evolution from NES to GC. It seemed like the N64 controller was out of place.
Anyway I think the controller worked best with 3D platformers and rail shooters like Starfox.