Everyone copies Nintendo. They are leaders for Innovation. However some of the upgrades you mentioned would have come naturally over time.
Rumble pack built in, did you expect that to remain a peripheral?
Also Wireless controllers, with built in batteries.
Literally everything is copied from Nintendo. The handheld controller, D-Pad, Start/Select buttons, 4 right thumb buttons (ABXY), shoulder buttons, rumble, wireless controllers, 4 player consoles, trigger buttons (Z on N64, gamecube trigger shoulders), Motion gaming, list goes on. MS only introduced the Home button, and Sony did duel analog with built in batteries, that's it.
P.S. PS1 controller with duel clicky analog sticks came before the N64 controller