I had one I didn't use for a long time that started drifting. Then after I used it a while it went a way.
See if you can make sure it's completely clean. Blow some compressed air, and/or use a q-tip in alcohol to get any stuff that may have accumulated.
One I would think the controller, but 3? I'm thinking it might be something else.