I'd wait to see if the PC version of SF5 is any good since you wouldn't have to buy anything to do it that way.
On the PS4, there is a lot going on where they are perhaps opening the door to PS3 fightsticks, which means that you could potentially pick up an older model but still awesome fight stick for your PS4 and SF5 down the line for cheap. There are also ways of modding the sticks to change compatibility from one platform to the other, but I've never done that myself.
Again, no confirmation AFAIK about PS3 fightsticks being possible with SFV on PS4 just yet, but there is at least one game, and a petition is there for MKX as well to get PS3 stick support. The driver that makes it work is royalty-free, so there's not much stopping Capcom from getting onboard, unless they really want to help sell PS4-only sticks by deliberately locking out PS3 sticks lol.