Crimson Gem Saga is $3.49 on PSN right now if you don't mind purchasing it digitally. If you want it fairly cheap though, look for used copies. You'll eventually find one in mint conditon for an affordable price.
Here's the games I'd recommend that I don't remember seeing in your list. .
Brave Story New Traveler
Breath of Fire 3
Castlevania Dracula X Chronicles
Crimson Gem Saga
Final Fantasy 4 Complete Collection(Definitive version of FF4.)
Gurumin
Gundam Battle Universe
Half Minute Hero
Jeanne D'Arc
Phantasy Star Portable 2
Persona 2 Innocent Sin
Prinny Can I Really Be the Hero
Prinny 2 Dawn of Operation Panties, Dude!
Pursuit Force
Pursuit Force Extreme Justice
Space Invaders Extreme
Star Ocean First Departure
Star Ocean Second Evolution
Legend of Heroes Trails in the Sky
Tales of Eternia
Wild ARMs XF
Wipeout Pure
Wipeout Pulse
Yggdra Union
Ys 1 and 2 Chronicles