At the time, the PSP Go was perfect. Any that disagrees just didn't know how to fully use it.
If Sony created a similar handheld to the PSP Go (but of course more powerful and higher res) and add a slot for physical games, have their current PSN online features, and the ability to connect up to 4 controllers (instead of just 1) on the device for local gaming then that'd be the perfect console.