Make sure you disable the power saving feature, as outlined here:
http://manuals.playstation.net/document/en/psvita/settings/wifi_savemode.html
That setting caused issues with my connection.
It could also be a sign of your wireless router not being able to handle the load (either due to a failure or just being over capactiy).







