The problem is the price. Theres fewer grown ups interested in handhelds than kids and the higher the price, the less likely parents will buy their kids a handheld console instead of another toy.
Vita 2 needs to be launched at ~£160 and accept microSD cards instead of their own expensive ones.