When you wake up from standby it takes the same time as a normal bootup, except when it's in the middle of doing something. So if you start downloading content, turn it off, and turn it on again you'd have the 5 second boot or whatever.
Also check your settings to see if you have everything turned on for standby mode.