Instead of spreading out your upper body so much focus more on your upper body days (shoulders and back one day, chest another, arms the last, whatever). You could probably say the same thing about lower body, though I generally did most everything because I have really strong legs and didn't care too much. It's my upper body that's as weak as a kitten.