One thing a lot of people seem to be missing here is that a significant demographic of the handheld market is children. If you don't include this demographic in your marketing strategies, you will not rise to the levels of DS or Gameboy.
I don't see Apple being able to successfully penetrate this market. I also don't see parents buying their children Apple devices (iPod Touch or iPhone) to be used as a gaming device.