I'm unfamiliar with the innards of these systems, but a brief overview shows the 3DS  has 2/4 times as much RAM, (depending on PSP model) twice as much VRAM, and while its main screen is lower resolution at 240x400 vs 272x480 on PSP, 3D pushes the number to 240x800, plus there's the 240x320 bottom screen.

As far as how the CPUs and GPUs compare though, I'm at a loss, can anyone tech-savvy explain to me how they compare?

It's comparable but defiantly a good leap. Also remember that game makers get better with time. Compare launch PSP games with launch 3DS games and you'll see the large improvement.

It is always difficult to compare specs of consoles one-to-one given their custom architectures. Comparing RAM is also difficult because system software and memory implementation also varies drastically by console. My opinion as an electrical engineer is that you should simply look at the games, since that's all that matters anyways.

Generally the 3DS is definitely more powerful than the PSP. It's not exactly a giant jump, but it's clearly noticeable.

If only people would remember this when talking about the Wii U, haha.

Oh I know. In only a few years its games will look way better than anything on PS360.

More.

Is it safe to say its similar to PS2 vs GC

It is no doubt more powerful than the Psp in my opinion. Games like Resident Evil Revelations, Kid Icarus, and Kingdom Hearts make me certain.

Not sure how accurate this is, but 3DS is stronger in a variety of ways even if it isn't pushing tech very far.

The PSP has 128 ppi and the 3DS has 237 ppi. As what seems to be Nintendo's calling card, releasing hardware at a marginal increase in performance as a means to provide lower cost of development, even though I'm not sure that always translates, but it atleast provides them with cheaper manufacturing costs to prevent the need to sell at a large loss....well typically.

PSP<PS2<3DS<GC
GC and 3DS are close, but 3DS has more modern techniques.

Powerwise, def behind the Xbox though.