I think the main issue is that it's not a balanced setup, the GPU is now way too powerful for the CPU.
If you had a PC equivalent to a base PS5 and asked for advice on how best to upgrade, I doubt anyone would be suggesting you drop your entire budget into just the GPU, as you'd end up with an extremely CPU-bound system, which is what the PS5 Pro seems to be.
It was a while since I watched the Digital Foundry hand-on, but the Sony reps had Oliver (think it was him), sitting absurdly close to massive screens, replicating a setup precisely zero people will have in real life.
For the majority, who I'm guessing will have sub-55 inch screens, and who sit at a normal distance, the advantages of the PS5 Pro will largely be lost.