That's probably also the reason why Intel/AMD don't bother having Altera/Xilinx develop dedicated upscaling/ray tracing FPGAs for their GPUs. They could likely come up with industry-leading stuff in that regard but it simply wouldn't be worth the investment.
But maybe one of them still might in the chiplet era, I don't know.