Ray tracing on PS5 is through a dedicated chip so shouldn't impact much the rest.
There is no such thing as a ray tracing chip. There are many ways to do ray tracing, some faster, some with better quality. Some dedicated hardware can help but it's not magic. RTX cards still struggle with ray tracing. It will impact the rest, dedicated chip or not.