So it turns out the chipset driver from Asus website was kinda shat. Downloaded the one from AMDs website for X670E and my performance increased by 5-8%. Not a lot sure but considering it was just installing the driver, well worth it.
PC Specs: CPU: 7800X3D || GPU: Strix 4090 || RAM: 32GB DDR5 6000 || Main SSD: WD 2TB SN850