Definitly not worth buying the new consoles yet. I currently have a PS5.
There just is not enough next gen experiences to be had on either. I would imagine the Series X is even worse off.
That being said, Gamepass is the real deal, and if you plan to play the full Xbox catalogue in glorious 4k on a Series X for the first time, I would say go ahead!