As far as actual in-game stuff, I actually don't think much will change for the "average" game, since these language models are extremely compute intensive and using them inside the game (or API calls to an external server that the devs have to pay for) isn't likely.
Of course it will affect the game development process. More boring AI art for example, lol.