Turns out this is even more impressive. It's not using an engine or code to create this game, it's creating the game frame by frame as it goes along. Holy hell this tech is going to reck things completely.
Wow, diffusion models (used in AI image generation) are also game engines - a type of world simulation.
— Ethan Mollick (@emollick) August 28, 2024
By predicting the next frame of the classic shooter DOOM, you get a playable game at 20 fps without any underlying real game engine.
This video is from the diffusion model. pic.twitter.com/p13fSVvl7K