Project website
GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality. GameNGen can interactively simulate the classic game DOOM at over 20 frames per second on a single TPU.
Game Preview
Arxiv page
What a cool concept! Brings a whole new meaning to the phrase, “but can you run Doom on it?” If this could be made reliable enough, I could see this used to generate new data for training YOLO models 