Playing a Neural Network's version of GTA V: GAN Theft Auto
Why Hacker News recommends it
Cited as an early, striking demo of neural networks acting as game engines and world models.
What it is
Sentdex demonstrates GAN Theft Auto, a GameGAN-based neural network that recreates GTA V so the network itself is the playable environment. He shows the results and releases the code.
Recommended by 3 HN commenters across 4 different months, 2021 to 2025.
What Hacker News said
Recommends ALittleLight · 2021-08 · on “Where are the robotic bricklayers?”
This video really amazed me in terms of automated game development. My fantasies are something like this and GPT-3 plus a couple decades of progress. I think we'll get to genuinely open ended sand box games. [this video]
Recommends ALittleLight · 2022-04 · on “DALL-E, the Metaverse, and Zero Marginal Content”
This YouTube video, to me, shows the promise of things to come. AI generated game worlds. Language models to generate plots and dialog, transformers and GANs to create illustrations. Imagine a game, a truly open world sand box, Grand Theft Auto meets AI Dungeon - every NPC is a "real" person with unlimited dialog options, the buildings you drive by you could easily walk in and investigate, unlimited play space - you could type in more general instructions and ideas to the plot generator ("add in a vampire romance and murder mystery angle") on the fly. [this video]
Recommends eru · 2022-12 · on “Netflix: 30% bitrate saving using Film Grain Synthesis”
> You could directly encode the elements as understanded by the process used to generate them, rather than attempting to reconstitute things from a stream of bitmaps. You might like Gan Theft Auto: [this video]
Recommends 7734128 · 2024-08 · on “Diffusion models are real-time game engines”
What you're describing reminded me of this cool project: [this video] "Playing a Neural Network's version of GTA V: GAN Theft Auto"
Cites magic_quotes · 2021-06 · on “GAN Theft Auto [video]”
Have you seen the video? The author even goes as far as suggesting the technique might useful for (generating?) entire operating systems at [this video] . That's just wild.
Cites bentcorner · 2021-07 · on “The art of asking nicely”
GAN Theft Auto also had a similar dream-like quality, especially with anything involving collisions (cars and how "big" the road was). [this video]
Cites eru · 2022-11 · on “Chip design shifts as fundamental laws run out of steam”
> I'm not going to be so stupid as to say 8 cores should be enough for anyone (while attached to a machine with 128) but you have to wonder if the stable diffusion style apps running on your desktop are going to be mainstream, or isolated to the few who choose to _need_ them as a hobby or a smaller part of the public that uses them for commercial success. AKA, I can utilize just about every core i'm given with parallel compiles, or rendering a 4K video, but I'm pretty sure i'm the only one in my immediate family that needs that. My wife in the past might have done some simulation work, but these days the heaviest thing she runs on her PC is office products. See GAN Theft Auto at [this video] Some
Cites eru · 2022-12 · on “Netflix: 30% bitrate saving using Film Grain Synthesis”
I guess unless your codec handles water physics. Which is not quite as absurd as it sounds. Have a look at the reflections in [this video]