ZH version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
75% Positive
Analyzed from 329 words in the discussion.
Trending Topics
#data#model#state#world#physics#latent#save#generated#feels#inputs
Discussion (9 Comments)Read Original on HackerNews
It often feels like the model is ignoring my inputs and just doing what it would expect the bot to do (which is unsurprising if the model could predict what would happen next during training without paying attention to the inputs)
Side-effect of the data: clearly the model is better than I normally am at playing, as it spontaneously did several things I had not told it to do and wouldn't really know how to do (at least not with a keyboard).
Really remarkable, congrats!
You can read plenty of details in the blog post and tech report but the TLDR is that we trained a multiplayer world model on 10k hours of Rocket League data. We optimized it to be playable at 20fps on a single GPU.
So what you see in the demo is fully generated: there’s no graphics or physics engine. Instead it’s a 5b neural network that takes actions in and gives pixels out.
Having a direct transformation would enable some interesting experiments.
How is the latent state different when everything else stays the same, but you change one physics value, like player one velocity? Is there a cyclical pattern of activation that correlates strongly with the seconds digit of the clock? Can you decode the latent state, give players full boost, and then re-encode it for infinite boost, without losing continuity?
What is the conversation like within Epic now? Is this still the view? What is the future for simulations like this?