4 ms·
They used webGL for the demo. Nice!
by CSSer 3y ago
They used webGL for the demo. Nice!
- sva_ 3y agoThis would be crazy in a video game. Walking through a bush and dragging the plant with you
- dragonwriter 3y ago> This would be crazy in a video game. Walking through a bush and dragging the plant with you. But game physics can handle stuff like that, there's no need for GenAI.
- esperent 3y agoI've been playing Red Dead Redemption 2 recently. When it comes to 3D nature scenes, this game is state of the art, and incredible in its attention to detail. Still, one of the things that stands out to me is how fake the small movements of leaves, grass, and flowers in the wind still feels. The actual physics of tree branches as you push past them isn't bad, but you can't use the physics engine for every leaf. The wind in trees and grass is still just a randomized oscillation of some kind that doesn't quite feel real. So I was immediately struck that this technique would be an improvement, perhaps using animated billboards. But it would come with its own issues - can't be done in real time any more than physics, for example, so it would be hard to use it for real time weather systems. And anyway, in that case since you're using a transparent video, there's probably easier ways to make it.
- solardev 3y agoRDR2 was good for its time, but is it really state of the art these days? Seems like other games have pretty good grass... Horizons Forbidden West: https://youtu.be/COY-pKl1BJY?si=uDrWYAqAlAiNVKZ8&t=16 https://youtu.be/COY-pKl1BJY?si=uDrWYAqAlAiNVKZ8&t=16 Crysis 3: https://www.youtube.com/watch?v=4_WwYMFS8EM https://www.youtube.com/watch?v=4_WwYMFS8EM Zelda BOTW: https://www.youtube.com/watch?v=1T7Z-u_JfmE https://www.youtube.com/watch?v=1T7Z-u_JfmE Or in UE5: https://youtu.be/Dj60HHy-Kqk?si=-iLHHWEH3cOEo-2L&t=42 https://youtu.be/Dj60HHy-Kqk?si=-iLHHWEH3cOEo-2L&t=42 https://www.youtube.com/watch?v=AShGmWyFamY https://www.youtube.com/watch?v=AShGmWyFamY https://www.youtube.com/watch?v=ZP_9DUhXVbk&t=2s https://www.youtube.com/watch?v=ZP_9DUhXVbk&t=2s
- CSSer 3y agoWow, that's a neat idea! That could potentially be pretty cool. It'd almost be like a form of photogrammetry but for physics. Kinegrammetry, maybe? I wonder what the storage efficiency and performance would look like. Perhaps something like ths could be adapted into a framework for object modeling.
- behnamoh 3y agoI'm still waiting for video games to adopt stable diffusion, GPT, and other GenAI models. the tech is there, but I guess the inertia in the industry doesn't allow us to have nice things yet.
- a_wild_dandan 3y agoYou'll see those things! We already have DLSS, for instance. But unfortunately we can't simply glue expensive black boxes onto games and ship them. Wrangling performant, richly interactive media is difficult enough without these models. This modern ML + gaming fusion space is barely in its infancy. We need to explore what's practical, and discover patterns to do it. Even without further breakthroughs, the next 5 to 10 years will be incredible. I'm so excited.
- wayfinder 3y agoWouldn’t say tech is there yet. It still needs a lot of human input and direction so slapping it into a video game would just be immersion breaking when it generates something out of character randomly. There’s less impactful ways to implement it like generating art paintings in a museum dynamically but that is in the “a little gimmicky” territory.
- sva_ 3y agoI think quite a bit of stuff like texture generation has already been used for some time - just on the developers machines pre-release. I suppose using these technologies client-side in real time will be something else entirely. Consumer hardware is lagging behind for that though, even with optimizations such as quantization tweaks etc.
- orbital-decay 3y agoTemporal stability has been solved for a while [1], there's just nothing of that grade for diffusion models currently. From above, tagged geometry guiding a temporally stable neural renderer seems to be the way to go for games, but this needs to be confirmed in the trenches. The industry has a lot to digest, and of course the hardware should improve quite a bit. [1] https://isl-org.github.io/PhotorealismEnhancement/ https://isl-org.github.io/PhotorealismEnhancement/
- pelorat 3y agoWhat do you mean, lots of games have physics that interreact with flora?