3 ms·
Pretty cool stuff - I eagerly await the day when the same generative models can spit out fully explorable 3D environments that I can then explore in VR.
by uejfiweun 5y ago
Pretty cool stuff - I eagerly await the day when the same generative models can spit out fully explorable 3D environments that I can then explore in VR.
- andybak 5y agoYeah - that's my wish too. I think all the pieces already exist but you'd need a supercomputer to get realtime frame rates.
- DethNinja 5y agoYou don’t need a supercomputer. You can actually hook algorithmic art from Houdini to GAN models and bake 3D art for later use. Problem is that GAN models are still not good enough to produce human level realistic images. It can generate trippy images but these are not very useful for commercial products. We still need better models or a completely different approach for computer generated realistic art.
- ShamelessC 5y agoDiffusion models are better - but their inference times are orders of magnitude slower. GAN models are really cool. Don't get me wrong. But they are popular _because_ they are fast at inference. They are still challenging to train (hopefully projected GAN helps with this) and have a very tough time representing highly diverse datasets with lots of data.
- andybak 5y ago> You can actually hook algorithmic art from Houdini to GAN models and bake 3D art for later use. I've seen some stuff like that but it's not really what I'm talking about. I want fully dynamic, spatially consistent generative worlds. And that is pretty hard to do at 75 or so FPS in stereo.