3 ms·
The most exciting thing about this to me is the possibility of doing photogrammetry from the frames and getting 3D assets. And then if we can do it all in real
by jasonjamerson 4y ago
The most exciting thing about this to me is the possibility of doing photogrammetry from the frames and getting 3D assets. And then if we can do it all in real time...
- minimaxir 4y agoThere's a bunch of NERF tools that can get pretty close to good 3D assets from static images already.
- jasonjamerson 4y agoYeah, I've been starting to explore those. Its all crashing together quickly.
- Rumudiez 4y agoyou can already do this, just not in real time yet. You can upload frame sequences to Polycam's website for example, but there are several services out there which do the same thing
- jasonjamerson 4y agoWith this you can do it with things that don't exist. I'm excited to explore the creative power of Stable Diffusion as a 3D asset generator.
- haxiomic 4y agoThis field is moving fast! Something like this has just been released. Checkout DreamFusion, which does something similar: They start with a random 3D NeRF field and use the same diffusion techniques to try to make it match the output of 2D image diffusion when viewed from random angles! Turns out it works shockingly well, and implies fully 3D representations are encoded in traditional 2D image generators https://dreamfusion3d.github.io/ https://dreamfusion3d.github.io/
- deleted 4y ago[deleted]