3 ms·
Huh, it's a pretty similar technique to what I outlined a couple days ago: https://news.ycombinator.com/item?id=32965139 https://news.ycombinator.com/item?id=32
by etaioinshrdlu 4y ago
Huh, it's a pretty similar technique to what I outlined a couple days ago: https://news.ycombinator.com/item?id=32965139 https://news.ycombinator.com/item?id=32965139
Although they start with random initialization and a text prompt. It seems to work well. I now see no reason we can't start with image initialization!
- ToJans 4y ago"those who say it cannot be done should not interrupt the people doing it"
- amelius 4y agoThey said it could be done, and even said how...
- efrank3 4y agoThe version that you proposed wouldn't have worked
- bmpoole 4y agodirectly training a NeRF on a single image is a terribly unconstrained problem that would lead to a volume that looks bad when the viewpoint changes. the gist of render + use diffusion model to refine is a great idea though and core to our method! the details of how to use the diffusion model for this refinement was the challenge, but once we figured that out it... just worked :)
- etaioinshrdlu 4y agoVery cool! Can we tweak your algorithm a little to be seeded with a real photo from a single viewpoint?
- poolio 4y agoit's a good idea :)
- monocasa 4y ago> Sussman attains enlightenment > In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. > “What are you doing?”, asked Minsky. > “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied. > “Why is the net wired randomly?”, asked Minsky. > “I do not want it to have any preconceptions of how to play”, Sussman said. > Minsky then shut his eyes. > “Why do you close your eyes?”, Sussman asked his teacher. > “So that the room will be empty.” > At that moment, Sussman was enlightened. http://www.catb.org/jargon/html/koans.html http://www.catb.org/jargon/html/koans.html