3 ms·
When I think of turning sequences of images into gaussians, I think of the difficulty of getting generalizable information that can be re-rendered out of the pi
by vessenes 2y ago
When I think of turning sequences of images into gaussians, I think of the difficulty of getting generalizable information that can be re-rendered out of the pipeline; textures and lighting, basically. From the description at the top of the paper, where they mention adding dimensions for things like albedo, I got excited.
But the demos don't do any re-rendering / change of lighting / etc, so I can't tell if this paper is just a 'super high render quality at same training time' paper, which is of course great to have, or if it has a shot at being extended to get us scenes that can be adjusted as to lighting and texture in-engine.
Any experts care to chime in?
- WithinReason 2y agoThe penultimate video has a lighting change
- nurettin 2y ago12d gaussians video has a moving light source and z rotation.
- barfbagginus 2y agoYou should be able to add those features as extra dimensions. I wonder how well this works for scenes with multiple characters, posed skeletons for the characters, etc How would you avoid degenerate parts of the configuration space, where characters clip through each other, clip through level features, etc? Could it theoretically scale to render a rave crowd with 1000 random people dancing under wild lighting effects?