3 ms·
There's probably some locality you can exploit as well. Given the same surface and close proximity, I imagine the coefficients are nearly identical. Or store o
by imbusy111 3y ago
There's probably some locality you can exploit as well. Given the same surface and close proximity, I imagine the coefficients are nearly identical.
Or store only the rotation of certain typical small set of SH coefficients in two values + index. For an ideal, single material sphere, all the coefficients could be lined up exactly, right?
- ReactiveJelly 3y agoI think the SH of a splat also depends on geometry around it, for shadows and reflections, so if the sphere is inside a scene, the sphere's SHs may not all be rotations of each other. Cause I've seen SH used for baked-in shadows.
- imbusy111 3y agoVery true. But the splats cannot, at the moment, account for moving lights, nor dynamic scenes, so it seems like only the 0-th harmonic would be affected by shadowing.
- aras_p 3y agoI looked at that in the previous post (https://aras-p.info/blog/2023/09/13/Making-Gaussian-Splats-smaller/ https://aras-p.info/blog/2023/09/13/Making-Gaussian-Splats-s...) and while there's some nearby correllations in positions & colors (for colors I actually (ab)use that by doing BC7 compression on that data), the rotations & scales are "pretty much random". Which makes sense; if they were not random the GS optimizer would probably have represented them as smaller amount of larger splats.
- BenoitP 3y agoFeels like the field is testing an changing lots of parameters right now. Hell, we were doing volumetric NeRF not long ago. It's going to be very interesting to where it converges. I would not be surprised to see volumetric wavelets at some point.