4 ms·
This is honestly genius. If I understand it correctly, instead of manipulating pixels, you turn any 2D image to a 3D model and then manipulate that model.
by carlosjobim 2y ago
This is honestly genius. If I understand it correctly, instead of manipulating pixels, you turn any 2D image to a 3D model and then manipulate that model.
- papamena 2y agoYes! This really feels next-gen. After all, you're not actually interested in editing the 2D image, that's just an array of pixels, you want to edit what it represents. And this approach allows exactly that. Will be very interesting to see where this leads!
- riggsdk 2y agoOr analogous of how you convert audio waveform data into frequencies with the fast-fourier transform, modify it in the frequency spectrum and convert it back into waveform again. Their examples does however only look a bit like distorted pixel data. The hands of the children seem to warp with the cloth, something they could have easily prevented. The cloth also looks very static despite it being animated, mainly because the shading of it never changes. If they had more information about the scene from multiple cameras (or perhaps inferred from the color data), the Gaussian splat would be more accurate and could even incorporate the altered angle/surface-normal after modification to cleverly simulate the changed specular highlights as it animates.
- anamexis 2y agoThe type of 3D model, Gaussian splatting, is also pretty neat and has been getting a lot of attention lately. There's been some good previous discussion on it here, like this one: Gaussian splatting is pretty cool https://news.ycombinator.com/item?id=37415478 https://news.ycombinator.com/item?id=37415478
- kranke155 2y agoGaussian splatting is clearly going to change a lot of things in 3D assets, surprise to see it doing the same for 2D here.