4 ms·
This is really awesome. A question for someone who knows more about this: How much harder would it be to make this work using any number of photos? I'm assumin
by S0y 2y ago
This is really awesome. A question for someone who knows more about this:
How much harder would it be to make this work using any number of photos? I'm assuming this is the end goal for a model like this.
Imagine being able to create an accurate enough 3D rendering of any interior with just a bunch of snapshots anyone can take with their phone.
- dagmx 2y agoThat’s already how Gaussian splats work. They’re novelty of splattr (though I contest that they’re the first to do so) is that they need fewer images than usual.
- Arkanum 2y agoI think the novelty is that they don't have to optimise the splats at all, they're directly predicted in a single forward pass.
- dagmx 2y agoThat’s not really novel either imho, though google search is escaping me on the specific papers I saw at siggraph. Imho it’s an interesting combination of technologies but not novel in an off itself.
- GaggiX 2y agoThe novelty here is that it does work on uncalibrated images.
- Arkanum 2y agoProbably not much harder, but you wouldn't get the same massive jump in quality that you get going from 1 image to 2. NeRF/Gaussian Splatting in general is what you're describing, but from the looks of it, this just does it in a single forward pass rather than optimising the gaussian/network weights.