6 ms·
Bolt3D: Generating 3D Scenes in Seconds
- deleted 2y ago[deleted]
- slowtrek 2y agoIs anything like this available locally yet?
- emmelaich 2y agoHere's the repo: https://github.com/szymanowiczs/splatter-image https://github.com/szymanowiczs/splatter-image Apparently you can clone and run the demo locally. But wasn't clear at a glance how much is local and what hardware required.
- ashikns 2y agoIsn't it generating in the browser using webgpu?
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]
- gessha 2y agoI assume that’s for interactive viewing only, not for generation. > Our method takes 6.25 seconds to reconstruct one scene on a single H100 NVIDIA GPU or 15 seconds on an A100.
- dvrp 2y agoI mean, it's the same author but seems like co-authors are different. How do you know it's the actual implementation?
- echelon 2y agoYour link above (Splatter Image) is not the same code / paper / research as Bolt3D. This is a previous paper/work by the lead author a year before they interned at Google Research and produced Bolt3D. Bolt3D appears to be his intern research project done in conjunction with a bunch of other Google and DeepMind researchers. I don't suspect there will ever be publicly available code for this.
- kombine 2y agoThis is previous work. Bolt3D uses the same principle, of predicting a per-pixel Gaussian splatting representation but it also trains a diffusion model, which is only feasible if you have substantial compute available. Given that it's a work done at Google I will not expect them to release source code. But it will be reproduced by someone else soon enough.
- emmelaich 2y agoTrue, I should've said related work.
- diggan 2y agoShow. Us. The. Wireframes! Every single time a new "Generate 3D" thing appears, they never show the wireframes of the objects/scenes up front, always you need to download and inspect things yourself. How is this not standard practice already? Not displaying the wireframes at all, or even offer sample files so we could at least see it ourselves, just makes it look like you already know that the generated results are unusable...
- ajwin 2y agoMy understanding is that it is not mesh, it’s Gaussian Splatting. There are tools to convert Splats into mesh though.
- diggan 2y agoYeah, but isn't still the expected outcome to end up with actual 3D objects, not point clouds? Or did people start integrating point clouds into their 3D workflows already? Besides for stuff like volumes and alike, I think most of us are still stuck working with polygons for 3D.
- text0404 2y agosplats augment 3D scenes, they don't replace them. i've seen them used for AR/VR, photogrammetry, and high-performance 3D. going from splats to a 3D model would be a downgrade in terms of performance.
- noduerme 2y agoI'm very unclear as to what is supposed to be happening locally here, but as soon as the demo finishes loading, it crashes firefox on my phone.
- lukan 2y agoI assume WebGPU related? FF lacks behind in support and I assume they use it under the hood. Meaning I would try chrome. (I know, I know)
- tmilard 2y agoImpressed with Bolt3D AI model ! - Speed of the 3D generation, - Accurate 3D mesh deduction. It's a wonderfull chock. I agree, this is the way forward: - "some photos" as imput. - Convenient, a camera is in every pocket (Smartphone). On WE, I have been trying for years to generate 3D from photos.My tool now works well, but there is still this big problem of the time it takes to "recreate" the 3D mesh from photos. I remind that photos are in ... 2D.Not convenient. Here is an example of my Tool's generation : https://free-visit.net/fr/demo01 https://free-visit.net/fr/demo01 Here, Bolt3d takes away the 4 hours combersome work into a automatic process. Wahoo ! So Bravo to the Bolt3d team of researchers.
- oplane 2y agoCan 3D generation happen for terrain views on a map ?
- bhouston 2y agoIt doesn't seem to work that well. Once you move off the primary camera axis, like rotate around, you notice that there are many regions with only sparse resolution and there are gaps everywhere. It is totally unusable for anything. Sure, it solves for the primary view, but this is claiming it is a 3D scene reconstruction/inference technique and in that claim it only sort of works. For example: https://i.postimg.cc/43tj36jv/Screenshot-2025-03-20-at-8-52-48-AM.png https://i.postimg.cc/43tj36jv/Screenshot-2025-03-20-at-8-52-...
- gcapu 2y agoWhere is this image from? Were you able to try the model?
- curtisszmania 2y ago[dead]
- scyzoryk_xyz 2y agoI’m imagining this approach being combined down the line with your typical photogrammetry approach for reinforcing quality.
- antonkar 2y agoWe’ll hopefully convert an LLM into a 3D haunted house and finally democratize AI interpretability by having millions of gamers walking in them
- marianaenhn 2y agook, thx
- burgerone 2y agoWhat's the use case for putting AI into everything? Pretty much every AI product so far has been and still is subject to hallucinations and inaccuracies and on top of that it's hugely computing intensive. Sure, it's the best we have right now and it allows us to do things that were previously next to impossible with manual programming work, but it's far from being something that's actually viable. And what would be the use case for turning a picture into an approximated 3d mesh that is only really complete from one angle? LIDAR does a stunningly accurate job at that already, reproducibly (although granted that this cannot retroactively be applied to existing photos).
- graypegg 2y agoSo I agree with you, but to be fair it is neat, and I think academia should be allowed to try things with little to no *immediate* commercial value. Being "neat" is enough IMO if there's enough resources to go around. In the long run, yeah this *exact* application is sort of pointless. I expected to see the lens parameters factored into the process. It's not. This would mean that everything is not only dimensionally inaccurate since there's no reference measurement, but also proportionally inaccurate to other things in the scene. You can actually see the effect of that on the "flower car" example. (the entire shape of the car is warped) Let alone the fact that the entire scene that can't be seen in the original photo is made up. Maybe someone would use this to make game assets? But you'd need to fix them up a ton before using them. Other sibling comments make the point that there's no wireframes... so we can assume the polygon count here is insane. Either way... it's just neat.
- AlexeyBelov 2y ago> What's the use case for putting AI into everything? Money.
- flykespice 2y agoGood good, now show me the topology