3 ms·
Anyone know anything I can use to take video of a road from my car (a phone) and create a 3D scene from it? More focused on the scenery around the road as I can
by ok_dad 3y ago
Anyone know anything I can use to take video of a road from my car (a phone) and create a 3D scene from it? More focused on the scenery around the road as I can put a road surface in there myself later. I’m talking about several miles or perhaps more, but I don’t mind if it takes a lot of processing time or I need multiple angles, I can drive it several times from several directions. I’m trying to create a local road or two for driving on in racing simulators.
- Jedd 3y agophotogrammetry - is the key word you're looking to search on. There's quite a few advanced solutions already (predating LLM/ML)
- 0_____0 3y agoSLAM from monoscopic video. I imagine without an IMU or other high quality pose estimator you'll need to do a fair bit of manual cleanup.
- sp332 3y agoMicrosoft's PhotoSynth did this years ago, but they cancelled it.
- WhatIsDukkha 3y agoGaussian splatting, there is quite a bit of youtube about it and there are commercial packages that are trying to make a polished experience. https://www.youtube.com/@OlliHuttunen78 https://www.youtube.com/@OlliHuttunen78 edit - I just realized you want a mesh :) for which Gaussian splatting is not there yet! BUT there are multiple papers which are exploring adding gaussians to a mesh thats progressively refined, I think its inevitable based on what's needed for editing and usecases just like yours. You could start exploring and compiling footage and testing and maybe it will work out but ... Here is a news site focused on the field - https://radiancefields.com/ https://radiancefields.com/
- chpatrick 3y agoYou can do this for free now with RealityCapture, not ML though.