3 ms·
3D simulations can’t create photorealistic images. (Not currently, anyways)
by minimaxir 9y ago
3D simulations can’t create photorealistic images. (Not currently, anyways)
- bkberry352 9y agoYou don't need photorealistic images for these situations. The images are always downsampled to a smaller resolution. So getting "good enough" but not photorealistic is fine.
- minimaxir 9y agoIf you have software to simulate real-world physics for hundreds of independent agents that can be run on a personal computer with close to real world graphic fidelity (including realistic noise), you’re running a multibilion dollar company, not writing thought pieces on Medium.
- nl 9y agoThere are a few companies you can get simulation software from specifically designed for self-driving cars. See https://blogs.nvidia.com/blog/2017/10/26/self-driving-simulation/ https://blogs.nvidia.com/blog/2017/10/26/self-driving-simula... for some discussion. It's true that this isn't photo-realistic (see https://www.youtube.com/watch?v=D7OccC0W_CU https://www.youtube.com/watch?v=D7OccC0W_CU for a video), but at the same time it is useful enough for training.
- dharma1 9y agoThere were a couple of projects using GTA 5 for training data successfully (one from OpenAI) but they got taken down due to licensing issues
- shoyer 9y agoOne option is to train a GAN to do domain adaptation. Google (disclaimer: I work there) recently did that very successfully for training robots to grasp: https://research.googleblog.com/2017/10/closing-simulation-to-reality-gap-for.html?m=1 https://research.googleblog.com/2017/10/closing-simulation-t...
- amelius 9y agoReread my comment. I didn't suggest to only use the simulations.
- tomdre 9y agoCheck out "domain adaptation" https://en.wikipedia.org/wiki/Domain_adaptation https://en.wikipedia.org/wiki/Domain_adaptation