4 ms·
>Tesla is the only participant that has a true path to self driving technology. They dont even ship cars with Stereo front facing cameras. Eight cameras, twelv
by rasz 6y ago
>Tesla is the only participant that has a true path to self driving technology.
They dont even ship cars with Stereo front facing cameras.
Eight cameras, twelve hypersonic sensors, one forward facing radar, GPS, and still no stereo vision resulting in cars plowing full speed into stationary obstacles ....
- godatemydog 6y agoU know u can do depth perception from time without stereo cameras?
- gamblor956 6y agoThat's true, but Tesla has yet to figure that out.
- lars_thomas 6y agoThings like this are not binary "can do/cannot do". Sure some kind of estimate could be made. But it is challenging when the scene is not static, the speed of the camera varies, lack of texture, motion blur... stereo is not without its problems of course. Lidars seem to be good in lot of the places where visible light cameras are struggling.
- jiggawatts 6y agoIt's possible to extract depth information from a monocular lens. There's several ways to do this, and Tesla has talked publicly that they've implemented at least one approach. One is depth-from-defocus combined with "overlap" hierarchy information that can be used to build a depth-map. This is the technique Tesla talked about. Interestingly, instead of manually coding up this algorithm, they simply trained a neural net to do it! The trick was to use the radar data as the "ground truth", and train the NN to predict it based on the optical input. It works quite well, and there are videos floating about showing how a Tesla can build up an accurate 3D model of the world around it as it drives along. There are other approaches as well. For example, the way birds gather depth information is they move their head. One eye takes two "snapshots" of the scene in rapid succession from slightly different positions, producing a stereo pair. A moving car is constantly shifting the camera positions. Note that you don't have to be moving the cameras side-to-side, moving along the road can be enough, as the shift of the focal plane can be used as an additional channel of information for the depth-from-defocus method mentioned above. This is what some mirror-less cameras do: they shift focus back-and-forth a bit to gain more information about the scene. A moving car has the same effect. Tesla has recently implemented some variant of this latter technique, they also talked about this publicly. Essentially, the first version of the self-driving hardware didn't have the computing power to analyse multiple frames together like this. The current version has the compute power to include the last few frames as well as inputs to the NN, which gives it not just more temporal stability but also the opportunity to extract depth information from motion. (However, I'm not sure if they've actually used motion in this specific way.)
- amscanne 6y ago> One is depth-from-defocus combined with "overlap" hierarchy information that can be used to build a depth-map. This is the technique Tesla talked about. Interestingly, instead of manually coding up this algorithm, they simply trained a neural net to do it! The trick was to use the radar data as the "ground truth", and train the NN to predict it based on the optical input. It works quite well, and there are videos floating about showing how a Tesla can build up an accurate 3D model of the world around it as it drives along. Wow, that scares the shit out of me. I hope this is not serious. How could they possibly understand the neural net and how it will behave under novel scenarios? This is the opposite of what you want in a safety critical system.