6 ms·
> with all vehicle sensors (radar, ultrasonics, cameras) staying the same. Still no LIDAR? LIDAR was the enabling technology in the DARPA challenges, and it re
by ModernMech 8y ago
> with all vehicle sensors (radar, ultrasonics, cameras) staying the same.
Still no LIDAR? LIDAR was the enabling technology in the DARPA challenges, and it remains so today. I can think of one Tesla customer who would still have a head if his "self driving" car was equipped with LIDAR.
- Animats 8y agoThat's what's so striking about this. The new hardware can run neural nets really fast. So they'll be able to do something that can do the job most of the time, but will still screw up badly some of the time. Not even stereo cameras. That's surprising. With all that compute power, depth from stereo should work well. A 3 camera system with all cameras pointed in roughly the same direction and arranged in a triangle, not a line, is resistant to many illusions that will trouble a 2-camera system. You don't need 3 cameras most of the time, but when you need them, you need them.
- toomuchtodo 8y agoTesla AP2.0+ vehicles have three forward facing cameras, two on each side (front quarter panels, side B pillars), and one rear camera, with overlap between them all. This should be more than sufficient to use structure from motion [1] instead of LIDAR for ranging (not including their ultrasonics). https://www.teslarati.com/tesla-autopilot-software-v9-blind-spot-detection-features/ https://www.teslarati.com/tesla-autopilot-software-v9-blind-... (Tesla Version 9 real-world blind spot test shows Autopilot’s 360° cameras in action) Youtube video of 3D Autopilot perspective: https://www.youtube.com/watch?v=wypE4fC56bg https://www.youtube.com/watch?v=wypE4fC56bg Of note: > Particularly noticeable in Erik’s demo, though, was what seemed to be a slight lag in how other vehicles’ avatars are displayed on the Model S’ instrument cluster, particularly when they are overtaking the electric car. That said, considering that blind spot monitoring is utilizing video feeds from the side and rear cameras, these slight lags could be due to the system shifting from one camera to another. This was particularly notable at around the 1:25 mark in the owner-enthusiast’s video. Which leads me to believe that the sensors (cameras, front radar, ultrasonics) are sufficient, but why the NN hardware upgrade is going to be necessary. Tesla bet that it was going to be cheaper to drive the cost of the processing hardware down vs being beholden to LIDAR, and it looks like they might be right. [1] https://en.wikipedia.org/wiki/Structure_from_motion https://en.wikipedia.org/wiki/Structure_from_motion
- udfalkso 8y agoI'd bet that lag is simply a front-end display issue.
- Cshelton 8y agoThere is a 3 camera system on the front of every AP2.0+ Tesla out there.
- Animats 8y agoBut they're not really aligned for stereo, although they do have some overlap.
- erikpukinskis 8y agoYou don't need stereo to perceive depth. You can do it with one camera over time, especially in an automotive case where the vehicle is always moving when it's making decisions.
- saulrh 8y agoThat's what's so striking about this. The new hardware can run neural nets really fast. So they'll be able to do something that can do the job most of the time, but will still screw up badly some of the time. You have perfectly captured the reason I don't trust myself to operate a car. I think that Tesla is moving too fast for public perception. A person is smart, but people are dumb, panicky animals, and expected value and engineering [1] set speed limits and goals that are far faster than PR, c.f. Greenpeace's anti-nuclear stance being significantly responsible for global climate change. But "they have to never make any mistakes" is a crippling double standard. [1] https://nickbostrom.com/fable/dragon.html https://nickbostrom.com/fable/dragon.html
- ucaetano 8y agoWhen the mistake results in human decapitation, you better not make them. Tesla is moving too fast for the quality of its own technology.
- eightysixfour 8y agoI find people’s response to autopilot failures to be really interesting. Autopilot is different than a human and is going to make different kinds of mistakes than a human, those mistakes are going to be frustrating and look “obvious” to humans. On the flip side every day humans make mistakes that autopilot would avoid and would be “obvious” to an AP system. Should we judge the computers vs perfection? Judge them like we judge humans? If a system came out that could be retrofit on every car in the country and make 1% fewer mistakes than humans, but the mistakes it makes are “obvious” and stupid, is it an improvement? Would we accept it? What about 10% or 50%?
- ucaetano 8y agoI'm fine with accepting a system that's better than humans, given some a priori evidence of such. But this isn't the case. This isn't the case of a company launching a system that performs better than humans through extensive testing and carefully weighting the risks. This is the case of a company intentionally false advertising something and resulting in preventable human loss.
- dominotw 8y agoi thought LIDAR has high cost barrier to be in consumer vehicles.
- ttul 8y agoIt does, but the cost is coming down quickly as a result of innovation.
- Alupis 8y ago> i thought LIDAR has high cost barrier to be in consumer vehicles. Ok, so you save a few bucks, kill a few people... then eventually come to the same conclusion every other Autonomous Driving company already has... you need LIDAR for this work reliably?
- deleted 8y ago[deleted]
- gpm 8y agoOr, you know, you get it working without LIDAR and make boatloads of money. Humans don't rely on any sort of LIDAR to drive, I don't see how you could be so certain that computers need to.
- trhway 8y ago>Humans don't rely on any sort of LIDAR to drive, I don't see how you could be so certain that computers need to. 1. using that logic we would still be trying to build airplanes with flapping wings like birds. 2. humans aren't that good of a drivers.
- shaklee3 8y agoHumans are GREAT drivers compared to anything else out there. Especially self-driving cars.
- andrewmunsell 8y agoHumans don't need LIDAR, but we rely on the massive amount of compute power available to us in our brains and a variety of other sensory inputs that go beyond simple vision. Of course, we're easily distracted, which is one reason why we aren't perfect drivers. I really believe you can make a vision+radar only self driving car, but not without a lot of compute power. LIDAR just makes it easier. Will HW3 be enough? Probably for a lot of scenarios, but it's definitely not going to be level 4/5 anytime soon.
- zmarty 8y agoLIDAR is a crutch and a dead end. Some startups have already wisened up and are only using cameras.
- syntaxing 8y agoInteresting because to me, LIDAR is an absolute necessity. Startups use cameras (+ radar) only because it's technically and financially "easier" than other technology. I don't know of any company with Level 3 and above self driving capabilities not using LIDAR (though I would love to be proved wrong because that would be awesome to see)
- ModernMech 8y agoIn the long run, binocular cameras should be enough. We are an existence proof of that. But that requires human-level cognition and inference, which is not something that's even on the horizon. Until then, LIDAR will be a key technology.
- raisedbyninjas 8y agoEven when cameras are "enough" LIDAR will still provide additional data not obtainable through cameras, allowing even safer driving. If humans had evolved biological LIDAR we would use it while driving.
- Klathmon 8y agoI may be mis-remembering, but wasn't an argument from Tesla that LIDAR would actually be a disadvantage? LIDAR has a lot more "false positives" if I remember correctly, and a lot of the work is going toward filtering LIDAR data and cleaning it up in cars that use it. I could see not wanting to spend the time and effort in trying to tame something like that when they have something working pretty well right now with different kinds of sensors.
- shaklee3 8y ago
- Fricken 8y agoSterling Anderson explains it better than I can: >Perception is a game of statistics. We believe it will ultimately be entirely possible to build a self-driving car that can get by on, for instance, cameras alone. However, getting autonomy out safely, quickly, and broadly means driving down errors as quickly as possible. Crudely speaking, if we have three independent modalities with epsilon miss-detection-rates and we combine them we can achieve an epsilon³ rate in perception. In practice, relatively orthogonal failure modes won’t achieve that level of benefit, however, an error every million miles can get boosted to an error every billion miles. It is extremely difficult to achieve this level of accuracy with a single modality alone. >Different sensor modalities have different strengths and weaknesses; thus, incorporating multiple modalities drives orders of magnitude improvements in the reliability of the system. Cameras suffer from difficulty in low-light and high dynamic range scenarios; radars suffer from limited resolution and artifacts due to multi-path and doppler ambiguity; lidars “see” obscurants. https://medium.com/aurora-blog/auroras-approach-to-development-5e42fec2ee4b https://medium.com/aurora-blog/auroras-approach-to-developme...
- erikpukinskis 8y agoCrudely speaking is right.