2 ms·
Three reasons: 1) They have hundreds of millions of cars sold already with cameras that they can up-sell this to. That means more revenue. But more importantly
by jillesvangurp 5y ago
Three reasons:
1) They have hundreds of millions of cars sold already with cameras that they can up-sell this to. That means more revenue. But more importantly, more training data. Massive amounts of it. Training data is the real value here. Radar/lidar/etc. might be able to detect better what is obvious to a human just looking at a thing. But given enough training data, a machine learning can probably replicate that capability so you don't actually need the fancy sensors. Adding new sensors to the mix would set them back quite a while on that front.
2) Simplicity. More sensors means more complexity integrating all the signals and gathering the right training data. More failure modes, etc. It probably also means more compute power needed to process all that data. More complex testing, etc. Scaling by keeping the sensor platform simple is a good move here.
3) The hard part of autonomous driving is actually interpreting visual signals in complex or unusual/rare situations. Roads are designed for humans with eyes. Lidar sees a blob, radar detects a pole, a camera sees a traffic sign, road markings that mean something, etc. It's a much richer signal. All the important stuff on roads is clearly visible. So, cameras are far more important for this than lidar/radar. Those are really great for avoiding crashing into things. Not so much for interpreting and classifying those things. And Tesla seems to be doing pretty OK with not crashing into things. Mostly, the amusing edge cases have to do with misinterpreting visual signals for which radar and lidar are probably not that relevant.
It's an interesting approach that they clearly believe that they can make work. It does not actually stop them from later adding more hardware to enhance things if they decide those things are needed. But it's quite interesting how far they are getting with just cameras.
- stonewareslord 5y agoFor #1: wouldn't more sensors be even better for training? If vision does not pick up an object like a human, but lidar detects a human sized object, the vision portion of the model can 'learn' from it's mistakes. The other two sound like good reasons though
- jillesvangurp 5y agoExcept that would kind of invalidate all the training data they've gathered for the last years which does not have data for these sensors. That would be a major setback and might take years to fix. Probably they started ignoring the radar sensor content quite some time ago when they realized they did not need it. They never had any lidar. Obstacle detection with lidar/radar is only interesting if you assume that object avoidance is a problem with camera based obstacle detection right now. There are lots of incidents with Teslas but I don't recall them running over pedestrians or crashing into vehicles a lot. Mostly incidents are about misinterpreting visual signals; not about crashing into stuff. If anything, their safety statistics are pretty good when autopilot is on. The cars still do dangerous/illegal/misguided things due to misinterpreting of traffic situations but it's then smart enough to get the driver out of trouble before bad things happen.