5 ms·

The more I've looked into the topic the less I think the removal of lidar was a cost issue. I think there are a lot of benefits to simplifying your sensor tech

The more I've looked into the topic the less I think the removal of lidar was a cost issue. I think there are a lot of benefits to simplifying your sensor tech stack, and while I won't pretend to know the best solution removing things like lidar and ultrasonic sensors seem to have been a decision about improving performance. By doubling down on cameras your technical team can remain focused on certain sensor technology, and you don't have to deal with data priority and trust in the same way you do when you have a variety of sensors. The only real test will be who creates the best product, and while waymo seems to have the lead it's arguably too soon to tell.

vjvjvjvjghv 10mo ago
Usually you would go in with the max amount of sensors and data, make it work and then see what can be left out. It seems dumb to limit yourself from beginning if you don’t know yet what really works. But then I am not a multi billionaire so what do i know?
- fpoling 10mo ago
  Well we know that vision works based on human experience. So few years ago it was a reasonable bet that cameras alone could solve this. The problem with Tesla is that they still continue to insist on that after it became apparent that vision alone with the current tech and machine learning does not work. They even do not want to use a radar again even if the radar does not cost much and is very beneficial for safety.
  - bsder 10mo ago
    > Well we know that vision works based on human experience. Actually, we know that vision alone doesn't work. Sun glare. Fog. Whiteouts. Intense downpours. All of them cause humans to get into accidents, and electronic cameras aren't even as good as human eyes due to dynamic range limitations. Dead reckoning with GPS and maps are a huge advantage that autonomous cars have over humans. No matter what the conditions are, autonomous cars know where the car is and where the road is. No sliding off the road because you missed a turn. Being able to control and sense the electric motors at each wheel is a big advantage over "driving feel" from the steering wheel and your inbuilt sense of acceleration. Radar/lidar is just all upside above and beyond what humans can do.
  - jsnell 10mo ago
    Human performance won't be sufficient. Self-driving vehicles have to be noticably (order of magnitude) better than humans to be accepted.
  - vjvjvjvjghv 10mo ago
    Human vision is terrible in conditions like fog, rain, snow, darkness and many others. Other sensor types would do much better there. They should have known that a long time ago.
    - guywithahat 10mo ago
      To be fair, lidar is arguably worse in rain and snow. I don't think we know of a sensor yet which works well in these conditions
_aavaa_ 10mo ago
Having multiple sources of data is a benefit, not a problem. Entire signal processing and engineering domains exist to take advantage of this. Even the humble Kalyan filter lets you combine multiple noisy sources to get a more accurate result than would be possible if using any one source.
- fpoling 10mo ago
  Kalman filters and more advanced aggregators add non-trivial latency. So even if one does not care about cost, there can be a drawback from having an extra sensor.
  - _aavaa_ 10mo ago
    Yes, there are tradeoffs to be made, but having to reconcile multiple sensors is not intrinsically a negative. But also, if you didn’t get the right result, I don’t care how quickly you didn’t get it.
  - MadnessASAP 10mo ago
    The latency from video capture and recognition is going to be so significant that it makes all other latency sources not even worth mentioning.
  - Zigurd 10mo ago
    Cars and roads are built for human reaction times. That's why you have low speed limits in urban areas. You can have a pile of latencies attributable to processing a scene and still have superhuman reaction time that contributes to outperforming humans. It's analogous to communications latency. High latencies are very annoying to humans, but below a threshold they stop mattering.
- guywithahat 10mo ago
  What I've heard out of Elon and engineers on the team is that some of these variations of sensors create ambiguity, especially around faults. So if you have a camera and a radar sensor and they're providing conflicting information, it's much harder to tell which is correct compared to just having redundant camera sensors. I will also add in my personal experience, while some filters work best together (like imu/gnss), we usually either used lidar or camera, not both. Part of the reason was combining them started requiring a lot more overhead and cross-sensor experts, and it took away from the actual problems we were trying to solve. While I suppose one could argue this is a cost issue (just hire more engineers!) I do think there's value in simplifying your tech stack whenever possible. The fewer independent parts you have the faster you can move and the more people can become an expert on one thing Again Waymo's lead suggests this logic might be wrong but I think there is a solid engineering defense for moving towards just computer vision. Cameras are by far the best sensor, and there are tangible benefits other than just cost.
solfox 10mo ago
To tell what? Waymo is easily 5 years ahead of the tech alone, let alone the roll out of autonomous service. They may eventually catch up but they are definitely behind.
dyauspitr 10mo ago
This is a solved problem. Many people I know including myself use Waymo’s on a weekly basis. They are rock solid. Waymo has pretty unequivocally solved the problem. There is no wait and see.
- goosejuice 10mo ago
  Nevermind the Waymos rolling by stopped school busses. https://www.npr.org/2025/12/06/nx-s1-5635614/waymo-school-buses-recall https://www.npr.org/2025/12/06/nx-s1-5635614/waymo-school-bu...
  - xp84 10mo ago
    This seems solvable, no? Not saying it isn’t really damn important, but those have stop signs and flashing lights. It seems like they can fix that.
    - goosejuice 10mo ago
      Solvable yes, but it's a perfect example of it not being solved yet despite this person's anecdotes. Engineering problems aren't limited to a single solution anyhow. Anyone ruling out a camera based solution has very little imagination.
      - dyauspitr 10mo ago
        Unless it’s a mathematical proof, solved usually means works in the overwhelming majority of cases. It’s solved for all intents and purposes.
        goosejuice 10mo ago
        Waymo has barely seen the US. They just got on the highway and don't operate anywhere with snow. If that's your definition of solved, be my guest, but it's a pretty silly one.
lotsofpulp 10mo ago
>The only real test will be who creates the best product, and while waymo seems to have the lead it's arguably too soon to tell. Price is a factor. I’ve been using the free self driving promo month on my model Y (hardware version 4), and it’s pretty nice 99% of the time. I wouldn’t pay for it, but I can see a person with more limited faculties, perhaps due to age, finding it worthwhile. And it is available now in a $40k vehicle. It’s not full self driving, and Waymo is obviously technologically better, but I don’t think anyone is beating Tesla’s utility to price ratio right now.
cameldrv 10mo ago
Honestly I think it's more that he was backed into a corner. The Teslas from ~9 years ago when they first started selling "full self driving" as an option, had some OK cameras and, by modern standards, a very crappy radar. The radar they had really couldn't detect stationary objects. It relied on the doppler effect to look for moving objects. That would work most of the time, but sometimes there would be a stationary object in the road, and then the computer vision system would have to make a decision, and unfortunately in unusual situations like a firetruck parked at an angle to block off a crash site, the Tesla would plow into the firetruck. Given that the radar couldn't really ever be reliable enough to create a self driving vehicle, after he hired Karpathy, Elon became convinced that the only way to meet the promise was to just ignore the radar and get the computer vision up to enough reliability to do FSD. By Tesla's own admission now, the hardware on those 2016+ vehicles is not adequate to do the job. All of that is to say that IMO Elon's primary reason for his opinions about Lidar are simply because those older cars didn't have one, and he had promised to deliver FSD on that hardware, and therefore it couldn't be necessary, or he'd go broke paying out lawsuits. We will see what happens with the lawsuits.
- xnx 10mo ago
  > he was backed into a corner He "painted himself into a corner" is the more accurate expression when one is the cause of their own problem
bulbar 10mo ago
Sure, but Tesla is already losing the race. They were ahead a few years ago, but not anymore. They bet in getting autonomous driving done with cameras only that are cheap and have a simple and will understood tech stack and ecosystem. It didn't work out though and now multi sensor systems are eating their lunch.
gitaarik 10mo ago
Seems to me rather that Teslas are self driving cars with a handicap; they are missing some easily obtainable data because they lack the sensors. Because their CEO is so hard headed. Simplifying things doesn't always make things easier.

vjvjvjvjghv 10mo ago

Usually you would go in with the max amount of sensors and data, make it work and then see what can be left out. It seems dumb to limit yourself from beginning if you don’t know yet what really works. But then I am not a multi billionaire so what do i know?

fpoling 10mo ago
Well we know that vision works based on human experience. So few years ago it was a reasonable bet that cameras alone could solve this. The problem with Tesla is that they still continue to insist on that after it became apparent that vision alone with the current tech and machine learning does not work. They even do not want to use a radar again even if the radar does not cost much and is very beneficial for safety.
- bsder 10mo ago
  > Well we know that vision works based on human experience. Actually, we know that vision alone doesn't work. Sun glare. Fog. Whiteouts. Intense downpours. All of them cause humans to get into accidents, and electronic cameras aren't even as good as human eyes due to dynamic range limitations. Dead reckoning with GPS and maps are a huge advantage that autonomous cars have over humans. No matter what the conditions are, autonomous cars know where the car is and where the road is. No sliding off the road because you missed a turn. Being able to control and sense the electric motors at each wheel is a big advantage over "driving feel" from the steering wheel and your inbuilt sense of acceleration. Radar/lidar is just all upside above and beyond what humans can do.
- jsnell 10mo ago
  Human performance won't be sufficient. Self-driving vehicles have to be noticably (order of magnitude) better than humans to be accepted.
- vjvjvjvjghv 10mo ago
  Human vision is terrible in conditions like fog, rain, snow, darkness and many others. Other sensor types would do much better there. They should have known that a long time ago.
  - guywithahat 10mo ago
    To be fair, lidar is arguably worse in rain and snow. I don't think we know of a sensor yet which works well in these conditions

_aavaa_ 10mo ago

Having multiple sources of data is a benefit, not a problem. Entire signal processing and engineering domains exist to take advantage of this. Even the humble Kalyan filter lets you combine multiple noisy sources to get a more accurate result than would be possible if using any one source.

fpoling 10mo ago
Kalman filters and more advanced aggregators add non-trivial latency. So even if one does not care about cost, there can be a drawback from having an extra sensor.
- _aavaa_ 10mo ago
  Yes, there are tradeoffs to be made, but having to reconcile multiple sensors is not intrinsically a negative. But also, if you didn’t get the right result, I don’t care how quickly you didn’t get it.
- MadnessASAP 10mo ago
  The latency from video capture and recognition is going to be so significant that it makes all other latency sources not even worth mentioning.
- Zigurd 10mo ago
  Cars and roads are built for human reaction times. That's why you have low speed limits in urban areas. You can have a pile of latencies attributable to processing a scene and still have superhuman reaction time that contributes to outperforming humans. It's analogous to communications latency. High latencies are very annoying to humans, but below a threshold they stop mattering.
guywithahat 10mo ago
What I've heard out of Elon and engineers on the team is that some of these variations of sensors create ambiguity, especially around faults. So if you have a camera and a radar sensor and they're providing conflicting information, it's much harder to tell which is correct compared to just having redundant camera sensors. I will also add in my personal experience, while some filters work best together (like imu/gnss), we usually either used lidar or camera, not both. Part of the reason was combining them started requiring a lot more overhead and cross-sensor experts, and it took away from the actual problems we were trying to solve. While I suppose one could argue this is a cost issue (just hire more engineers!) I do think there's value in simplifying your tech stack whenever possible. The fewer independent parts you have the faster you can move and the more people can become an expert on one thing Again Waymo's lead suggests this logic might be wrong but I think there is a solid engineering defense for moving towards just computer vision. Cameras are by far the best sensor, and there are tangible benefits other than just cost.

solfox 10mo ago

To tell what? Waymo is easily 5 years ahead of the tech alone, let alone the roll out of autonomous service. They may eventually catch up but they are definitely behind.

dyauspitr 10mo ago

This is a solved problem. Many people I know including myself use Waymo’s on a weekly basis. They are rock solid. Waymo has pretty unequivocally solved the problem. There is no wait and see.

goosejuice 10mo ago
Nevermind the Waymos rolling by stopped school busses. https://www.npr.org/2025/12/06/nx-s1-5635614/waymo-school-buses-recall https://www.npr.org/2025/12/06/nx-s1-5635614/waymo-school-bu...
- xp84 10mo ago
  This seems solvable, no? Not saying it isn’t really damn important, but those have stop signs and flashing lights. It seems like they can fix that.
  - goosejuice 10mo ago
    Solvable yes, but it's a perfect example of it not being solved yet despite this person's anecdotes. Engineering problems aren't limited to a single solution anyhow. Anyone ruling out a camera based solution has very little imagination.
    - dyauspitr 10mo ago
      Unless it’s a mathematical proof, solved usually means works in the overwhelming majority of cases. It’s solved for all intents and purposes.
      - goosejuice 10mo ago
        Waymo has barely seen the US. They just got on the highway and don't operate anywhere with snow. If that's your definition of solved, be my guest, but it's a pretty silly one.

lotsofpulp 10mo ago

>The only real test will be who creates the best product, and while waymo seems to have the lead it's arguably too soon to tell. Price is a factor. I’ve been using the free self driving promo month on my model Y (hardware version 4), and it’s pretty nice 99% of the time. I wouldn’t pay for it, but I can see a person with more limited faculties, perhaps due to age, finding it worthwhile. And it is available now in a $40k vehicle. It’s not full self driving, and Waymo is obviously technologically better, but I don’t think anyone is beating Tesla’s utility to price ratio right now.

cameldrv 10mo ago

Honestly I think it's more that he was backed into a corner. The Teslas from ~9 years ago when they first started selling "full self driving" as an option, had some OK cameras and, by modern standards, a very crappy radar. The radar they had really couldn't detect stationary objects. It relied on the doppler effect to look for moving objects. That would work most of the time, but sometimes there would be a stationary object in the road, and then the computer vision system would have to make a decision, and unfortunately in unusual situations like a firetruck parked at an angle to block off a crash site, the Tesla would plow into the firetruck. Given that the radar couldn't really ever be reliable enough to create a self driving vehicle, after he hired Karpathy, Elon became convinced that the only way to meet the promise was to just ignore the radar and get the computer vision up to enough reliability to do FSD. By Tesla's own admission now, the hardware on those 2016+ vehicles is not adequate to do the job. All of that is to say that IMO Elon's primary reason for his opinions about Lidar are simply because those older cars didn't have one, and he had promised to deliver FSD on that hardware, and therefore it couldn't be necessary, or he'd go broke paying out lawsuits. We will see what happens with the lawsuits.

xnx 10mo ago
> he was backed into a corner He "painted himself into a corner" is the more accurate expression when one is the cause of their own problem

bulbar 10mo ago

Sure, but Tesla is already losing the race. They were ahead a few years ago, but not anymore. They bet in getting autonomous driving done with cameras only that are cheap and have a simple and will understood tech stack and ecosystem. It didn't work out though and now multi sensor systems are eating their lunch.

gitaarik 10mo ago

Seems to me rather that Teslas are self driving cars with a handicap; they are missing some easily obtainable data because they lack the sensors. Because their CEO is so hard headed. Simplifying things doesn't always make things easier.