4 ms·

You have to remember that you have a much greater "dynamic range" of vision as a human. That means that you can see much darker and brighter things at the same

You have to remember that you have a much greater "dynamic range" of vision as a human. That means that you can see much darker and brighter things at the same time. The thing that would(or should) have alerted you as a driver is the reflecting of the truck's lights on the paint of the broken down pickup as it drove past. Although why the truck driver didn't slowdown as it passed a crash is a bit of a mystery. However, Teslas have radar for this sort of things. On the other hand this does kinda underscore the problem of using cameras with global shutter control for self driving. The auto contrast couldnt cope with the oncoming lights, so stopped down the sensitivity of the camera, leaving it blind to that broken truck.

seanmcdirmid 5y ago
Do Teslas have radars? I thought their self driving tech was based solely on conventional video cameras? Found: > Beginning with deliveries in May 2021, Model 3 and Model Y vehicles built for the North American market will no longer be equipped with radar. from https://www.tesla.com/support/transitioning-tesla-vision https://www.tesla.com/support/transitioning-tesla-vision, so radar-less is a new thing. That Tesla should have had a radar unless bought recently.
- KaiserPro 5y ago
  its hw2.5 which does have radar. If its used or not is another matter. either way, having a different class of sensor is wise, to make up for corner cases in the main sensor array.
vgeek 5y ago
What is the practical solution for cameras only besides sensors with more dynamic range? Secondary cameras with faster apertures and higher ISOs(or different exposure settings)? Would that also help by allowing triangulation for distances and minimizing false positives for stationary objects? It is more of a technology or cost problem?
- KaiserPro 5y ago
  Good question. Tesla already have limited number of sensors, and they do most of the driving using monocular(single camera, or single viewpoint with three different zoom levels) inference. This is absolute madness, given the state of current tech. For that night situation, I would be pushing for a different camera type. One that doesn't have a global exposure setting. This means that groups of pixels can be lumped together to have local ISO settings(its more complex than that, and involves integrating processing silicon directly under the sensor, on the same die.). This is a way to get vastly greater dynamic range in a situation where you have lots of point lights (ie headlights) This would require developing and qualifying a new camera sensor from scratch (I don't think generic versions of this type of camera exist yet) Musk is unlikely to do this as he has signaled that everything should be done via ML. Second, using a different wavelength, IR, or near IR. Thirdly, higher wavelength radar. It gives you this information for free, they are cheap and already qualified for vehicles.

seanmcdirmid 5y ago

Do Teslas have radars? I thought their self driving tech was based solely on conventional video cameras? Found: > Beginning with deliveries in May 2021, Model 3 and Model Y vehicles built for the North American market will no longer be equipped with radar. from https://www.tesla.com/support/transitioning-tesla-vision https://www.tesla.com/support/transitioning-tesla-vision, so radar-less is a new thing. That Tesla should have had a radar unless bought recently.

KaiserPro 5y ago
its hw2.5 which does have radar. If its used or not is another matter. either way, having a different class of sensor is wise, to make up for corner cases in the main sensor array.

vgeek 5y ago

What is the practical solution for cameras only besides sensors with more dynamic range? Secondary cameras with faster apertures and higher ISOs(or different exposure settings)? Would that also help by allowing triangulation for distances and minimizing false positives for stationary objects? It is more of a technology or cost problem?

KaiserPro 5y ago
Good question. Tesla already have limited number of sensors, and they do most of the driving using monocular(single camera, or single viewpoint with three different zoom levels) inference. This is absolute madness, given the state of current tech. For that night situation, I would be pushing for a different camera type. One that doesn't have a global exposure setting. This means that groups of pixels can be lumped together to have local ISO settings(its more complex than that, and involves integrating processing silicon directly under the sensor, on the same die.). This is a way to get vastly greater dynamic range in a situation where you have lots of point lights (ie headlights) This would require developing and qualifying a new camera sensor from scratch (I don't think generic versions of this type of camera exist yet) Musk is unlikely to do this as he has signaled that everything should be done via ML. Second, using a different wavelength, IR, or near IR. Thirdly, higher wavelength radar. It gives you this information for free, they are cheap and already qualified for vehicles.