3 ms·

What do you call the video of a Tesla mistaking the moon for a yellow traffic light[1], if not a detection failure? That wouldn't happen with a lidar-only or li

What do you call the video of a Tesla mistaking the moon for a yellow traffic light[1], if not a detection failure? That wouldn't happen with a lidar-only or lidar-assisted system. [1] https://www.youtube.com/watch?v=7UF-S2czdCk https://www.youtube.com/watch?v=7UF-S2czdCk

sedgjh23 5y ago
they said most, not all
zootboy 5y ago
I'm not sure how lidar would help in detecting yellow lights correctly. Seems to me like that has to be a vision system, at least until we get all traffic lights to report their state via radio.
- jlund-molfese 5y ago
  I was thinking distance—if the object emitting the yellow light is 240K miles away from your car, it can be assumed that it isn’t a traffic signal, right?
- FireBeyond 5y ago
  "how far away is the light?"
qwertox 5y ago
This is a strange bug. As if they weren't making predictions about where the yellow light would have to be one second later, by using at least speed and accelerometer data, and compare the expected result with the new reality. This is not necessarily a job for lidar, they are just omitting some checks. At second 18 [1] a street light comes into play which looks similar to the moon. That relative movement is what the system should have been expecting from the moon, but they apparently just re-computed the assumption that the moon is a traffic light which is moving along with the car. It's somewhat revealing that they are not doing these kind of checks. I actually can't believe that they aren't doing it, but I can't see a case where the traffic light would always be at the same spot, if you have velocity and acceleration data at hand. A traffic light is a very important thing. [1] https://youtu.be/7UF-S2czdCk?t=18 https://youtu.be/7UF-S2czdCk?t=18
iknowstuff 5y ago
The traffic light detection runs on an older NN which works over individual image frames instead of the new video-based system. They are migrating towards the latter. In any case, they can ask the fleet for examples of this and train the NN against it.

sedgjh23 5y ago

they said most, not all

zootboy 5y ago

I'm not sure how lidar would help in detecting yellow lights correctly. Seems to me like that has to be a vision system, at least until we get all traffic lights to report their state via radio.

jlund-molfese 5y ago
I was thinking distance—if the object emitting the yellow light is 240K miles away from your car, it can be assumed that it isn’t a traffic signal, right?
FireBeyond 5y ago
"how far away is the light?"

qwertox 5y ago

This is a strange bug. As if they weren't making predictions about where the yellow light would have to be one second later, by using at least speed and accelerometer data, and compare the expected result with the new reality. This is not necessarily a job for lidar, they are just omitting some checks. At second 18 [1] a street light comes into play which looks similar to the moon. That relative movement is what the system should have been expecting from the moon, but they apparently just re-computed the assumption that the moon is a traffic light which is moving along with the car. It's somewhat revealing that they are not doing these kind of checks. I actually can't believe that they aren't doing it, but I can't see a case where the traffic light would always be at the same spot, if you have velocity and acceleration data at hand. A traffic light is a very important thing. [1] https://youtu.be/7UF-S2czdCk?t=18 https://youtu.be/7UF-S2czdCk?t=18

iknowstuff 5y ago

The traffic light detection runs on an older NN which works over individual image frames instead of the new video-based system. They are migrating towards the latter. In any case, they can ask the fleet for examples of this and train the NN against it.