3 ms·

You can stream video with milliseconds of latency, provided you have enough bandwidth for the video stream. Videoconferencing and cloud gaming both work on this

You can stream video with milliseconds of latency, provided you have enough bandwidth for the video stream. Videoconferencing and cloud gaming both work on this principle. That said, I would argue that their focus on one-way latency is misinformation meant to make the picture look rosier than it actually is. Round-trip latency is what matters here -- the video feed needs to get to the assistant, then the assistant needs to react, then their response needs to get back to the car. If one-way latency is 250ms, then round-trip latency would presumably be 500ms, which is a very long time in the context of driving. At highway speeds, you'd travel ~44 feet / 13 meters in that time.

gruez 8mo ago
>That said, I would argue that their focus on one-way latency is misinformation meant to make the picture look rosier than it actually is. Round-trip latency is what matters here -- the video feed needs to get to the assistant, then the assistant needs to react, then their response needs to get back to the car. If one-way latency is 250ms, then round-trip latency would presumably be 500ms, which is a very long time in the context of driving. At highway speeds, you'd travel ~44 feet / 13 meters in that time. Right, which is why the blog post is titled "Advice, not control ..." and goes to explain that they're not relying on the "remote assistance" people to make split second judgements.
Retric 8mo ago
They don’t do human in the loop at highway speeds. Further the cars need to safely stop in an emergency without human intervention. There’s no way for the car to first notice a problem, then send a message to a call center which then routes to a human, and for that human to understand the situation, all fast enough to avoid a collision. Even 50ms is significant here let alone several seconds.
- mcny 8mo ago
  That's not an achievement. Even a non intelligent low to mid end compact SUV such as a 2024 Mazda CX30 has cruise control that can detect cars stopped ahead to slow down, stop if necessary, and continue when the car in front starts moving. I'm just saying that "it avoids a collision" by not ramming into people or cars is table stakes and it makes us look incompetent if we tout it as a flagship feature.
  - Retric 8mo ago
    You say that but we’ve had cars that can do what you describe for a decade and yet actual autonomous driving is still waiting. Not failing due to a software or hardware issue is way more complicated than just usually working. Avoids a collision is similarly way more difficult than just detecting a stopped car. What needs to happen when a car blows out a tire at speed isn’t just slam on the breaks for example. At scale cars need to adapt to the conditions and drive defensively not just watch what’s directly in front of them.

gruez 8mo ago

>That said, I would argue that their focus on one-way latency is misinformation meant to make the picture look rosier than it actually is. Round-trip latency is what matters here -- the video feed needs to get to the assistant, then the assistant needs to react, then their response needs to get back to the car. If one-way latency is 250ms, then round-trip latency would presumably be 500ms, which is a very long time in the context of driving. At highway speeds, you'd travel ~44 feet / 13 meters in that time. Right, which is why the blog post is titled "Advice, not control ..." and goes to explain that they're not relying on the "remote assistance" people to make split second judgements.

Retric 8mo ago

They don’t do human in the loop at highway speeds. Further the cars need to safely stop in an emergency without human intervention. There’s no way for the car to first notice a problem, then send a message to a call center which then routes to a human, and for that human to understand the situation, all fast enough to avoid a collision. Even 50ms is significant here let alone several seconds.

mcny 8mo ago
That's not an achievement. Even a non intelligent low to mid end compact SUV such as a 2024 Mazda CX30 has cruise control that can detect cars stopped ahead to slow down, stop if necessary, and continue when the car in front starts moving. I'm just saying that "it avoids a collision" by not ramming into people or cars is table stakes and it makes us look incompetent if we tout it as a flagship feature.
- Retric 8mo ago
  You say that but we’ve had cars that can do what you describe for a decade and yet actual autonomous driving is still waiting. Not failing due to a software or hardware issue is way more complicated than just usually working. Avoids a collision is similarly way more difficult than just detecting a stopped car. What needs to happen when a car blows out a tire at speed isn’t just slam on the breaks for example. At scale cars need to adapt to the conditions and drive defensively not just watch what’s directly in front of them.