5 ms·

I wonder why they would let the public see this. To the critical eye it looks like it barely works. It loses its mind right at the beginning, around 0:06-0:07

I wonder why they would let the public see this. To the critical eye it looks like it barely works. It loses its mind right at the beginning, around 0:06-0:07, veers to the right for no reason and then rolls through a stop sign without stopping. It spends the rest of the video hunting left and right like a drunk.

IceSentry 7y ago
The video is clearly sped up and it looks like it did wait at the stop sign in the first part, it just didn't wait long.
- Groxx 7y ago
  yea, there's a big "stop" icon at the top, and it goes down to 2mph (afaict not zero). a rolling stop in any case.
torpfactory 7y ago
Sorta looks like its avoiding a big puddle in the road to the left of the vehicle. Notice the 'wed road' number goes up fast when it's going through that section.
judge2020 7y ago
Some have speculated that it's a human driving and not autopilot (plus autopilot still has a warning that it's only meant for highways).
- FireBeyond 7y ago
  > plus autopilot still has a warning that it's only meant for highways And Summon has a warning that you need to "pay full attention to the vehicle". Unless you look at their marketing, in which case it also tells you that you car will come "as you are being distracted by a fussy child".
Zeetah 7y ago
> It loses its mind right at the beginning, around 0:06-0:07, veers to the right for no reason I'm speculating but I think the reasons it veers to the right are some combination of the following: 1) There is water on the left hand side of the lane. I was going back and forth on the video and you can see "Raining" along the left edge turn green. So, it has detected the water and is avoiding it? At the same time it has turned green "Wet road". 2) There is a vehicle on the right side of the lane - it has been identified with an upside down green triangle / crosshairs and a square (is that block the license plate?) and the Tesla is "following" it. Again speculating based on watching the display change. I found this clip amazing for the following reasons: a) Around 0:02, it starts to notice the right edge of the road. Along the right edge of the video, you can see the estimated road. Around 0:04, you can see the right turn lane and the dots along the right edge change to show the vehicle has detected it. b) Detection of arrows on the road surface. They are labeled with "RA", "FA" and "LA". RA = Right Arrow, etc. c) Around 0:04, a "container" type of black outline appears on the right edge - it is a vehicle! d) Around 0:05, another container appears in the right turn area and it is another vehicle. e) Around 0:09, another container appears on the left middle and it is another vehicle. Jumping to 0:22: f) It has seen the vehicle about to enter the scene from the left and "CutinExcited" probability starts to increase and when the vehicle has moved through the scene, it goes away. g) If you see the frame at time 28668.2612540 (?), it has picked up and classified a person on the left of the red 44. Super impressive real-time classification.
- FireBeyond 7y ago
  > I'm speculating but I think the reasons it veers to the right are some combination of the following: 1) There is water on the left hand side of the lane. I was going back and forth on the video and you can see "Raining" along the left edge turn green. So, it has detected the water and is avoiding it? At the same time it has turned green "Wet road". 2) There is a vehicle on the right side of the lane - it has been identified with an upside down green triangle / crosshairs and a square (is that block the license plate?) and the Tesla is "following" it. "May potentially swerve into other lanes to avoid puddle"? And yeah, it literally runs a stop sign. In their own marketing video.
Bedon292 7y ago
Most of what is happening on that video appears to be a human controlling the vehicle, the overlay is just what the computer sees. In current public releases autopilot only warns you that it thinks you are going to run a red light / stop sign. And it is up for the human driver to actually stop. So, unless its on some beta release it was probably a human that rolled through it.
- interlocutor 7y ago
  > warns you that it thinks you are going to run a red light / stop sign I need this feature, and I would prefer this to full autonomous driving. A computer that warns you when you're about to make a mistake is achievable today and will increase safety for everyone.
  - notahacker 7y ago
    This. I expect this to be the near term outcome of a lot of autonomous driving projects, which is one of the reasons that despite my scepticism about the idea we're close to abandoning the steering wheel I still think the research itself is inherently worthwhile when conducted safely.
  - a_bonobo 7y ago
    I was in a Honda Stepwagn last week and that one recognised stop signs and clearly displayed it.
    - thedance 7y ago
      These can make neat demos but what’s the false negative rate?
      - a_bonobo 7y ago
        I don't think that data exists (outside of Honda's internal servers), does similar data exist for Teslas?
trca 7y ago
Karpathy (their Head of AI) showed how they are able to generate a 3D depth map of an environment given 2 forward-facing stereo cameras, it's possible that's what the car is attempting to do here since it recognizes that part of its vision will be blocked once it stops moving. Or it's trying to avoid the puddle lol.
- thedance 7y ago
  Maybe they can, but the videos give the impression (possibly misleading) that the software doesn't have object permanence. After it gets real close to the truck its estimate of where the road might be starts to wander around.

IceSentry 7y ago

The video is clearly sped up and it looks like it did wait at the stop sign in the first part, it just didn't wait long.

Groxx 7y ago
yea, there's a big "stop" icon at the top, and it goes down to 2mph (afaict not zero). a rolling stop in any case.

torpfactory 7y ago

Sorta looks like its avoiding a big puddle in the road to the left of the vehicle. Notice the 'wed road' number goes up fast when it's going through that section.

judge2020 7y ago

Some have speculated that it's a human driving and not autopilot (plus autopilot still has a warning that it's only meant for highways).

FireBeyond 7y ago
> plus autopilot still has a warning that it's only meant for highways And Summon has a warning that you need to "pay full attention to the vehicle". Unless you look at their marketing, in which case it also tells you that you car will come "as you are being distracted by a fussy child".

Zeetah 7y ago

> It loses its mind right at the beginning, around 0:06-0:07, veers to the right for no reason I'm speculating but I think the reasons it veers to the right are some combination of the following: 1) There is water on the left hand side of the lane. I was going back and forth on the video and you can see "Raining" along the left edge turn green. So, it has detected the water and is avoiding it? At the same time it has turned green "Wet road". 2) There is a vehicle on the right side of the lane - it has been identified with an upside down green triangle / crosshairs and a square (is that block the license plate?) and the Tesla is "following" it. Again speculating based on watching the display change. I found this clip amazing for the following reasons: a) Around 0:02, it starts to notice the right edge of the road. Along the right edge of the video, you can see the estimated road. Around 0:04, you can see the right turn lane and the dots along the right edge change to show the vehicle has detected it. b) Detection of arrows on the road surface. They are labeled with "RA", "FA" and "LA". RA = Right Arrow, etc. c) Around 0:04, a "container" type of black outline appears on the right edge - it is a vehicle! d) Around 0:05, another container appears in the right turn area and it is another vehicle. e) Around 0:09, another container appears on the left middle and it is another vehicle. Jumping to 0:22: f) It has seen the vehicle about to enter the scene from the left and "CutinExcited" probability starts to increase and when the vehicle has moved through the scene, it goes away. g) If you see the frame at time 28668.2612540 (?), it has picked up and classified a person on the left of the red 44. Super impressive real-time classification.

FireBeyond 7y ago
> I'm speculating but I think the reasons it veers to the right are some combination of the following: 1) There is water on the left hand side of the lane. I was going back and forth on the video and you can see "Raining" along the left edge turn green. So, it has detected the water and is avoiding it? At the same time it has turned green "Wet road". 2) There is a vehicle on the right side of the lane - it has been identified with an upside down green triangle / crosshairs and a square (is that block the license plate?) and the Tesla is "following" it. "May potentially swerve into other lanes to avoid puddle"? And yeah, it literally runs a stop sign. In their own marketing video.

Bedon292 7y ago

Most of what is happening on that video appears to be a human controlling the vehicle, the overlay is just what the computer sees. In current public releases autopilot only warns you that it thinks you are going to run a red light / stop sign. And it is up for the human driver to actually stop. So, unless its on some beta release it was probably a human that rolled through it.

interlocutor 7y ago
> warns you that it thinks you are going to run a red light / stop sign I need this feature, and I would prefer this to full autonomous driving. A computer that warns you when you're about to make a mistake is achievable today and will increase safety for everyone.
- notahacker 7y ago
  This. I expect this to be the near term outcome of a lot of autonomous driving projects, which is one of the reasons that despite my scepticism about the idea we're close to abandoning the steering wheel I still think the research itself is inherently worthwhile when conducted safely.
- a_bonobo 7y ago
  I was in a Honda Stepwagn last week and that one recognised stop signs and clearly displayed it.
  - thedance 7y ago
    These can make neat demos but what’s the false negative rate?
    - a_bonobo 7y ago
      I don't think that data exists (outside of Honda's internal servers), does similar data exist for Teslas?

trca 7y ago

Karpathy (their Head of AI) showed how they are able to generate a 3D depth map of an environment given 2 forward-facing stereo cameras, it's possible that's what the car is attempting to do here since it recognizes that part of its vision will be blocked once it stops moving. Or it's trying to avoid the puddle lol.

thedance 7y ago
Maybe they can, but the videos give the impression (possibly misleading) that the software doesn't have object permanence. After it gets real close to the truck its estimate of where the road might be starts to wander around.