5 ms·

We're asking a lot from this kind of software (for good reasons), but humans commit hundreds of leaps of faith of various severity on the roads daily -- failure

We're asking a lot from this kind of software (for good reasons), but humans commit hundreds of leaps of faith of various severity on the roads daily -- failure to yield, failure to maintain a safe following distance, assuming other drivers immediately adjacent to you, like in lanes that are significantly slower than yours, will keep driving safely and carefully. Urban, peak-hour traffic on most US freeways is an exercise in collective insanity, riding people's bumpers at 55+ mph (and often significantly higher), leaving little room to stop for incidents [1][2][3][4] or debris. But only a small subset of these situations result in significant accidents, because unimpaired humans, largely, have some intuition for self-preservation. On the other hand, we're expecting an algorithm coded by humans to perform better than a complicated bioelectric system we barely understand. Waymo's self-driving program has opted to thoroughly understanding its environment, which is why their cars drive in a manner that bears no resemblance to how humans actually drive. We as a society have to eventually reconcile the implications of the disconnect. [1] Unsafe lane change in traffic with different lane speeds: https://gfycat.com/CleanGleefulArawana https://gfycat.com/CleanGleefulArawana [2] Tailgating causes crash, swerve, multi-vehicle accident: https://www.youtube.com/watch?v=j0rj2sZ1KA4 https://www.youtube.com/watch?v=j0rj2sZ1KA4 [3] Inattention to incident causes further accidents: https://www.youtube.com/watch?v=hZL6OKwQGew https://www.youtube.com/watch?v=hZL6OKwQGew [4] Inattention in slowing traffic causes accident: https://www.youtube.com/watch?v=Ff7wbSwTuEk https://www.youtube.com/watch?v=Ff7wbSwTuEk

ghostbrainalpha 8y ago
Are you saying that even if AI can't react as well as humans, the roads would potentially be safer with more AI drivers because of the cumulative effect of all the little safety rules they follow that human drivers do not?
- bsder 8y ago
  Yes. Computers won't get distracted. Computers won't accidentally mix up medications and get foggy. Computers won't get tired. Computers won't drive drunk. I can create a self-driving car better than 50% of Southern Californians right now: "<beep> High humidity detected. I'm sorry, I can't let you drive today, Dave. <beep>" People suck at driving in new places--take a plane flight to a new city, rent a car, and have a passenger record how many illegal things you do--you probably won't make it out of the airport before the first infraction. People are good at driving in the familiar because they memorize it. A new stop sign at a previously uncontrolled intersection causes chaos for a while. Computers will also memorize the local environment at some point. Remember how bad Google Maps was when they started? This will be the same.
  - Normal_gaussian 8y ago
    It is a shame that sales pressures are stopping us forcing "AI" cars from being branded in an obvious way (bright orange and pale blue stripes?) - this would allow human drivers to treat the vehicle as a non-human, removing a lot of the dangers it would cause to lawbreakers who follow too closely. Of course `AI hybrid` vehicles would still behave unpredictably unless they had some way to signal whether the human or the `AI` was in control of the vehicle.
  - dbt00 8y ago
    You're comparing what humans do to what software could possibly do, which is a category error. Software doesn't recognize color coded warning signs. Software doesn't trust it's stationary object recognition at high speeds. Software doesn't distinguish between high speeds on limited access highways and high speeds on pedestrian accessible roads. Software has a higher crash and fatality rate per mile driven than humans, right now, despite driving in statistically safer cars. Yes there are good reasons to be hopeful software can do better at those things eventually, but it's obvious now that it's not ready (or Tesla wouldn't have to trash-talk a dead man for not maintaining high enough torque on the steering wheel to inform the car he was steering, because he wouldn't be dead and they wouldn't have to require passive hands on the wheel).
    - slg 8y ago
      >Software has a higher crash and fatality rate per mile driven than humans, right now, despite driving in statistically safer cars. Do you have a source for that claim because everything I have seen has been inconclusive so far?
      - ben_w 8y ago
        From https://en.m.wikipedia.org/wiki/List_of_autonomous_car_fatalities https://en.m.wikipedia.org/wiki/List_of_autonomous_car_fatal... 3rd Tesla autopilot fatality happened at 210,000,000 km, giving a fatality rate of 9.2—14.3 per billion km of autopilot depending on if you take the average just before or just after the third death. From https://en.m.wikipedia.org/wiki/List_of_countries_by_traffic-related_death_rate https://en.m.wikipedia.org/wiki/List_of_countries_by_traffic... USA has an average of 7.1 fatalities per billion vehicle-km. I’m assuming most of the Tesla kilometres were in the USA. I don’t know if that is a reasonable assumption.
- niftich 8y ago
  My prediction is that if self-driving cars commingle with human-driven cars on the same roadway, and are common enough to show up during your commute, road safety will improve slightly in aggregate, but the immediate environs of traffic surrounding a self-driving car will be less safe. There will be drivers annoyed at the car whose behavior approximates a tentative, wary driver: strictly adhering to the speed limit, leaving ample space in front, avoiding lane changes, braking early, and occasionally pumping the brakes for no discernible reason. These self-driving cars will create a traffic bubble around them, making it less safe for everyone else, including the aggressive drivers who will cut it off or overtake it at a high rate of speed, and the average motorists who are just trying to align their driving to the emergent conditions of traffic, and are caught between conflicting pressures and unsafe adjacency to different speeds.
  - skybrian 8y ago
    It's unclear to me why human drivers should be considered unable to adapt to more "tentative, wary" drivers on the roads. After all, humans vary quite a bit in how they drive. There are plenty of cautious drivers already out there.
    - tempestn 8y ago
      They do adapt; it's just slightly less safe than being among a set of vehicles behaving more similarly. Same thing with a particularly tentative human driver. (Or a particularly aggressive one, of course.)
  - dsfyu404ed 8y ago
    Humans are pretty good drivers if you don't count the ones who are drunk, looking at a phone or otherwise impaired. If you a bunch of AI cars into the mix safety will decrease unless you toss them in in a way that results in them displacing the more risky drivers.
jakelarkin 8y ago
human drivers routinely do things that are not justifiable by vehicle physics (e.g. stopping distances) because they have a comparatively sophisticated and unconscious understanding of our physical world, how changes may develop and how other human drivers or pedestrians might react. self-driving is a much harder and unlikely problem than the perpetual hype-cycle is willing to admit.
- std_throwaway 8y ago
  Mostly because they use the heuristic of "see, nothing happened last time" and do it again but with a little less safety margin.
  - nradov 8y ago
    It's partly that, but also a matter of human drivers trusting each other to some extent. In congested areas if you leave the recommended safe stopping distance then another driver will always cut in front of you. So people adapt by closing up the gaps and hoping the drive in front doesn't do anything stupid.
    - viraptor 8y ago
      I find this one interesting. I rarely drive in the city, so when I do the distance in queues seems pretty crazy. But at some point I stopped caring that people cut in in front. The active cruise control keeps my distance now (apart from when we're stopped) and often people will use that gap. But... so what? Let them and keep your distance again. It really improves the experience.
      - std_throwaway 8y ago
        If you try to account for it, it's not much time at all. And you're improving traffic flow by providing a means to change lanes (a bit more) safely. Most people "cutting in front" are actually just in search for a spot.
- dsfyu404ed 8y ago
faitswulff 8y ago
While we're on the topic of Waymo, does anyone know whether they use driving data from Google Maps Navigation? It'd be an interesting upper hand, if so.
- kart23 8y ago
  Yes, they definitely do. I think there was a TED talk on google self driving a couple years ago which outlined how they used maps.
taneq 8y ago
> humans commit hundreds of leaps of faith of various severity on the roads daily And this is necessary (to some degree, probably not as far as we take it though) in order to drive a car in a practical manner. Instead of thinking about it as "safe" vs. "unsafe", it's more helpful to think about driving as trying to limit your risk to whatever you consider an acceptable level, based on your model of the world. From least to most risky, some potential models are: * Assume nothing beyond the basic laws of physics * Assume nothing outside your visual range is breaking any road rules * Assume the road outside your visual range is as you last saw it (no blockages / hazards etc.) * Assume other vehicles around you will mostly follow the road rules (basically what Waymo does, afaik) * Assume other vehicles around you are alert and have a sense of self-preservation (the normal human driving behaviour you describe) * Bomb through traffic YOLO style The other issue, especially for emergency braking, is that whether or not something is a collision hazard or not is dependent on velocity, not just speed. Until emergency braking systems can take control of steering as well as braking there will always be false positives and negatives no matter how good we make the system's perception.

ghostbrainalpha 8y ago

Are you saying that even if AI can't react as well as humans, the roads would potentially be safer with more AI drivers because of the cumulative effect of all the little safety rules they follow that human drivers do not?

bsder 8y ago
Yes. Computers won't get distracted. Computers won't accidentally mix up medications and get foggy. Computers won't get tired. Computers won't drive drunk. I can create a self-driving car better than 50% of Southern Californians right now: "<beep> High humidity detected. I'm sorry, I can't let you drive today, Dave. <beep>" People suck at driving in new places--take a plane flight to a new city, rent a car, and have a passenger record how many illegal things you do--you probably won't make it out of the airport before the first infraction. People are good at driving in the familiar because they memorize it. A new stop sign at a previously uncontrolled intersection causes chaos for a while. Computers will also memorize the local environment at some point. Remember how bad Google Maps was when they started? This will be the same.
- Normal_gaussian 8y ago
  It is a shame that sales pressures are stopping us forcing "AI" cars from being branded in an obvious way (bright orange and pale blue stripes?) - this would allow human drivers to treat the vehicle as a non-human, removing a lot of the dangers it would cause to lawbreakers who follow too closely. Of course `AI hybrid` vehicles would still behave unpredictably unless they had some way to signal whether the human or the `AI` was in control of the vehicle.
- dbt00 8y ago
  You're comparing what humans do to what software could possibly do, which is a category error. Software doesn't recognize color coded warning signs. Software doesn't trust it's stationary object recognition at high speeds. Software doesn't distinguish between high speeds on limited access highways and high speeds on pedestrian accessible roads. Software has a higher crash and fatality rate per mile driven than humans, right now, despite driving in statistically safer cars. Yes there are good reasons to be hopeful software can do better at those things eventually, but it's obvious now that it's not ready (or Tesla wouldn't have to trash-talk a dead man for not maintaining high enough torque on the steering wheel to inform the car he was steering, because he wouldn't be dead and they wouldn't have to require passive hands on the wheel).
  - slg 8y ago
    >Software has a higher crash and fatality rate per mile driven than humans, right now, despite driving in statistically safer cars. Do you have a source for that claim because everything I have seen has been inconclusive so far?
    - ben_w 8y ago
      From https://en.m.wikipedia.org/wiki/List_of_autonomous_car_fatalities https://en.m.wikipedia.org/wiki/List_of_autonomous_car_fatal... 3rd Tesla autopilot fatality happened at 210,000,000 km, giving a fatality rate of 9.2—14.3 per billion km of autopilot depending on if you take the average just before or just after the third death. From https://en.m.wikipedia.org/wiki/List_of_countries_by_traffic-related_death_rate https://en.m.wikipedia.org/wiki/List_of_countries_by_traffic... USA has an average of 7.1 fatalities per billion vehicle-km. I’m assuming most of the Tesla kilometres were in the USA. I don’t know if that is a reasonable assumption.
niftich 8y ago
My prediction is that if self-driving cars commingle with human-driven cars on the same roadway, and are common enough to show up during your commute, road safety will improve slightly in aggregate, but the immediate environs of traffic surrounding a self-driving car will be less safe. There will be drivers annoyed at the car whose behavior approximates a tentative, wary driver: strictly adhering to the speed limit, leaving ample space in front, avoiding lane changes, braking early, and occasionally pumping the brakes for no discernible reason. These self-driving cars will create a traffic bubble around them, making it less safe for everyone else, including the aggressive drivers who will cut it off or overtake it at a high rate of speed, and the average motorists who are just trying to align their driving to the emergent conditions of traffic, and are caught between conflicting pressures and unsafe adjacency to different speeds.
- skybrian 8y ago
  It's unclear to me why human drivers should be considered unable to adapt to more "tentative, wary" drivers on the roads. After all, humans vary quite a bit in how they drive. There are plenty of cautious drivers already out there.
  - tempestn 8y ago
    They do adapt; it's just slightly less safe than being among a set of vehicles behaving more similarly. Same thing with a particularly tentative human driver. (Or a particularly aggressive one, of course.)
- dsfyu404ed 8y ago
  Humans are pretty good drivers if you don't count the ones who are drunk, looking at a phone or otherwise impaired. If you a bunch of AI cars into the mix safety will decrease unless you toss them in in a way that results in them displacing the more risky drivers.

jakelarkin 8y ago

human drivers routinely do things that are not justifiable by vehicle physics (e.g. stopping distances) because they have a comparatively sophisticated and unconscious understanding of our physical world, how changes may develop and how other human drivers or pedestrians might react. self-driving is a much harder and unlikely problem than the perpetual hype-cycle is willing to admit.

std_throwaway 8y ago
Mostly because they use the heuristic of "see, nothing happened last time" and do it again but with a little less safety margin.
- nradov 8y ago
  It's partly that, but also a matter of human drivers trusting each other to some extent. In congested areas if you leave the recommended safe stopping distance then another driver will always cut in front of you. So people adapt by closing up the gaps and hoping the drive in front doesn't do anything stupid.
  - viraptor 8y ago
    I find this one interesting. I rarely drive in the city, so when I do the distance in queues seems pretty crazy. But at some point I stopped caring that people cut in in front. The active cruise control keeps my distance now (apart from when we're stopped) and often people will use that gap. But... so what? Let them and keep your distance again. It really improves the experience.
    - std_throwaway 8y ago
      If you try to account for it, it's not much time at all. And you're improving traffic flow by providing a means to change lanes (a bit more) safely. Most people "cutting in front" are actually just in search for a spot.
dsfyu404ed 8y ago

faitswulff 8y ago

While we're on the topic of Waymo, does anyone know whether they use driving data from Google Maps Navigation? It'd be an interesting upper hand, if so.

kart23 8y ago
Yes, they definitely do. I think there was a TED talk on google self driving a couple years ago which outlined how they used maps.

taneq 8y ago

> humans commit hundreds of leaps of faith of various severity on the roads daily And this is necessary (to some degree, probably not as far as we take it though) in order to drive a car in a practical manner. Instead of thinking about it as "safe" vs. "unsafe", it's more helpful to think about driving as trying to limit your risk to whatever you consider an acceptable level, based on your model of the world. From least to most risky, some potential models are: * Assume nothing beyond the basic laws of physics * Assume nothing outside your visual range is breaking any road rules * Assume the road outside your visual range is as you last saw it (no blockages / hazards etc.) * Assume other vehicles around you will mostly follow the road rules (basically what Waymo does, afaik) * Assume other vehicles around you are alert and have a sense of self-preservation (the normal human driving behaviour you describe) * Bomb through traffic YOLO style The other issue, especially for emergency braking, is that whether or not something is a collision hazard or not is dependent on velocity, not just speed. Until emergency braking systems can take control of steering as well as braking there will always be false positives and negatives no matter how good we make the system's perception.