8 ms·

Throwing random percentages is silly. In reality, these vehicles have only been tested within a very tight scope, in near-controlled conditions in Arizona, Cali

Throwing random percentages is silly. In reality, these vehicles have only been tested within a very tight scope, in near-controlled conditions in Arizona, California, etc. with very specific conditions for their operations. I would consider it 99% complete when I can pull up a map, point to any stretch of drivable road in the United States and ask it to autonomously operate there. Specifically, there's an especially tricky road in I-35N in Texas where the lane markings come ago, yellow shoulder markings _merge_ into barriers, and the road condition is so bad that the steering rack will _turn_ by itself(!). We're not even close to calling this thing autonomous. If and when it gets to that point, I would consider it "99%" complete. In reality though, I really see this tech being viable in continued controlled conditions. Maybe there will be a point when certain lanes will become dedicated "autonomous lanes", where they're completely isolated from the rest of traffic, come with special markings and sensor suites to assist driveler-less cars operate efficiently. As long as the chaotic human element is ever present, regardless of how well they model these systems, it will fail to cope with the massive amount of discontinuous information humans inject into a situation (swerving into a lane, road rage, cargo suddenly coming loose from a truck, etc.) Oh, and have we tested these things during winter? :p

ajross 5y ago
> Specifically, there's an especially tricky road in I-35N in Texas Seems like you could just get some data on that before declaring that "we're not even close". How do shipping Teslas do? FWIW: my impression is that the things people think are hard aren't the problems that are actually hard. People here and elsewhere on the internet have spent years screaming about lidar vs. radar vs. vision. And... it turns out vision basically won. Something like half the Tesla fleet in ths US are vision only in the US now, and... the cars see stuff just fine. We're not having detection failures. It works. If you watch all the FSD beta video being spread around youtube, much of it by drivers specifically looking for edge cases like this, most of the remaining problems are in pathing and decisionmaking, not detection. The cars see a busy intersection and then get paralyzed (there was an amusing clip from one guy of a car trying to make a left turn, giving up, and repathing a right turn that took it back in a loop only to fail at the same left turn repeatedly), or creep too slowly and annoy other drivers. Or they choose the wrong lane, or misread a multiple traffic light environment, or misread the need for detection (the one really dangerous video I remember had the car deciding to take a left turn across a broad street with a complicated blind corner instead of creeping out farther). Those are bugs to fix, for sure. But they're not the bugs we thought we had to fix. Those bugs... got fixed. So you can look at this as a pessimist and say "we'll never get there", or you can judge from previous experience that the hard problems won't turn out to be that hard in the end. Personally, having been watching the progress in this space, my guess is that Tesla and Waymo (and maybe Mobileye -- no one else is close) get this basically fixed within a year or two. At which point the debate will shift from "we'll never get there" to "we'll never be able to regulate this appropriately" or somesuch.
- zamadatix 5y ago
  > Something like half the Tesla fleet in ths US are vision only in the US now, and... the cars see stuff just fine. We're not having detection failures. It works. You and I have extremely different experiences with Teslas. About the only place I could conceive arguing it works is highways and even then I wouldn't trust riding one down the highway without a steering wheel. Hell, my coworker can't even call his out of the driveway because it has been thinking his mailbox is a car for the last 6 months. I think we'll get there and I don't think it'll matter if it's with LIDAR or pure vision but we're certainly not close to being able to remove the steering wheel (regulation aside).
  - ajross 5y ago
    Mine drove me to Yellowstone and back with like two disengagements which were my paranoia about other traffic. But yes: the example was an interstate in Texas. And I happen to know it actually works quite well on interstates. So a very reasonable experiment about whether or not automation "will never get there" on edge cases like the referenced interstate is to take a commonly deployed, already available automation technology there and test it. But also recognize that shipping autopilot is now about a year old. All the FSD work hasn't made it to released cars yet. It's very much evolved, but visible only on youtube right now.
  - iknowstuff 5y ago
    Summon uses the old, pre surround video NN. The FSD stack is a whole different beast.
- coryrc 5y ago
  We're not having detection failures. Then what do you call them hitting stationary things regularly?
  - iknowstuff 5y ago
    Radar
  - ajross 5y ago
skybrian 5y ago
Yes, it’s kind of a silly headline. A percentage compares two numbers, in the numerator and a denominator. If you don’t know what’s being counted or measured, it’s not a real statistic. However, people do uses percentages metaphorically and we should try not to be so distracted by silly headlines.
- ghaff 5y ago
  That's exactly what this is. It's the classic "The first 90% is 90% of the work. The last 10% is the other 90%." Or whatever the exact quote is. It's not about the number. It's the fact that it's a lot of work to get close. It's as much or more work to get over the finish line.
lisper 5y ago
What could "99% complete" even possibly mean? That it goes 99 miles/days/hours/minutes before hitting a tree?
- icedchai 5y ago
  I look at it this way: I haven't had a car accident in over 25 years of driving. Now if there was a 1% chance of having a car accident every time drove, I'd be having multiple accidents a year. This seems bad.
  - TchoBeer 5y ago
    except 99% doesn't necessarily mean "every time you drive"; it's obvious to me that if you drive for 100 miles you are more likely to get into an accident than 10 miles. It's probably closer to "in 99% of situations".
    - icedchai 5y ago
      The reality is that long term trips may, in general, be safer since you're on highways. Some statistics show that short term trips are more likely to have accidents. See https://wtop.com/dc-transit/2020/09/study-25-percent-of-car-accidents-happen-in-first-3-minutes-of-driving/ https://wtop.com/dc-transit/2020/09/study-25-percent-of-car-...
      - TchoBeer 5y ago
        It doesn't necessarily have to scale linearly like that, but I assume 10 miles on the highway is safer than 100 miles on the highway.
        dheera 5y ago
        Humans are particularly bad at highway driving long distances because they get highway hypnosis or fall alseep. On local roads on the other hand humans tend to do a good job reasoning with situations.
sgtnoodle 5y ago
That stretch of road you describe as difficult is actually not difficult at all for Waymo's current technology. Their navigation does not depend on vision.
- riffraff 5y ago
  how does it know where to be in the lane if it doesn't use lane markings? "stick to the right as far as possible" is not a reliable approach when the emergency lane may or may not be there.
  - TchoBeer 5y ago
    not a gotcha question, I'm actually curious: how does a human driver know where to be in the lane?
    - frosted-flakes 5y ago
      Context. The faint wear marks that tires make on the road over years, the seam between lanes, the car in front of them, the distance away from the guardrail or ditch, or there are no marked lanes at all and you just have to share the road with oncoming traffic. Furthermore, it's not uncommon for three lane roads to turn into two lanes during heavy snow, and in those case, the lanes are wherever everyone decided they were, collectively.
    - riffraff 5y ago
      I think this is a very good question! The case I was thinking of is a highway I was in last week, where temporary work has one of the directions going through the other direction, so the 2+emergency lanes in one direction become 2 lanes without emergency in one direction and one lane in the opposite one. In this case, there are temporary lane markings on the ground indicating you should not follow the old ones, but rather align yourself further to the right then you would normally do. OTOH, I am familiar with the situation in Rome where often the lane markings are deleted and a road may be 2-3-4 lanes depending on how people queue up, in which case people would generally rely on social/experience cues, which I'm unable to formalize.
bastardoperator 5y ago
You should come drive some of the mountain roads in CA. I wouldn't consider roads in TX any trickier than roads elsewhere.
bhawks 5y ago
> Specifically, there's an especially tricky road in I-35N in Texas Why are we ok with streets in such slapdash condition in the first place? Yes I think self driving cars need to handle it, but I also think we aren't handling it. Self driving cars have the potential to greatly reduce deaths due to accidents and improve accessibility for often ignored segments of our population. It is sad to see it so close, but held back by reasons like this.
- x0x0 5y ago
  There was always where this was going to end -- demands that we spend (from the public) hundreds of billions to upgrade roads to make self-driving tech "work". Also, > and right now, no driverless car from any company can gracefully handle rain, sleet, or snow Good thing the entire US has the weather patterns of the bay area, and never experiences rain, sleet, or snow!
- MichaelGroves 5y ago
  Lots of people aren't okay with road conditions. But lots more people aren't okay with a myraid of other pet peeves and legitimate grievances they have with just about every single aspect of our society. The process of prioritizing which matters to address is called "politics", a process so notorious I assume I don't need to explain this further.
- chiph 5y ago
  IH-35 has been under continuous construction since .. the 90's? Hindsight being what it is .. they should have built a new 8-lane highway a few miles to the West rather than attempting to widen it multiple times (with all the bridge replacements needed) through towns like Temple and Waco. But as the Texas Central Railroad has found, you can't just eminent-domain land in Texas for large infrastructure projects.
  - ghaff 5y ago
    I live about an hour west of Boston. There's a sort of half-ring six-lane highway called I-495. It mostly handles the traffic load fairly well. But it's a source of sometimes genuine surprise to me that a highway of this capacity for the area was built in the late 1950s given that must have seemed almost outrageously overbuilt for at least most of its route at the time.
samstave 5y ago
I almost feel that relatively short range (meaning they can make the hops between charging stations) self-flying passenger drones/planes would be better than cars. Leet air-traffic control systems with decades of anti collision experience interact with and track all flights and inform all flying systems of the telemtry data for all slights so they have spatial awareness that way. Set flight paths that are low, but avoid densly populated areas/neighborhoods/infrastructure etc. Create small emergency landing areas all over... The only ground based vehicles I care about being 99% auto would be long-haul trucking. With a station to pickup a local last-mile-human-driver for actual drop-offf etc.
qaq 5y ago
Lex interviewed Dmitri Dolgov CTO Waymo https://www.youtube.com/watch?v=P6prRXkI5HM https://www.youtube.com/watch?v=P6prRXkI5HM I think you are conflating operating a public service within a very tight scope and "only been tested within a very tight scope"
dathinab 5y ago
I e.g. think that many self driving car systems are good enough to drive on German highways (and kraftfahrstraßen ~ slower smaller highways). But only IFF there is no external accident and no construction site. If both would be handles truckers could sleep/nap while driving on the highways, which could have interesting effects tbh. Handling construction sites could be made feasible. But I have no idea how to handle accidents happening around/in-front of the truck in a good way. Similar I would be worried about improvised marking of fresh accident sites before emergency responders arrive...
throwaway09223 5y ago
I have elderly relatives who won't drive at night, or on highways. I have friends who won't drive in various degrees of inclement weather - and I know a LOT of Californians who can't drive in the snow. Human skill is extremely variable. A car that can drive to any road under any condition will be vastly superior to the average driver. Reducing such a complex system to a single percentage may be silly, but the idea that a car might have partial coverage under certain conditions is quite reasonable and is reflective of how real human drivers work as well.
- Natsu 5y ago
  I think the GP post also points out that some roads are, frankly, terrible. I've had more than a few times where I wasn't clear if the cones were set in such a way that I could continue down the road or not and I've been wrong at least once (though the cop was very understanding after I explained it). Some randomly placed cones are enough to confuse humans in many circumstances, as well. I doubt we'll ever have an all-encompassing solution for that, either. Even for things like autonomous-only lane, well it's not like everyone obeys the HOV lanes currently... There probably isn't a perfect solution, especially when I've seen plenty of ambiguous markings.
  - Marsymars 5y ago
    Just yesterday I ran into some confusing cones and signage where I made the right merge onto the exit, but the car behind me made the wrong call and drove a kilometre or so down a newly built, unopened highway in parallel to me on my left until they got to some concrete barriers and realized their error.
- xyzzy21 5y ago
  And there's zero possible way self-driving cars are going to handle country roads that are sometime dirt in the snow during a blizzard. Humans absolutely can do that. But the very architectural basis via ML that's being used never will. Different architecture? Maybe. Maybe in 50-100 years.
  - 5y ago
bryanlarsen 5y ago
That awful stretch of I95 can be special cased. It's a great example of what a computer can be better at than humans who each have to individually figure it out. An unprotected left turn is probably a harder problem. They'll be expected to do it aggressively like humans, and also expected to do it safely. Those are incompatible directives.
- ghaff 5y ago
  The (IMO) "right" way to do an unprotected left is also somewhat situational. If there isn't a lot of traffic generally on a country road but a somewhat bunched up group of vehicles is coming, I'll be patient until the bunch has cleared (unless someone flashes their lights at me). If on the other hand, I'm in a busier urban area and I can see there aren't a lot of openings, I'll be more aggressive including at traffic light changes. In general, my expectation--which may be completely wrong--is that we'll see autonomous driving on sections of highways in good weather long before we have door to door almost everywhere. Which is useful by itself for long highway drives.
kurthr 5y ago
I think responding to the human element is huge for safe driving. You would not want to safely drive the same way in LA as Boston, or Seattle. Other drivers make very different assumptions on your response to their (and others) actions, and that can create danger irrespective of navigation.
kenhwang 5y ago
Google Maps navigation can't even reliably call out which lane to use for turning in major metro areas, and that's kinda the basic best case scenario: clear images/footage, unlimited compute time, static road markers, common use case. I'm not sure how they can do better with far more stringent resources and requirements.
cmroanirgo 5y ago
This has always had me wondering about the viability of self driving: what's it going to be like in different countries? Not only are there different signs, different line marking & colours, & different widths. Cars are different: not all models are sold equally throughout the world. People are different: through their clothing, height and build. But the really big difference is that not everyone drives on the RHS... The article lists left turns as a problem, whereas on a LHS road system, right hand turns will be the problem. In NZ (a LHS system), I've heard that turning right across traffic has priority over oncoming traffic. In Melbourne, VIC Australia (also LHS), right turns are made from the left most lane because of trams lines. I'm sure there are loads of other issues specific to other geographies. To me, this never ending self driving experiment screams out that the wrong solution is being pursued. (That doesn't imply that I know what they should be using as a solution)
- mdoms 5y ago
  > In NZ (a LHS system), I've heard that turning right across traffic has priority over oncoming traffic. This is incorrect and would be utterly chaotic. You may be thinking of an outdated rule in NZ where right-turning traffic takes precedence over left-turning coming in the opposite direction to the same side road. This was the case for a long time but was reversed[0] in 2012, overnight, almost without a hitch. [0] https://www.nzta.govt.nz/driver-licences/getting-a-licence/road-code/give-way-rule-changes-2012/ https://www.nzta.govt.nz/driver-licences/getting-a-licence/r...
  - 8note 5y ago
    It sounds like a pretty good idea to me, and will ensure low speed, low traffic roads
jandrewrogers 5y ago
My current work involves ground-truthing sensor and classifier hits from various automotive OEMs. Take, for example, reading old-fashioned speed limit signs. In principle, doing this correctly and reliably in context is a relatively simple machine learning problem, particularly when restricted to a single country. I have yet to work with an automotive OEM that doesn't consistently mis-classify some speed limit signs in some common cases that are completely unambiguous. It leads one to wonder about the quality of classifier design and testing such that these end up in production vehicles. The cases that cause a classifier to fail are different across automotive OEMs too, it isn't intrinsic; other automotive OEMs will handle that specific case just fine. On the other hand, when it works it often works surprisingly well. The good/bad news is that most of the problems I see are ultimately caused by poor model design and testing. These are all surmountable with better quality AI engineering. There is more AI to self-driving cars than the classifiers that pull features out of their environmental sensors. However, the driving AIs are making decisions based on the output of those classifiers -- garbage in, garbage out. These are the kinds of situations that will produce relentless incremental improvements over time, and there is still a lot of low-hanging fruit to improve on.

ajross 5y ago

> Specifically, there's an especially tricky road in I-35N in Texas Seems like you could just get some data on that before declaring that "we're not even close". How do shipping Teslas do? FWIW: my impression is that the things people think are hard aren't the problems that are actually hard. People here and elsewhere on the internet have spent years screaming about lidar vs. radar vs. vision. And... it turns out vision basically won. Something like half the Tesla fleet in ths US are vision only in the US now, and... the cars see stuff just fine. We're not having detection failures. It works. If you watch all the FSD beta video being spread around youtube, much of it by drivers specifically looking for edge cases like this, most of the remaining problems are in pathing and decisionmaking, not detection. The cars see a busy intersection and then get paralyzed (there was an amusing clip from one guy of a car trying to make a left turn, giving up, and repathing a right turn that took it back in a loop only to fail at the same left turn repeatedly), or creep too slowly and annoy other drivers. Or they choose the wrong lane, or misread a multiple traffic light environment, or misread the need for detection (the one really dangerous video I remember had the car deciding to take a left turn across a broad street with a complicated blind corner instead of creeping out farther). Those are bugs to fix, for sure. But they're not the bugs we thought we had to fix. Those bugs... got fixed. So you can look at this as a pessimist and say "we'll never get there", or you can judge from previous experience that the hard problems won't turn out to be that hard in the end. Personally, having been watching the progress in this space, my guess is that Tesla and Waymo (and maybe Mobileye -- no one else is close) get this basically fixed within a year or two. At which point the debate will shift from "we'll never get there" to "we'll never be able to regulate this appropriately" or somesuch.

zamadatix 5y ago
> Something like half the Tesla fleet in ths US are vision only in the US now, and... the cars see stuff just fine. We're not having detection failures. It works. You and I have extremely different experiences with Teslas. About the only place I could conceive arguing it works is highways and even then I wouldn't trust riding one down the highway without a steering wheel. Hell, my coworker can't even call his out of the driveway because it has been thinking his mailbox is a car for the last 6 months. I think we'll get there and I don't think it'll matter if it's with LIDAR or pure vision but we're certainly not close to being able to remove the steering wheel (regulation aside).
- ajross 5y ago
  Mine drove me to Yellowstone and back with like two disengagements which were my paranoia about other traffic. But yes: the example was an interstate in Texas. And I happen to know it actually works quite well on interstates. So a very reasonable experiment about whether or not automation "will never get there" on edge cases like the referenced interstate is to take a commonly deployed, already available automation technology there and test it. But also recognize that shipping autopilot is now about a year old. All the FSD work hasn't made it to released cars yet. It's very much evolved, but visible only on youtube right now.
- iknowstuff 5y ago
  Summon uses the old, pre surround video NN. The FSD stack is a whole different beast.
coryrc 5y ago
We're not having detection failures. Then what do you call them hitting stationary things regularly?
- iknowstuff 5y ago
  Radar
- ajross 5y ago

skybrian 5y ago

Yes, it’s kind of a silly headline. A percentage compares two numbers, in the numerator and a denominator. If you don’t know what’s being counted or measured, it’s not a real statistic. However, people do uses percentages metaphorically and we should try not to be so distracted by silly headlines.

ghaff 5y ago
That's exactly what this is. It's the classic "The first 90% is 90% of the work. The last 10% is the other 90%." Or whatever the exact quote is. It's not about the number. It's the fact that it's a lot of work to get close. It's as much or more work to get over the finish line.

lisper 5y ago

What could "99% complete" even possibly mean? That it goes 99 miles/days/hours/minutes before hitting a tree?

icedchai 5y ago
I look at it this way: I haven't had a car accident in over 25 years of driving. Now if there was a 1% chance of having a car accident every time drove, I'd be having multiple accidents a year. This seems bad.
- TchoBeer 5y ago
  except 99% doesn't necessarily mean "every time you drive"; it's obvious to me that if you drive for 100 miles you are more likely to get into an accident than 10 miles. It's probably closer to "in 99% of situations".
  - icedchai 5y ago
    The reality is that long term trips may, in general, be safer since you're on highways. Some statistics show that short term trips are more likely to have accidents. See https://wtop.com/dc-transit/2020/09/study-25-percent-of-car-accidents-happen-in-first-3-minutes-of-driving/ https://wtop.com/dc-transit/2020/09/study-25-percent-of-car-...
    - TchoBeer 5y ago
      It doesn't necessarily have to scale linearly like that, but I assume 10 miles on the highway is safer than 100 miles on the highway.
      - dheera 5y ago
        Humans are particularly bad at highway driving long distances because they get highway hypnosis or fall alseep. On local roads on the other hand humans tend to do a good job reasoning with situations.

sgtnoodle 5y ago

That stretch of road you describe as difficult is actually not difficult at all for Waymo's current technology. Their navigation does not depend on vision.

riffraff 5y ago
how does it know where to be in the lane if it doesn't use lane markings? "stick to the right as far as possible" is not a reliable approach when the emergency lane may or may not be there.
- TchoBeer 5y ago
  not a gotcha question, I'm actually curious: how does a human driver know where to be in the lane?
  - frosted-flakes 5y ago
    Context. The faint wear marks that tires make on the road over years, the seam between lanes, the car in front of them, the distance away from the guardrail or ditch, or there are no marked lanes at all and you just have to share the road with oncoming traffic. Furthermore, it's not uncommon for three lane roads to turn into two lanes during heavy snow, and in those case, the lanes are wherever everyone decided they were, collectively.
  - riffraff 5y ago
    I think this is a very good question! The case I was thinking of is a highway I was in last week, where temporary work has one of the directions going through the other direction, so the 2+emergency lanes in one direction become 2 lanes without emergency in one direction and one lane in the opposite one. In this case, there are temporary lane markings on the ground indicating you should not follow the old ones, but rather align yourself further to the right then you would normally do. OTOH, I am familiar with the situation in Rome where often the lane markings are deleted and a road may be 2-3-4 lanes depending on how people queue up, in which case people would generally rely on social/experience cues, which I'm unable to formalize.

bastardoperator 5y ago

You should come drive some of the mountain roads in CA. I wouldn't consider roads in TX any trickier than roads elsewhere.

bhawks 5y ago

> Specifically, there's an especially tricky road in I-35N in Texas Why are we ok with streets in such slapdash condition in the first place? Yes I think self driving cars need to handle it, but I also think we aren't handling it. Self driving cars have the potential to greatly reduce deaths due to accidents and improve accessibility for often ignored segments of our population. It is sad to see it so close, but held back by reasons like this.

x0x0 5y ago
There was always where this was going to end -- demands that we spend (from the public) hundreds of billions to upgrade roads to make self-driving tech "work". Also, > and right now, no driverless car from any company can gracefully handle rain, sleet, or snow Good thing the entire US has the weather patterns of the bay area, and never experiences rain, sleet, or snow!
MichaelGroves 5y ago
Lots of people aren't okay with road conditions. But lots more people aren't okay with a myraid of other pet peeves and legitimate grievances they have with just about every single aspect of our society. The process of prioritizing which matters to address is called "politics", a process so notorious I assume I don't need to explain this further.
chiph 5y ago
IH-35 has been under continuous construction since .. the 90's? Hindsight being what it is .. they should have built a new 8-lane highway a few miles to the West rather than attempting to widen it multiple times (with all the bridge replacements needed) through towns like Temple and Waco. But as the Texas Central Railroad has found, you can't just eminent-domain land in Texas for large infrastructure projects.
- ghaff 5y ago
  I live about an hour west of Boston. There's a sort of half-ring six-lane highway called I-495. It mostly handles the traffic load fairly well. But it's a source of sometimes genuine surprise to me that a highway of this capacity for the area was built in the late 1950s given that must have seemed almost outrageously overbuilt for at least most of its route at the time.

samstave 5y ago

I almost feel that relatively short range (meaning they can make the hops between charging stations) self-flying passenger drones/planes would be better than cars. Leet air-traffic control systems with decades of anti collision experience interact with and track all flights and inform all flying systems of the telemtry data for all slights so they have spatial awareness that way. Set flight paths that are low, but avoid densly populated areas/neighborhoods/infrastructure etc. Create small emergency landing areas all over... The only ground based vehicles I care about being 99% auto would be long-haul trucking. With a station to pickup a local last-mile-human-driver for actual drop-offf etc.

qaq 5y ago

Lex interviewed Dmitri Dolgov CTO Waymo https://www.youtube.com/watch?v=P6prRXkI5HM https://www.youtube.com/watch?v=P6prRXkI5HM I think you are conflating operating a public service within a very tight scope and "only been tested within a very tight scope"

dathinab 5y ago

I e.g. think that many self driving car systems are good enough to drive on German highways (and kraftfahrstraßen ~ slower smaller highways). But only IFF there is no external accident and no construction site. If both would be handles truckers could sleep/nap while driving on the highways, which could have interesting effects tbh. Handling construction sites could be made feasible. But I have no idea how to handle accidents happening around/in-front of the truck in a good way. Similar I would be worried about improvised marking of fresh accident sites before emergency responders arrive...

throwaway09223 5y ago

I have elderly relatives who won't drive at night, or on highways. I have friends who won't drive in various degrees of inclement weather - and I know a LOT of Californians who can't drive in the snow. Human skill is extremely variable. A car that can drive to any road under any condition will be vastly superior to the average driver. Reducing such a complex system to a single percentage may be silly, but the idea that a car might have partial coverage under certain conditions is quite reasonable and is reflective of how real human drivers work as well.

Natsu 5y ago
I think the GP post also points out that some roads are, frankly, terrible. I've had more than a few times where I wasn't clear if the cones were set in such a way that I could continue down the road or not and I've been wrong at least once (though the cop was very understanding after I explained it). Some randomly placed cones are enough to confuse humans in many circumstances, as well. I doubt we'll ever have an all-encompassing solution for that, either. Even for things like autonomous-only lane, well it's not like everyone obeys the HOV lanes currently... There probably isn't a perfect solution, especially when I've seen plenty of ambiguous markings.
- Marsymars 5y ago
  Just yesterday I ran into some confusing cones and signage where I made the right merge onto the exit, but the car behind me made the wrong call and drove a kilometre or so down a newly built, unopened highway in parallel to me on my left until they got to some concrete barriers and realized their error.
xyzzy21 5y ago
And there's zero possible way self-driving cars are going to handle country roads that are sometime dirt in the snow during a blizzard. Humans absolutely can do that. But the very architectural basis via ML that's being used never will. Different architecture? Maybe. Maybe in 50-100 years.
- 5y ago

bryanlarsen 5y ago

That awful stretch of I95 can be special cased. It's a great example of what a computer can be better at than humans who each have to individually figure it out. An unprotected left turn is probably a harder problem. They'll be expected to do it aggressively like humans, and also expected to do it safely. Those are incompatible directives.

ghaff 5y ago
The (IMO) "right" way to do an unprotected left is also somewhat situational. If there isn't a lot of traffic generally on a country road but a somewhat bunched up group of vehicles is coming, I'll be patient until the bunch has cleared (unless someone flashes their lights at me). If on the other hand, I'm in a busier urban area and I can see there aren't a lot of openings, I'll be more aggressive including at traffic light changes. In general, my expectation--which may be completely wrong--is that we'll see autonomous driving on sections of highways in good weather long before we have door to door almost everywhere. Which is useful by itself for long highway drives.

kurthr 5y ago

I think responding to the human element is huge for safe driving. You would not want to safely drive the same way in LA as Boston, or Seattle. Other drivers make very different assumptions on your response to their (and others) actions, and that can create danger irrespective of navigation.

kenhwang 5y ago

Google Maps navigation can't even reliably call out which lane to use for turning in major metro areas, and that's kinda the basic best case scenario: clear images/footage, unlimited compute time, static road markers, common use case. I'm not sure how they can do better with far more stringent resources and requirements.

cmroanirgo 5y ago

This has always had me wondering about the viability of self driving: what's it going to be like in different countries? Not only are there different signs, different line marking & colours, & different widths. Cars are different: not all models are sold equally throughout the world. People are different: through their clothing, height and build. But the really big difference is that not everyone drives on the RHS... The article lists left turns as a problem, whereas on a LHS road system, right hand turns will be the problem. In NZ (a LHS system), I've heard that turning right across traffic has priority over oncoming traffic. In Melbourne, VIC Australia (also LHS), right turns are made from the left most lane because of trams lines. I'm sure there are loads of other issues specific to other geographies. To me, this never ending self driving experiment screams out that the wrong solution is being pursued. (That doesn't imply that I know what they should be using as a solution)

mdoms 5y ago
> In NZ (a LHS system), I've heard that turning right across traffic has priority over oncoming traffic. This is incorrect and would be utterly chaotic. You may be thinking of an outdated rule in NZ where right-turning traffic takes precedence over left-turning coming in the opposite direction to the same side road. This was the case for a long time but was reversed[0] in 2012, overnight, almost without a hitch. [0] https://www.nzta.govt.nz/driver-licences/getting-a-licence/road-code/give-way-rule-changes-2012/ https://www.nzta.govt.nz/driver-licences/getting-a-licence/r...
- 8note 5y ago
  It sounds like a pretty good idea to me, and will ensure low speed, low traffic roads

jandrewrogers 5y ago

My current work involves ground-truthing sensor and classifier hits from various automotive OEMs. Take, for example, reading old-fashioned speed limit signs. In principle, doing this correctly and reliably in context is a relatively simple machine learning problem, particularly when restricted to a single country. I have yet to work with an automotive OEM that doesn't consistently mis-classify some speed limit signs in some common cases that are completely unambiguous. It leads one to wonder about the quality of classifier design and testing such that these end up in production vehicles. The cases that cause a classifier to fail are different across automotive OEMs too, it isn't intrinsic; other automotive OEMs will handle that specific case just fine. On the other hand, when it works it often works surprisingly well. The good/bad news is that most of the problems I see are ultimately caused by poor model design and testing. These are all surmountable with better quality AI engineering. There is more AI to self-driving cars than the classifiers that pull features out of their environmental sensors. However, the driving AIs are making decisions based on the output of those classifiers -- garbage in, garbage out. These are the kinds of situations that will produce relentless incremental improvements over time, and there is still a lot of low-hanging fruit to improve on.