4 ms·
Here's the crash report: "On October 28, 2021, after turning right onto Fremont Blvd from Cushing Pkwy, the Pony.ai Autonomous Vehicle ("Pony.ai AV") performed
by Animats 5y ago
Here's the crash report:
"On October 28, 2021, after turning right onto Fremont Blvd from Cushing Pkwy, the Pony.ai Autonomous Vehicle ("Pony.ai AV") performed a left lane change maneuver in autonomous mode. While performing the lane change, the Pony.ai AV came into contact with a center divider on Fremont Blvd. and the traffic sign that was posted on the divider. The Pony.ai AV suffered moderate damage to the front of the vehicle and the undercarriage. There were no injuries and no other vehicles involved. Fremont Police Department were called to report the incident and the damaged street sign. Pony.ai has subsequently worked with local authorities to resolve all issues related to the damaged sign."
It's not a serious incident, but it is a fully autonomous vehicle under good conditions going somewhere it was absolutely not supposed to go. So DMV revoked their license for full autonomous operation without a safety driver. They have to go back to testing with a safety driver.
[1] https://www.dmv.ca.gov/portal/file/pony-ai_102821-pdf/ https://www.dmv.ca.gov/portal/file/pony-ai_102821-pdf/
- tyingq 5y agoStreetview positioned at a right turn from Cushing onto southbound Fremont Blvd: https://www.google.com/maps/@37.4905025,-121.9488087,3a,24.2y,134.28h,86.87t/data=!3m6!1e1!3m4!1s1QKyKisG_B_UQaEfmT9h1Q!2e0!7i16384!8i8192 https://www.google.com/maps/@37.4905025,-121.9488087,3a,24.2... You can see the curb rashed up and the pretty improvised fix to the sign from a previous accident I suppose, since the map says March, 2021. https://imgur.com/a/U8cokYd https://imgur.com/a/U8cokYd
- tlrobinson 5y agoI doubt that was where the impact was if the car was turning right from Cushing onto Freemont, since it’s 2 lanes over from the turning lane.
- ehnto 5y agoThe report said it performed a left lane change after the initial turn, so it could still be.
- lostlogin 5y agoIt’s crashed right outside a Tesla factory.? There is a joke here somewhere.
- robbedpeter 5y agoCould Tesla have put up adversarial triggers nearby their own facilities to test, and it overlapped on whatever opencv or vision package pony.ai is using? Using invisible-to-humans paint on signs for adversarial recognition attacks on autonomous driving systems would also be an anti-Tesla tactic not entirely unreasonable to consider. "Tesla autopilot crashes right outside Tesla factory!" would be a desired headline for a certain crowd. It'll be interesting to see what caused this, at any rate, probably less than 1% chance the above is what happened.
- cwmoore 5y agoThis one gives a better idea of why this might have happened, in the direction of travel, the white back of the sign is easy to miss with a white-sided box truck behind it: https://www.google.com/maps/@37.4902551,-121.9483919,3a,75y,309.66h,76.43t/data=!3m6!1e1!3m4!1sGMkg-OYtjbelcE-_9xUxkA!2e0!7i16384!8i8192 https://www.google.com/maps/@37.4902551,-121.9483919,3a,75y,... The pole at the end of the divider with the sign facing away, stretched-arrow street paint left-turn symbol, and the enormous expanse of intersection pavement are all a little disorienting.
- Apofis 5y agoWhat's amazing is that it's on Google Streetview already! Wow. Google sent a drone out to get a photo right away. Amazing.
- tyingq 5y agoSeems like maybe you misread something. I didn't suggest it was recent...I put the date in the post.
- ashtonkem 5y ago“Do not drive into stationary objects” should be one of the more basic requirements for a self driving car, any company that messes that up makes me nervous about how they might handle more complicated situations.
- CamperBob2 5y agoAsimov's Laws for Self-Driving Cars: 1. Don't hit anyone 2. Don't hit anything 3. If forced to violate rule(s) above, preserve the life of the person making the car payments
- mirages 5y agoThat was part of spec of the traction/break of a vehicle I worked on. Passagers life was prioritized as the premise behind the decision was : "Outside the vehicle is an unknown, we don't know if it's a human, an animal, an object ; we know that inside we have human life (at least the driver, at most the hundred of passengers), so we give priority to what we know)
- sorokod 5y agoSome interesting moral questions can be asked about this setup. The most basic one, if indeed the outside is unknown to your product, are you a moral person developing it.
- ashtonkem 5y agoThat sounds bad. Yes, you know that there’s a person in the car, but you also know that if the object in front of you is a person then they are multiple orders of magnitude more likely to be killed than the occupants. You have to weigh the uncertainty and the disparity of outcomes. Sounds like a continuation of the automotive trend that pretends like the only person whose life matters is the occupant.
- colechristensen 5y agoIt’s not a serious incident for a human, there are lots of explanations for such a thing which are innocent. It is a serious incident for a robot for which running into a street sign in the middle of the road is a “never” kind of problem and indicative of a significant issue.
- bmj 5y agoIt’s not a serious incident for a human And perhaps that's part of the problem. "Oh, this person crashed his heavy machine into something...it happens" seems to significantly undervalue the responsibility and risks of driving. It should really be a "never" problem for people, too.
- darepublic 5y agoFSD isn't even close to human capability yet so its a moot point. When FSD is as good as a human driver we can then think about quantifying how seriously to take its occasional malfunctions / mistakes.