7 ms·
for those who haven't seen it, the manufacturer of the lidar system believes their hardware was functioning normally, and the problem is in uber's software: htt
by walrus01 9y ago
for those who haven't seen it, the manufacturer of the lidar system believes their hardware was functioning normally, and the problem is in uber's software: https://www.forbes.com/sites/alanohnsman/2018/03/23/lidar-maker-velodyne-baffled-by-self-driving-ubers-failure-to-avoid-pedestrian/#56a42cec5cc2 https://www.forbes.com/sites/alanohnsman/2018/03/23/lidar-ma...
- atomical 9y agoShouldn't the investigation be criminal? Shouldn't someone go to jail over this?
- xapata 9y agoAn inattentive driver killing a pedestrian isn't typically treated as criminal, as far as I know. As a pedestrian and a driver, I have mixed feelings about this.
- rtpg 9y agoWhat about Toyotas faulty acceleration? My... My understanding was that you can totally have this be treated as criminal but that most families don't want to press charges? Because, well, all of it sucks.
- thaumasiotes 9y agoWhat faulty acceleration? You mean https://en.wikipedia.org/wiki/2009%E2%80%9311_Toyota_vehicle_recalls https://en.wikipedia.org/wiki/2009%E2%80%9311_Toyota_vehicle... ? > The most common problem was drivers hitting the accelerator pedal when they thought they were hitting the brake, which the NHTSA called "pedal misapplication.” Of the 58 cases reported, 18 were dismissed out of hand. Of the remaining 40, 39 of them were found to have no cause; the remainder being an instance of “pedal entrapment.”
- romwell 9y agoNo, this faulty unintended acceleration: [1][2] [1] https://en.wikipedia.org/wiki/Sudden_unintended_acceleration#Sudden_Acceleration_in_Toyota_Vehicles https://en.wikipedia.org/wiki/Sudden_unintended_acceleration... [2]http://www.safetyresearch.net/blog/articles/toyota-unintended-acceleration-and-big-bowl-%E2%80%9Cspaghetti%E2%80%9D-code?utm_content=bufferf2141&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer http://www.safetyresearch.net/blog/articles/toyota-unintende...
- thaumasiotes 9y agoSo... the NHTSA started an investigation in 2010, and Toyota 'provided to the American public, NHTSA and the United States Congress an inaccurate timeline of events that made it appear as if TOYOTA had learned of the sticky pedal in the United States in “October 2009,”', when "In fact, TOYOTA had begun its investigation of sticky pedal in the United States no later than August 2009, had already reproduced the problem in a U.S. pedal by no later than September 2009, and had taken active steps in the months following that testing to hide the problem from NHTSA and the public." But the NHTSA's 10-month investigation beginning in 2010 when Toyota had already informed them of the sticky pedals came to the conclusion that zero of the reported cases of unintended acceleration involved sticky pedals. That's a case for lying to the government, and we see a judgment against Toyota for lying to the government. How is it a case for unintended acceleration?
- romwell 9y agoRead the second line as well to make conclusions.
- darpa_escapee 9y ago> What about Toyotas faulty acceleration? This is a great case to read up on. The testimony from experts in this case was top notch. I believe the criminal charges in the case were related to the degree of deception Toyota engaged in with regards to unintended acceleration in their vehicles. edit: Someone did a case study: https://users.ece.cmu.edu/~koopman/pubs/koopman14_toyota_ua_slides.pdf https://users.ece.cmu.edu/~koopman/pubs/koopman14_toyota_ua_...
- sgc 9y agoFamilies don't press criminal charges, the DA does. But if someone doesn't want to testify, a case can fall apart.
- danso 9y agoToyota paid a huge fine and other penalties, but looks like the criminal charge has been dismissed: https://www.reuters.com/article/us-usa-toyota/u-s-judge-dismisses-criminal-charge-in-toyota-sudden-acceleration-case-idUSKBN1CA2R2 https://www.reuters.com/article/us-usa-toyota/u-s-judge-dism...
- skookumchuck 9y agoIf you charge the engineers criminally, the result is that they won't cooperate with investigations, and will do their best to cover things up. With "no fault" investigations, the engineers work with the investigators to identify and fix the problems. The result is a lot better than the adversarial system.
- Hydraulix989 9y agoHas there ever been any back-stabbing after the engineers "cooperate" and volunteer potentially self-incriminating information?
- empath75 9y agoWe aren’t talking about a micro service going down, we’re talking about someone dying. If that driver hadn’t been in a self driving car, they’d clearly be going to jail for looking at their phone while driving.
- skookumchuck 9y agoThat's right, we're talking about someone dying. Is it better to have the problem fixed, or better to get revenge? In aviation, for example, some mechanics in Chicago were putting jet engines on using the wrong procedure. This resulted in a crack in the engine mount, the engine fell off during takeoff, resulting in a fiery crash where everyone died. Everyone cooperated with the investigation. The mechanics were not criminally charged. The procedures were changed so it wouldn't happen again. Under your proposal, the shop would have had every incentive to alter records, deny, obfuscate, and in general impede finding the truth as much as possible. Do you think that would have been better? I know of no cases where mechanics, engineers, air traffic controllers, regulators or pilots were criminally charged in a fatal accident. The result is we have incredibly safe air travel. I don't know about you, but I'm happy about that result.
- atomical 9y agoA software developer fucked up. It could have been much worse. It's going to make our industry look worse if we aren't held accountable.
- pentagonpapers 9y agoNah, I'd rather not be held accountable for endless scope creep and 80 hour work weeks delivering a product I repeatedly called a pile of bugs
- m4x 9y agoEngineers who are held responsible for their work and can go to jail when they get it wrong don't accept work conditions like you describe. Software engineering might be a better profession to work in if it was regulated the same way other engineering fields are.
- lostlogin 9y agoMakes you wonder if a governing body will ever come about - eg medical councils/boards, engineers associations etc. Presumably it’s these type of problems that they came into existence for. It’s a double edged sword, but often works in the interest of the profession where I am. The biggest difficulty I’d see is that defining a software developer is not prticularly easy.
- Mizza 9y agoA vehicle involved death is always treated as a potential criminal case.
- xapata 9y agoSure, the police always check for intoxication, etc.
- threeseed 9y agoNot sure about the US but in other countries it often is. In Australia for example if you are using your phone and kill someone you absolutely will be seeing jail time.
- paulcole 9y ago> An inattentive driver killing a pedestrian isn't typically treated as criminal, as far as I know They certainly should be treated like a criminal. They used a deadly weapon to kill someone because they didn’t respect their responsibility.
- bunderbunder 9y agoIt's generally considered a form of negligent homicide, which is a crime in the USA.
- xapata 9y agoNo, "ordinary" negligence justifies a charge of vehicular manslaughter, which has lesser penalties than plain manslaughter. Even then, it seems like many states require "gross" negligence, like speeding or intoxication to charge with a crime. Someone who simply "didn't see the pedestrian" but was otherwise following the law will likely not be charged with a crime. They'll get sued, of course.
- dragonwriter 9y ago> An inattentive driver killing a pedestrian isn't typically treated as criminal, as far as I know. It's usually, though exact standards vary, vehicular homicide if there is criminal negligence, which can include inattention while driving especially if it results in a citable (on its own, before considering the fatality) violation of a traffic mandate that causes then fatality.
- ineedasername 9y agoBut who would go to jail? The developer responsible for writing the faulty code? Or the QA team that missed it on review? The project lead who signed off and checked the code into the repo? The supervisors of any of these people? I'm really not sure how you aportion blame on something whose development is so widely distributed.
- atomical 9y agoYes, the developer.
- Whitestrake 9y agoI'd argue that prosecuting a developer because his employer used his code to kill someone would be comparable to prosecuting a gun manufacturer because a customer used their weapon to kill someone.
- atomical 9y agoThis is comparable to prosecuting the developer who works for a gun manufacturer when a new type of digital "safety" fails.
- Whitestrake 9y agoAn equally fair comparison. I'm not a lawyer, this is not legal advice, and I'm really just spit-balling for discussion's sake and because I consider it interesting; please do poke holes in my reasoning. Presumably the developer in this scenario is not responsible for guaranteeing to and/or misleading a customer that his code adequately renders a deadly weapon safe, more likely that responsibility falls on the managers whose project it was to implement such a digital "safety" and instructed the developer to write the code in the first place. Assuming the developer did not write the code with the intent of bringing about a person's death, which might involve fooling his superiors as to the efficacy of his work, I'd wager he can't be guilty of a crime. Outside of that, I believe vicarious liability applies. Perhaps he was a one-man department of this hypothetical gun manufacturer, implementing, deploying, and marketing his product himself and of his own initiative; I don't think there's any doubt he'd be liable in this case, the extent of which is dependent on his intention. Perhaps our developer was self-employed as a contractor, and warranted to his client (the hypothetical gun manufacturer) that the code was safe; assuming the manufacturer used it as warranted, and it failed, I'd assume the developer would be mostly liable for the result.
- alsetmusic 9y ago> Edit: It's disgusting you guys are down voting me over this. Adding this is not a mature response to downvotes. I was indifferent to your original comment. I downvoted because of this addendum.
- deleted 9y ago[deleted]
- deleted 9y ago[deleted]
- deleted 9y ago[deleted]
- atomical 9y agoNo.
- keyle 9y agoIt would be involuntary man-slaughter at worst. Hard to prove right?
- mtgx 9y agoWhy? The car should have all the logs, shouldn't it? It's won't be 100% an account of what happened, but it should be pretty close - unless neither Uber's lidar nor radar was functioning, in which case that could ironically save the company.
- ajross 9y agoCriminal negligence statutes (I don't know Arizona law in particular) virtually always have a "gross negligence" requirement. A reasonable person would have had to have known that the action was likely to cause harm. It's not enough just to make a fuckup. That just doesn't seem to apply here, absent evidence that we don't have (e.g. Uber knew the LIDAR was being ignored, something like that). This was just a software bug. You don't throw people in jail because they wrote buggy software.
- atomical 9y agoWhich is it? You're saying we don't have enough details AND that it's just buggy software.
- ajross 9y agoUpthread it was pointed out that the LIDAR manufacturer believes their system was operating correctly. Assuming that, it becomes a software bug more or less by definition. But fine: let's say it was the LIDAR system was at fault. Do they go to jail, then? How about the bureaucrats who approved the test? All this doesn't matter. I'm simply saying that ALL the facts in evidence point to this being a reasonable mistake, and reasonable mistakes don't qualify for negligence prosecution. If you want to argue to the contrary you need evidence, which doens't seem to exist. Therefore the upthread question "shouldn't someone go to jail?" is answered with a firm "no".
- DC-3 9y agoTo be horribly utalitarian - every week you set back the development of self-driving tech, you're 'killing' future people who are involved in human-at-fault collisions. Counterintuitively, it is the most ethical choice to continue to accelerate self driving car development even if it is sometimes conducted in an unsafe manner.
- danso 9y agoIt would be utilitarian if we knew that self-driving tech was the best outcome out of all potential alternatives. We don't.
- freehunter 9y agoNot disagreeing, just curious: besides the obvious "drive it yourself", what are the in-the-works alternatives to self-driving cars? I'll admit I don't follow the space too closely.
- danso 9y agoI'm not in this crowd, but mass-transit advocates argue that the resources/attention poured into self-driving could be better allocated toward investment in mass transit infrastructure.
- TheGRS 9y agoThis also assumes a good market of people who want to use mass transit vs something private.
- joejerryronnie 9y agoMass transit infrastructure will not provide VC's with 100x returns.
- TheGRS 9y agoEhhh, I think given enough time and money just about any problem can be solved. Given what we know today, it seems pretty reasonable to say that we will achieve a car that can drive itself in any situation and not cause deaths...at some point in the future.
- mrep 9y agoOver what? Correct me if I am wrong, but the car had the right of way and the person illegally crossed. Regardless of any improvements in what the self driving car/driver could/should have done, it seems clear cut to me that the root cause lies with the person.
- atomical 9y agoJust because you have right of way does not allow you to murder someone.
- freehunter 9y agoI know you're using hyperbole, but murder does imply a pre-determined intent to kill. At worst this is involuntary manslaughter.
- mrep 9y agoMurder? This was not a premeditated killing. It was an accident that everyone involved certainly wishes did not happen. Although, you might be able to argue for involuntary manslaughter but I'm no expert.
- umanwizard 9y agoI’m not sure about Arizona, but murder in common law doesn’t require intent, only that a reasonable person could have predicted the action would lead to someone’s death.
- mrep 9y agoSo reading this article [0], it seems as though both parties are evaluated for their actions and blame is assigned proportionally. So while the women jaywalking would probably get the bulk of the blame for jaywalking, the driver/uber might also get some due to software error/driver inattention. My guess for why the cops are not really going after uber is because the women was reportedly homeless so she does not have any family to fight for her case. [0]: http://www.alllaw.com/articles/nolo/auto-accident/pedestrian-fault-car-accident.html http://www.alllaw.com/articles/nolo/auto-accident/pedestrian...
- stale2002 9y agoDid you see the video? Imagine if it was just a person at the wheel. Would a person have gone to jail for hitting that person, in the video?
- atomical 9y agoIf the person knew they were there, yes. That's the case with the LIDAR.
- alistairSH 9y agoThe low quality dash-cam video that looks nothing like real life? Street lights and headlights cast more light than is evident in that video. Do you ever drive at night? Then you should intuitively know if it was really that dark, the headlights were off, or fog was present, or something else that would indicate a speed much lower than the posted limit was sensible (vs this car, which was speeding st the time).
- CydeWeys 9y agoThat manipulated video does more to make me distrust Uber than the crash itself. They're showing what their true colors are, same as always. I don't trust them to do self-driving cars safely.
- Piskvorrr 9y agoPedantry: video is probably not manipulated ("has not been postprocessed"), but it is manipulative ("released with intent to manipulate audience"): I've seen similarly crappy, unedited videos from cheap dashcams. Indeed, it would make sense to buy the worst-quality scapegoat camera - you could then claim "see, it's really, really dark out there, nothing we could have done!"
- CydeWeys 9y agoThe selective choice of what to release, even though they clearly have much better information, is what's manipulative. No disagreement there.
- chrononaut 9y agoRelated, has anyone gone to jail for faulty aircraft surface control software?
- dingo_bat 9y agoWould a human driver be prosecuted criminally?