3 ms·
> The only possible solution is that the SDC and/or software manufacturer is legally responsible for any accidents the SDC causes. [...] But that would be money
by wpietri 8y ago
> The only possible solution is that the SDC and/or software manufacturer is legally responsible for any accidents the SDC causes. [...] But that would be money, not jail time, of course.
I don't think there's any "of course" there. As we see with the 2008 crash and the financial industry generally, corporate financial liability for the high-risk decisions of individual managers and execs doesn't do much to reduce systemic risk. For the managers, it's a "heads I win, tails you lose" play.
The difference between banks and robot cars is that a banking failure just means slightly higher prices for the customers and/or slightly lower dividends for investors. Whereas with robot cars, in comes in funerals. Especially given the endemic low quality in the software industry, there's little doubt in my mind that unless "disruptors" face actual jail time, we'll see what is in effect scaled-up negligent homicide.
- BurningFrog 8y agoI mean, we have a century of settled tradition/law for how to handle deaths and injuries from badly designed cars. It's far from a new issue. I think that system can keep working. I don't really see the analog with the banks. Software has endemic low quality where it doesn't much matter. In mission critical systems, it is usually reliably as solid as it needs to be.
- wpietri 8y ago> I mean, we have a century of settled tradition/law for how to handle deaths and injuries from badly designed cars. It's settled for cars with human drivers, because the drivers bear most of the responsibility. For cars without drivers, who's to blame for bad driving? "Somebody's bank account" is not a compelling answer. > I don't really see the analog with the banks. What part is unclear for you? I'm saying that with banks for the last 10+ years, we see that financial penalties don't solve problems of risk or accountability. > Software has endemic low quality where it doesn't much matter. In mission critical systems, it is usually reliably as solid as it needs to be. I don't think either of those statements is correct, unless you mean the first one tautologically. But the latter is definitely untrue. Look at the way Toyota was building their software. Or the recent Boeing fiasco. Or Volkswagen's emissions scandal, which is responsible for circa dozens of deaths.