4 ms·
You might be able to literally count on two hands the number of accidents where we have this level of transparency into the thought processes and sensory data o
by roenxi 7y ago
You might be able to literally count on two hands the number of accidents where we have this level of transparency into the thought processes and sensory data of the 'driver'. And control over what happens next time. There is no doubt that the engineering data gathered here and in other accidents is going to contribute to a massive (truly massive, unspeakably massive, enormously massive - all such adjectives are appropriate) reduction in both actual deaths from car accidents and statistical deaths from the huge amount of time people waste driving.
The big picture is so overwhelmingly positive that even if the engineers were purposefully running people over to gain testing data it would still probably be a large net win for greater society. Thankfully there is no call for such reckless data gathering.
If anything, punishments in this case should be much more lenient than normal rather than breaking out the cruel and unusual measures.
- Piskvorrr 7y agoOh wait. So the creators are to be treated with leniency, but LITERALLY running over innocent bystanders is an unfortunate coincidence which should be endured for the brighter future? If you do not see why this is wrong, do I have news for you.
- TheSpiceIsLife 7y ago> There is no doubt that the engineering data gathered here and in other accidents is going to contribute to a massive Im going to strongly opposed this, and to support my perspective I present to you the Boing / FAA fiasco.
- roenxi 7y agoAir travel is the safest form of transport we have. Perfection is impossible, but air safety is pretty close. They didn't get there by getting outraged every time an aeronautical engineer made a mistake; they got there because every time there was a crash they gathered data, thought carefully and made changes. There is no call to get riled up because Uber as a corporate entity let a mistake slip through. The justice system will come up with something that is fair enough and we will all be better off for the engineering learnings. This is young technology, which is different from aircraft.
- TheSpiceIsLife 7y ago> Perfection is impossible, but air safety is pretty close. Intentionally programming a system to ignore object history each time reclassification happens seems like a glaring oversight. Sitting behind the wheel as a test driver using your phone seems like a glaring oversight. I’ll continue with my rile until change occurs, cheers.
- Haga 7y agoThey got there because every crash is a worldwide public tragedy that leads to government regulators grounding planes until fixed... Putting the economic knife to throats.
- vpribish 7y agoI think you are absolutely correct. and i'm disappointed again at the broader HN downvoters who lack any sense of perspective. It's like the hackers all turned into fuzzy-headed luddites here.
- Piskvorrr 7y agoAh, sure: The New World Order requires sacrifices, as it's axiomatically Good, Correct, and Right. Anyone opposing it is the Enemy. (Now technooptimism-flavored: when Friend Computer runs you over, it's because you were secretly a traitor.)
- puranjay 7y agoCome on. It's one thing to be run over by a fellow human being, it's another to be run over by a system developed by a corporation in the pursuit of greater profits. As a species, we've long accepted that living around each other poses some hazards and we've made our peace with it. But to stretch that agreement to a multi-billion dollar corporation that only wants to make money off it? That's too much to ask for.
- glofish 7y agoI think the "for-profit"" by a "multi-billion dollar corporation" thought process is clouding your judgment. It is such a trite and overused argument. Why does it feel so different to you if the accident was caused by negligent human texting, versus an engineer making decisions in code? If anything that engineer was most likely operating in much better faith than the texting, perhaps drunk human driver.
- puranjay 7y agoIt's a rather complicated question. Intention matters a lot when it comes to dealing with on-road incidents. If there is no intention, we deem it an "accident", else we deem it manslaughter. The punishment - by courts and by society - are much harsher for the latter. Can code be "accidental"? Surely not. Someone had an intent to write and implement it. If it fails, its not "accidental"; the system was just programmed that way. So the question is: are we okay with for-profit companies intentionally writing software that can lead to deaths?
- FussyZeus 7y ago> If anything, punishments in this case should be much more lenient than normal rather than breaking out the cruel and unusual measures. How is it cruel or unusual to subject someone to risks posed by a system they're building? The Wright brothers didn't hit up bars to find guys willing to drunkenly try and soar into the sky on an oversized kite. The vast majority of things that were ever invented involved huge risks and often injuries to the inventor. Why do people writing code get exemptions from that? I agree with the GP: the hardcoded 1 second wait time sounds exactly like some hack I'd put in a bit of code, the key difference being, my code makes fun little applications on an iPhone work, it does not DRIVE A 3500 POUND VEHICLE IN PUBLIC. I bet if that engineer thought it would be him in front of that things bumper, he would've put in a bit more work to figure out what was going on.
- roenxi 7y ago> How is it cruel or unusual to subject someone to risks posed by a system they're building? More unusual than cruel, I must admit. We just don't do that anywhere. If I were to guess why - if we did, people would either not work on experimental systems or would gold-plate the safety features way beyond what was reasonable. That sounds nice if you don't think about it too hard but in practice it would shave % off how much we produce in goods and services for no reason. Aeroplanes are a great example. It sounds nice to say they are a super-safe form of transport, but actually thinking through the risks people face on their commute to work each day the amount of money we spend doesn't make sense. I mean, what if the risk of being in a plane crash was only as rare as being struck by lightening? And the ticket was much cheaper? That wouldn't be so terrible. I don't know a lot of people who were struck by lightening but I know a lot of people who don't have much money but take overseas holidays anyway. > I bet if that engineer thought it would be him in front of that things bumper, he would've put in a bit more work to figure out what was going on. Probably not in my experience. It is quite hard to get better performance out of a knowledge worker by threatening them. From what I've seen they tend to either resign or just do what they were already doing and hope. It isn't like anyone can stop writing buggy code by trying harder.
- gambiting 7y ago
- spease 7y agoThese kind of metrics should be mandatory for self-driving cars. Just because, say, you can produce a painstakingly detailed timeline should not free you from consequences if that timeline indicates you acted with wanton disregard that any reasonable person could tell you would result in loss of life. If someone is so stupid that they don’t realize that a car needs to be able to avoid people in the road, even outside crosswalks, they have no business doing development of self-driving cars. They simply aren’t qualified. Ditto if that person simply doesn’t care. We’re not learning anything from this that we didn’t already know. Of course if you do nothing to avoid a person or a bicycle at 40 MPH, you’re gonna kill someone eventually. This kind of thinking reeks of the “it works with expected input, problem solved” that causes so many issues in critical software. This is like Boeing with the 737 Max. They didn’t want to deal with failure conditions, so they avoided detecting them so they could pretend like they don’t exist. Subsequently, those failure conditions then caused two airplanes to crash and kill the people aboard.
- roenxi 7y agoAeroplanes have 50 years of global experience in how to fly planes safely. Self driving cars aren't even a full product yet. If (and it is a big if) there is one engineer who was grossly negligent then yes they shouldn't be working on self driving cars. But it is far more likely that this was totally normal corporate ineptitude and will be fixed in the due course of normal engineering processes. A safe culture is not built by people making wild guesses about what and why on forums. It is likely that the engineer responsible for this code is also going to be responsible on net for a very large number of lives saved and judgement of who may have been culpable for what should be left to the courts. Morally I'm happy to say that I believe not only is he or she in the clear but probably deserves a pat on the back for helping to push forward the technology most likely to promote save young lives that I've ever seen. I've had young friends who died from car crashes and ... not much else. Maybe drugs and diseases in a few rare cases. I want technology that gets people taking their their hands off the wheel and I want it ASAP. It doesn't need to be perfect; it just needs to be about as good as what we have now and consistently improving. Anyone halfway competent who is working on that as a goal has my near total support. This is not the time to be discouraging people who work on self driving cars. This is a time to do things properly, non-judgmentally and encouragingly while acknowledging that we can't have cars running people over if we can possibly avoid it and fixing what mistakes get found.