89 ms·
Self-driving Uber car kills Arizona woman crossing street
- bryanlarsen 9y agoArizona had 10 pedestrian deaths in a single week: https://www.azcentral.com/story/news/local/phoenix-breaking/2018/03/13/arizona-official-10-pedestrian-deaths-week-show-major-crisis/422808002/ https://www.azcentral.com/story/news/local/phoenix-breaking/...
- alacombe 9y agoAs somebody else pointed out, what is the ratio of total miles driven in metro Phoenix over fatalities ?
- bitxbitxbitcoin 9y agoOn purpose to protect something "more valuable," or on accident?
- cek 9y agoThere's an old saying around gun owners: "There's no such thing as a firearms accident. Only negligence." I think the same thing applies to autonomous things.
- si1entstill 9y agoI feel that this sentiment could be applied to almost anything and isn't really meaningful. Almost every accident ever could be attributed to negligence somewhere.
- maxerickson 9y agoI try pretty hard to refer to "vehicle collisions" and things like that instead of "car accidents". So yeah.
- SllX 9y agoI think the point here is a firearm in particular is designed to project deadly force and should be treated as such. If someone "accidentally" shoots someone, it means they were negligent in their treatment of the instrument in their hand. Autonomous vehicles are expected to be able to safely navigate a large variety of streets and highways, and possibly trails and countryside in the future, without killing anybody else around or killing the people inside, nor destroying the fixtures and buildings that make up your typical city street. The only problem is cars are inherently deadly, go look up the number of people that have died in automobile "accidents" since the automobile was invented, total it up for just one country. They need to be treated with and afforded the same respect as any other instrument intended to project deadly force, because they do, as do whatever algorithms are controlling the instrument.
- jaxbot 9y agoIn NYC the urbanists have a trend of saying "crash" instead of "accident" when referring to traffic collisions. They feel that "accident" gives the driver too much credit in situations where they were completely at fault for not looking, going too fast, running a light, etc.
- dragonwriter 9y ago> In NYC the urbanists have a trend of saying "crash" instead of "accident" when referring to traffic collisions. Everyone I've known in law enforcement, especially CHP officers, does this by default (though they tend to prefer “collision”) when referring to an event where a car hit something. As one of them explained, “collision” or “crash” is a readily discernable physical fact; “accident” is a conclusion about the mental state of the participants.
- gowld 9y agoWhich by the way is idiotic. Last century, people switched from "crash" to "accident" for exactly the same reason -- to shift liability from the machine to the operator. IT's a nonsensical euphemism treadmill. The idea that an "accident" isn't the drivers false is an absurd premise. Drivers are obligated to be diligent. "Crash" is a neutral term that doesn't assign liability to anyone.
- neon_electro 9y agoAgreed; more generally, there's a movement to avoid calling these incidents "crashes" instead of "accidents", since it's arguable that crashes are avoidable: https://www.crashnotaccident.com/ https://www.crashnotaccident.com/
- gowld 9y agoAccidents are avoidable. Legislating euphemisms is feelgood nonsense.
- bitxbitxbitcoin 9y agoI agree completely. Here, there's perhaps negligence of the system, and the driver that was supposed to be overriding it in situations like this.
- jakelazaroff 9y agoThis is a dumb saying that ignores the fact that humans are fallible beings who make mistakes. Sure, you might shoot yourself because you're just careless with your gun. Or you might be also thinking of an argument you had with your spouse, or you might be tired when you're handling your everyday carry on your way to work, or you might get startled, or a million and one other things that might prevent you from singly focusing your attention the gun you're handling. Machines exist to serve us, not the other way around. If a product doesn't take human habits and flaws into account, it's a bad product, because over a large enough sample size someone will make a mistake.
- LyndsySimon 9y ago> This is a dumb saying that ignores the fact that humans are fallible beings who make mistakes. It's not, because the basic rules of gun handling are designed in such a way that failing to obey one of them will not result in injury. They are: * Never point a gun at anything you don't wish to destroy * Keep your finger off the trigger until you're ready to fire * Always assume the gun is loaded * Know your target and what's beyond it. > Machines exist to serve us, not the other way around. If a product doesn't take human habits and flaws into account, it's a bad product, because over a large enough sample size someone will make a mistake. Modern firearms are absolutely designed to this criteria - it takes a willful act to discharge them. If someone "mistakenly" fires a gun and hits someone, it requires multiple failures and clearly rises to the point of negligence.
- jakelazaroff 9y agoAs long as you follow the basic rules of car safety, you won't crash. Stay within the speed limit, be aware of your surroundings, keep a safe distance from the car in front of you, signal 100 feet before a turn. Unless someone else doesn't follow the basic rules of car safety! You know what system we've come up with to improve car safety that has only one rule to remember? Always wear your seatbelt. You know what we've come up with that requires zero effort from the driver? Laminated glass. Crumple zones. Airbags. Automatic braking. This isn't about whether people use a product negligently — put it in enough hands and it will happen. The point is to design products such that the consequence of negligence is not injury or death.
- xexers 9y agoForgive me, I don't understand what you mean. Please elaborate.
- bennyg 9y agoThey're basically asking if the car avoided doing something that would have been more destructive (e.g not hitting 2 people but only hitting one person instead). Or if there was no conflict decision making that happened and the car accidentally ran into the person and it resulted in a fatality. - AI decides between one life lost as a better potential outcome - AI made no decision and just happened to hurt someone
- delete2 9y agoPlease don't, he's going to launch into some philosophical dilemma that's not relevant because these cars aren't making decisions.
- xexers 9y agoNo, I'm not going to do that. I just didnt know what they meant.
- hughes 9y agoI think it's a reference to the imaginary trolley problem, which is often raised as an objection to self-driving capability. The idea is that making a decision between killing one person vs killing something more valuable than one person (eg. multiple people) is something that drivers do on a regular basis. Computers may not be capable of correctly evaluating the ethics of that decision.
- suresk 9y agoOne of the most oft-discussed questions around self-driving cars is what should happen if your car can choose between two options: 1) An action that will have a better chance of protecting the people inside the car, 2) An action that will protect people outside of the car, with a whole bunch of variations. For example - What if someone steps out into the road and you can either hit them, or run into a wall? The former makes it far more likely the occupants of the car will be safe, the latter saves the life of a pedestrian at the expense of possible injury to people in the car. It is kind of an interesting question, because people can't generally react quickly and rationally enough in a situation like that for it to matter, but in theory, a computer can. But it also dominates the discussion in a way that likely far overstates how frequently this will actually be a decision a computer has to make. I think that is what the person you're replying to is asking. Given that this occurred at night and on (very likely) uncrowded streets, I feel like its far more likely the car (and backup driver) just somehow missed the pedestrian.
- deleted 9y ago[deleted]
- toofy 9y agoYeah, it will be interesting to see if this was an intentional (algorithmic) response or a failure of sensors somewhere. I go back and forth with thinking the algorithms in things like self-driving cars should be public. Anything which must make a choice such as smash into bus or smash into bicycle — the public should be aware of the choices the company chooses to implement. Obviously this example is simplistic but it illustrates my point. Today I’m definitely leaning towards it should be public and scrutinized. Next month I may be worried this would hamper progress.
- bitxbitxbitcoin 9y agoI'm pretty sure everyone involved and observing also vacillate between those two mindsets. Regardless, events like this will likely hamper progress.
- zawerf 9y agoIs this the first death ever? (Do we count Tesla's autopilot as self-driving?)
- CocaKoala 9y agoHm, there have been other crashes where the 'driver' in the car died (I recall one where a car in autonomous mode rear-ended a truck, something about how the sensor was blinded by the setting sun? And it had alerted the driver to take control several times before the crash) but this is the first incident I can recall where a pedestrian was struck and killed by an autonomous vehicle.
- stevenwoo 9y agoIn the Tesla one the sensors did not recognize the white trailer of an 18 wheeler against the sky from news reports.
- jandrese 9y agoIIRC in that case the driver T-boned a truck crossing the road, because the side of the truck was so shiny that it read as the horizon to the car's sensors.
- twinkletwinkle 9y agoI believe it's the first "third-party" death.
- tabeth 9y agoObviously more information is needed, but I thought the entire point of having a driver behind the wheel is to manually intervene to prevent this very situation? I'm very curious to see how they'll investigate this and who will be determined to be at fault (person behind the wheel or Uber). It will likely set a precedent.
- annabellish 9y agoHuman beings simply cannot switch between "not focussed" and "in charge of a car, taken out of autonomous mode, and actively avoiding collision" fast enough to avoid most accidents, unfortunately. Neither can humans maintain the focus required to be ready to do that when 99.9% of the time they're not required to do anything. Semi-autonomous cars have drawbacks.
- sandworm101 9y agoWhich is why the machine should be backup for the always-driving human, only leaping in to correct failings.
- nradov 9y agoExactly like what has been done successfully in aviation for decades now. For example Auto-GCAS. I don't understand why car companies are trying to go against a proven model.
- joshuamorton 9y agoModern aviation includes fully autonomous modes though. An airplanes autopilot is simpler than a car's autonomy, but they accomplish essentially the same goal: get you from point A to point B with no human interaction. AFAIK, even takeoff and landing can be done mostly autonomously on modern aircraft. If anything, airplanes prove that machines doing most of the work and humans stepping in only when necessary is a proven model.
- 9y ago
- ashleyn 9y agoUber's self-driving program seems to be one of the most unethical, most poorly-run in the entire industry. There were plenty of reports before warning us of the questionable quality of their research: cars changing lanes suddenly, blowing red lights, and now one finally killed someone. Every prior incident should have been treated as a serious matter. Waymo et al has had none of these issues. Time to revoke their licence to test?
- Mononokay 9y ago> Uber's self-driving program seems to be one of the most unethical, most poorly-run in the entire industry. I mean, it's Uber. I'm not sure exactly what people were expecting. Their entire schtick is being unethical and poorly-run.
- reddit_clone 9y agoYeah. Their motto seems to be 'easier to ask forgiveness/pay fines instead of asking for permission'.
- artursapek 9y agoWhat do you guys think Uber stands to gain from intentionally programming their cars to run red lights?
- Mikeb85 9y agoI don't think anyone thinks it's intentional, just that they're a poorly run company and have been less diligent in fixing bugs and ensuring safety.
- stochastic_monk 9y agoThey stand to gain by being quicker to market by failing to instantiate adequate safeguards. Criminal negligence, not direct malicious criminality.
- nodesocket 9y agoStriking a pedestrian in a crosswalk is horrible and terrible news. The reality though is how many pedestrians are hit by manual driver's vs automous drivers? On a percentage basis I gotta believe autonomous cars are orders of magnitude safer. Self driving cars aren't going to be perfect. How many people lost their lives in early factories to machines during the industral revolution? Imagine if they had pulled the plugs back then.
- kamakazizuru 9y agoyes, but with a human driver you have someone to take responsibility / punish for, what do you do with an alogrithm to provide justice?
- etskinner 9y agoFine/sue the entity that made the algorithm, just like every other situation like that. Or, if you can prove negligence on the part of someone inside that company, prosecute them.
- danso 9y agoWhat other situations did you have in mind?
- Maybestring 9y ago>What do you do with an alogrithm to provide justice? Assuming Arizona hasn't produced law specifically for fatalities in their public road self driving test program... The algorithms are just one detail of the total system design, and the design of the system isn't really the issue. People don't get killed by designs or code. The verification of it's safety, and the decision to deploy that system on uncontrolled public streets will be the issue. People made these decisions, not an algorithm.
- jandrese 9y agoIt appears the woman was not using the crosswalk, but really that doesn't make much difference in the reaction to the report. Uber's self driving tech seems a bit under-baked at the moment.
- leggomylibro 9y agoFTA: "The Uber vehicle was reportedly driving early Monday when a woman walking outside of the crosswalk was struck. ... Tempe Police says the vehicle was in autonomous mode at the time of the crash and a vehicle operator was also behind the wheel." That's a very bad look; the whole point of self-driving cars is that they can react to unexpected circumstances much more quickly than a human operator, such as when someone walks out into the road. Sounds like Uber's platform may not be up to that standard yet, which makes me wonder why they're on public roads. On the other hand, it sounds like it happened very recently; I guess we'll have to wait and see what happened.
- m3kw9 9y agoThey will have video for sure if since they are testing, then we will see. Your statement about reaction time is assuming so many things, may as well declare the AI guilty now right?
- jakeogh 9y agoIt's not "intelligent", it's a dumb computer that is programmed by humans. The people responsible for putting it on the road must be liable.
- jobigoud 9y agoIt's not intelligent but it's also not programmed by humans in the sense that someone painstakingly put explicit logic for the possible cases.
- jakeogh 9y agoIt's programmed by humans. Get over it. It's not intelligent, it's not "learning" it's following instructions, saving data, and iterating. Your comment is obvious to the point of meaninglessness. This tendency to buzzword out of obvious truths (NN's are programs for example) derails rational discussion.
- Jeff_Brown 9y agoOn the bright side, with an autonomous vehicle, an accident is a learning experience that will benefit other autonomous vehicles.
- deleted 9y ago[deleted]
- iooi 9y agoThe second ever [1] fatal car crash involving a self-driving car. This is the first one where a third party is killed. [1] https://www.theguardian.com/technology/2016/jul/01/tesla-driver-killed-autopilot-self-driving-car-harry-potter https://www.theguardian.com/technology/2016/jul/01/tesla-dri...
- felippee 9y agoTesla was not a self driving car, please stop confusing this. This case is in fact the first autonomous test vehicle caused fatality. There were at least several Tesla autopilot related fatalities and injuries, but I would seriously not put those into self driving bag.
- iooi 9y agoCan you provide a source? From all the articles I can find, the language is all pretty much the same: "Tesla driver killed while using autopilot" "The Tesla driver killed in the first known fatal crash involving a self-driving car" "It's been nearly a year and a half since Joshua Brown became the first person to die in a car driving itself." "Tesla bears some blame for self-driving crash death, feds say"
- dang 9y agoCould you please not use allcaps for emphasis in HN comments? This is in the site guidelines: https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html.
- iooi 9y agoSorry, I just pasted the text in the article.
- dahdum 9y agoTesla doesn’t have self driving capability, their autopilot is just driver assistance (like adaptive cruise control).
- jeremynixon 9y agoImportant and and missing: "[Uber] said it had suspended testing of its self-driving cars in Tempe, Pittsburgh, San Francisco and Toronto"[1] 1: https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html https://www.nytimes.com/2018/03/19/technology/uber-driverles...
- kartan 9y agoAgain... 'Uber has temporarily suspended the testing of its self-driving cars following the crash of one of them in Tempe, Ariz. The ride-hailing company had also been conducting experiments in Pittsburgh and San Francisco.' I was resumed shortly after. 27 Mar 2017 (1 year ago) https://spectrum.ieee.org/cars-that-think/transportation/self-driving/uber-crash-leads-company-to-suspend-robotaxi-testing https://spectrum.ieee.org/cars-that-think/transportation/sel...
- basura045478 9y agothat's SOP for every av program. have incident? ground the fleet. doesn't matter why, or who's at fault.
- itamarst 9y agoThe video says bicyclist and shows a bent bicycle. So pedestrian or bicyclist?
- stingrae 9y agoPerhaps they were walking their bicycle across the street.
- jaxbot 9y agoIt would explain the "outside a crosswalk" remark better if the person were riding the bike. This is one of those cases where video evidence should be subpoenaed, though. It's far too common for the police to accept the statement from the only party still alive, and come up with incorrect conclusions about what happened on the street.
- AYBABTME 9y agoSeems very unlikely to me that this case will be brushed off without police looking at video.
- bmm6o 9y agoI've heard that police reports often refer to all non-drivers as "pedestrians", even if they were riding a bike (which I learned after a neighbor was killed while riding a bike). I don't know if this is legalese or police jargon, but either way you would hope a journalist who covers these things could translate.
- DFHippie 9y agoA police officer in Nashville shouted at my wife for riding her bike in the road in accordance with Nashville law. Basically, he didn't know the law he was enforcing.
- xapata 9y agoUnfortunately, many police forces don't train the police on how to handle bicycles. For example, in many places riding on the sidewalk is illegal, yet police will suggest a cyclist get off the road and ride on the sidewalk. From studying many bicycle-related police reports, I was dismayed at how often I read the phrase "a pedestrian riding a bicycle."
- danso 9y agoGiven that so many of autonomous car accidents logged by the California DMV seem to be the fault of the human driver trying to take control, I’m surprised that the accident here reportedly happened in autonomous mode, which for all its flaws seems to have been good at not hitting things in front of it. In fact, seems like most of the CA accidents were the autonomous car being rear ended or side hit from other cars, usually for going too slow or stopping unexpectedly.
- outside2344 9y agoGiven how incompetent Uber is at regulation of anything else in their company, is this really a surprise?
- avoutthere 9y agoIt's a sad reality, but regardless of how many times per day a pedestrian is hit by a human-driven car, such incidents involving self-driving cars will be headline news for years to come.
- ambivalents 9y agoHaving a hard time sympathizing here. It's one thing to fear air travel based on the very few but very publicized plane incidents (considering all the data we have on the safety of air travel). It's another thing to hold these self-driving car companies accountable, considering a) the lack of data and history of such programs, and b) their touted benefit as a safer alternative to human-driven cars.
- deleted 9y ago[deleted]
- FeepingCreature 9y agoIt's not about sympathy. It's about one question: do they kill fewer or more people than humans per mile? If they kill fewer people, they can be run by a joint venture of Satan and the Mafia for all I care.
- bonzini 9y agoIf the miles are not enough, they kill less until they first kill someone. At which point they kill several orders of magnitude more. # of events per something are not always a statistically valid way to measure things.
- timmaah 9y agoThe video mentions she was on a bike and shows a mangled bicycle. Also the line markings on the street indicate there is a bike lane to the left of a right turn lane. Definitely very bad. https://www.google.com/maps/@33.4369934,-111.9429875,3a,75y,83.99h,72.74t/data=!3m6!1e1!3m4!1scUyILaxFs5z63AL2SupCJw!2e0!7i13312!8i6656 https://www.google.com/maps/@33.4369934,-111.9429875,3a,75y,...
- conductr 9y agoNot to be insensitive to the death. But, that bike lane design is just horrible. Are human drivers really known for respecting the "do not cross solid white line" rules? 9/10 drivers that realize at the last moment they need to turn right are going to quickly cross over this bike lane probably without much time to check their blind spot. If I was cycling on this path, I'd want to use the sidewalk and be extra cautious of peds, I don't trust drivers human or not.
- mason55 9y agoThere aren't a lot of options when you need to have cars turning on roads with bike lanes. At some point the car lane and the bike lane have to cross paths unless you're going to build a fully grade-separated bike lane. I suppose you could have a wall that separates the bike lane from the road except for a short area where cars can cross over, so that at least there's only a small space where the bikes & cars can interact, but that introduces a bunch of new problems (cars that can't see bikes behind the wall when they go to cross over, cars that run into the wall, probably even more swerving to get into the lane because your choices are do it RIGHT NOW or you're stuck/hit a wall).
- tylersmith 9y agoThey have barriers in some places in the US but they're not very common: https://imgur.com/a/gy8mq https://imgur.com/a/gy8mq
- DeRock 9y ago
- hardwaresofton 9y agoIt seems like a bunch of what-ifs that normally come up with self-driving cars are about to get answered and precedents are about to be set. I assume this case will also be one of the most well-recorded cases of a fatal car accident in history as well, given the amount of sensors and equiment on-board a self-driving car, along with eye witness testimony from the operator on board. Can't tell if Uber has just been incredibly unlucky as of late or if just enough of their employee-base is incompetent as to prevent them from just having a quiet year with no large failures.
- odammit 9y agoCurious how the numbers work out of number of miles [1] to number of deaths of autonomous vs standard vehicles. I know the scale is different but since this is the first death I’m curious if the percents fall in line. [1] is distance the right metric?
- jnbiche 9y agoPerhaps time as opposed to distance? After all, we drive much fewer miles in a city, but there are much greater opportunities for accidents, particularly pedestrian accidents.
- checkyoursudo 9y agoMaybe deaths per speed per time (or distance, since speed over time is the same as distance at speed). More deaths at higher speeds and fewer at lower would seem more likely. Purely using time or distance may skew the interpretation, if there are more deaths at some speed ranges than others.
- prh8 9y agoYes, these statistics are typically based on miles driven.
- jws 9y agoThis is an interesting metric. Although self driving test cars are rare, the whole point of their existence is to drive so they probably clock more hours than a normal car. About 5400 pedestrians are killed each year in the US. US drivers go 3.1 trillion miles a year. So they kill a pedestrian about every 5.7 billion miles. Last November, Waymo said they had 4 million self driven miles, so well short of statistically expecting to hit a pedestrian. In September of some unspecified year Axios claims Uber had self driven over 1 million miles. My estimate needs help, the distribution of pedestrian bearing roads and pedestrian free roads likely does not match from my total miles per year number and what carbot testers cover. Also, this may have been a cyclist death, which adds another 800 or so deaths per year. But, in any event, in rough numbers, Uber appears to have beat their expected time to pedestrian fatality by two or three orders of magnitude.
- matt4077 9y agoWhy am I not surprised that, among all the teams competing in this space, many of which have clocked in far more miles than them, Uber is the first one to kill someone? This may well just be bad luck. But I cannot shake the feeling that if Uber started an ice cream venture, they would store their molasses on a hill in a Boston. The only way to get “humanity” associated with Uber would involve an Uber zeppelin. Or it’s a conspiracy, because nothing is as threatening to Uber than autonomous cars. This is certain to invite more regulatory scrutiny. Just kidding... I think..
- Axsuul 9y agoYou mentioned bad luck and that could very well be it. Unless Uber starts having more incidents, it isn't fair to say that Uber's technology is inferior.
- jakeogh 9y agoCalling these pre-programmed multi-MJ wheeled computers "self driving" is foolish and deceptive.
- orliesaurus 9y agoNot to be the guy who says "I TOLD YOU SO" but it had to happen at some point, sadly & unfortunately - if this is the first (known) case of A.I. controlled cars killing humans, the number of casualties can only grow from now onwards
- JumpCrisscross 9y ago> if this is the first (known) case of A.I. controlled cars killing humans, the number of casualties can only grow from now onwards This is how counting works.
- wongarsu 9y agoEvery year between 30000 and 40000 Americans are killed in car accidents. With more self-driving cars on the road it comes as no surprise that self-driving cars will cause some of them.
- w_t_payne 9y agoTo ensure that all automotive software incorporates lessons learned from such fatalities, it would be beneficial to develop a common data set of (mostly synthetic) data replicating accident and 'near miss' scenarios. As we understand more about the risks associated with autonomous driving, we should expand and enrich this data-set, and to ensure public safety, testing against such a dataset should be part of NHTSA / Euro NCAP testing. I.e. NHTSA and Euro NCAP should start getting into the business of software testing.
- kaennar 9y agoDr. Mary Cummings has been working on talking to NHTSA about implementing V and V for autopilots/AI in unmanned vehicles for a few years now. She's also been compiling a dataset exactly like what you are talking about. I think the idea is to build a "Traincar of Reasonability" to test future autonomous vehicles with. You might want to check out her research https://hal.pratt.duke.edu/research https://hal.pratt.duke.edu/research
- pishpash 9y agoHow about not testing it on the unpaid public in incremental patches like this age of software "engineering" has decided it was a good idea to do?
- Someone1234 9y agoYou ultimately have to at some stage, since any test track is a biased test by its nature. It is more an issue of how sophisticated these vehicles should be before they're let loose on public roads. At some stage they have to be allowed onto public roads or they'd literally never make it into production.
- peterwwillis 9y agoSituations no self-driving car can avoid: - philosophical dilemma - physics-constrained reaction times - actions that violate the rules of the system Solutions: - protected car lanes - protected bike lanes - protected pedestrian lanes Reasons why these solutions are not put in place: - cost Until humans determine that the cost of human life is higher than the cost of upgrading infrastructure, we should accept human death as a regular part of autonomous driving, just the same as we do for non-autonomous driving. 37k dead people every year in the US due to human drivers. Top reasons for auto accidents today include inclement weather, reckless driving, speeding, driving under the influence, and distracted driving. In theory, most of those could be solved by autonomous driving. But then the list of reasons for accidents would change to whatever new reasons cause autonomous car accidents, such as damaged sensors, programming errors, equipment failure, road hazards, etc. Even with autonomous cars, we will still need protected lanes, and we will still never implement them, because we don't really care when people we don't know die.
- lainga 9y agoIf by "protected passenger lane" you mean putting a Jersey barrier between the sidewalk and the road, no thanks. Maybe I'm a spoiled suburbanite, but I can't help but recall that, scant a century ago, pedestrians could walk along or on the streets wherever they pleased.
- peterwwillis 9y agoNot specifically that one way. In order to allow transportation to co-exist with pedestrians without collisions, you need some kind of separation between the two. With subways, the protected lane is literally underground, but it does definitely have a protected lane. If you don't go under ground, you can go above ground, like several subways and metros do around the world. If you don't do either of these, you have to make concessions on the ground level. My personal preference would be tall fences around the roadway, and pedestrian bridges that go over or under the roadway (but both have problems). Another would be to still have the fences, but automate some sliding barricades that would activate when traffic halted, which is somewhat like how train crossings work. We could also implement hybrid methods, like that at Shibuya crossing, for very congested intersections.
- johnstew 9y agoWhy is Uber allowed on public roads?
- jakeogh 9y agoThis has little to nothing to do with the specific company (although is a convenient deflection ATM). The very idea that pre-programmed computers can deal with driving is the fundamental problem. In time, people will realize that, but at the moment the "solution" is to "patch" and make more laws to hide the truth: AI has nothing to do with intelligence. Ultimately they will blame humans, humans are the bugs in their code.
- vokep 9y ago"Artificial Intelligence has nothing do to with intelligence" welp I don't even know what to make of that
- checkyoursudo 9y agoI'm not the original poster, but maybe they just mean that as it stands right now, artificial intelligence refers to nothing that is actually intelligent in a way that an average person probably thinks about intelligence, and it's a little hard to see where the leap to actual intelligence is going to come. Maybe?
- joefourier 9y agoAs far as I know all self-driving car programs use some form of machine learning, so they aren't exactly "pre-programmed" in the sense of good old-fashioned AI based on strict, pre-determined rules. What exactly do you mean by "deal with driving"? Drive without a single accident, ever? That's obviously impossible in practice. Drive better than humans, who in 2016 killed 37,461 people in the US alone? I don't see how that would be impossible - human drivers have a limited field of view, slow response times (average time to break is ~2.3 seconds), and are frequently distracted, sleepy, drunk, etc.
- 9y ago
- pcthrowaway 9y agoThe people leading the development should demonstrate that they can stop for pedestrians by personally jumping out in front of them on a closed test road. If they're not able to demonstrate this, they shouldn't be putting them on public roads.
- deleted 9y ago[deleted]
- Alex3917 9y agoWhy? It’s not a problem if Uber kills pedestrians, even in situations where it’s completely avoidable. It’s only (legally) a problem if they’re violating the rules of the road while doing so.
- wtetzner 9y ago> It’s only (legally) a problem if they’re violating the rules of the road while doing so. I doubt that's true, but even if it were, I believe the rules of the road are "always yield to pedestrians, even if you have the right-of-way".
- sevensor 9y agoIn general motorists are not held strongly accountable for killing pedestrians or cyclists. Juries in the U.S. are very reluctant to convict. I'm not sure Uber can rely on that, however. While juries are reluctant to convict drivers, driverless vehicles are another matter. As I said in another comment, they're going to have to invent a crime that puts cyclists and pedestrians positively at fault in these situations.
- pc86 9y agoI think their (idiotically stated) point was that there are plenty of situation where you can kill someone on the road in an accident and not have any legal liability for it.
- deleted 9y ago
- Avamander 9y agoMy sympathies to the victim, but this post with the XKCD substitution plugin made my sides leave orbit.
- dang 9y agoPlease don't do this here.
- ocdtrekkie 9y agoThe reason self-driving car companies have flocked to Arizona is that Arizona chose to pretty much completely deregulate them: They don't even have to report statistics to the state like they do in California. It's unfortunate, but unsurprising, the first pedestrian killed by an experimental self-driving car allowed on public roads was in Arizona.
- jonathanyc 9y agoWhat will the consequences of this person’s killing be? Will someone lose out on a promotion, or miss their performance bonus? We need to discuss how the developers self-driving cars will be held accountable for the crimes they commit. There is no reason the person who programs or the person who makes money from a self-driving car should be held less accountable for a crime that if committed directly by a person would almost certainly result in jail time. You can’t replace yourself with a computer program and then choose to take only the benefits and not the responsibilities.
- cliffordkeeney 9y agoThis is crazy. The developers likely have no say in where and when the cars go out on public roads. That's obviously a decision for someone higher up in the company. The executives should be held accountable, not the developers.
- jonathanyc 9y agoI partially agree. “There is no reason the person who programs or the person who makes money from a self-driving car...” The person who profits the most should be held the most responsible. But the separation of roles between the executives and the developers is likely to mean that no one gets punished at all.
- cgmg 9y agoWhy should the person who profits most be held the most responsible? Suppose the person in charge of safety clearance makes less money than the original developer. How does that shift responsibility to the developer, as opposed to the situation where the developer makes less money?
- InclinedPlane 9y agoThis was inevitable. Some of the developers for self-driving vehicles are immensely careful, some are not. And the regulatory oversight is currently not sufficient to allow the one to operate but not the other.
- lostlogin 9y agoI wonder how companies handle these situations? Most places have clear requirements eg stop, check if anyone is injured, contact police, remove debris from road if safe to do so. These things aren’t so easy without a driver.
- 3pt14159 9y agoLook, I'm all for taking self-driving cars seriously. I've written about how they're effectively WMDs if the software update computer gets owned. I've also frequently commented about the unethical practices that Uber has taken in the past. That being said, let's not over-react. This is a single death. These are going to happen. Right now self-driving cars are essentially teenagers learning how to drive. En mass there is going to be a death here or there, but, also en mass, we're going to have a permanently safer road once they've learned, if we can secure them from cyber attack. Try to avoid all-or-nothing thinking here. Definitely advocate for regulations, and maybe Uber wasn't safe enough, but people are either going to die from self-driving cars or they're going to die from self-driving cars taking too long because of public outrage.
- gamblor956 9y agoThis didn't need to happen. It's indefensible that it did. And there's still no proof that self-driving cars are safer than humans when confronted with novel situations, i.e., the situations most likely to result in injuries and fatalities. If anything, the evidence thus far is that self-driving cars are more dangerous than ones driving by humans.
- Axsuul 9y agoHow are we to judge that self-driving cars are more dangerous from simply one death? The proper comparison to be made should be between miles driven from autonomous vehicles vs. those of humans and then looking at the incident rates.
- 3pt14159 9y agoThe research I've seen is that for areas with good conditions year round they're currently safer than a subset of the population (those in at least one automotive accident in the past 5 years, or something like that). Still not better than your average driver, but even if we start by replacing alcoholics and routinely poor drivers the net impact on safety goes up.
- deleted 9y ago
- codecamper 9y agoInteresting nobody used the words jail or murder yet. Not even manslaughter. Just because there was no driver does not keep it from being a crime. Do the engineers go to jail or do the managers or the investors?
- stordoff 9y agoIn a typical crash, you don't jump straight to "this was murder/manslaughter"/"who is going to jail". At a bare minimum, you have to establish fault. I don't see why this case would be any different.
- WHoWHo 9y agoWhat happens when a self driving car in the future from a service is driving empty back to some parking? And hits someone? Does it call ambulance or police?
- rjromero 9y agoI’m pretty sure if Arizona’s lawmakers understood the underlying nature of machine learning and autonomous driving, they wouldn’t allow self driving cars to operate. I don’t care how good your models and data are, until you’re able to write an algorithm that can fully handle and learn from a situation it was completely unprepared for, it will always encounter edge cases like this. This is what happens when we have a society of people saying AI is already here, people like Elon Musk saying AI is a “significant threat” despite "AI" being essentially a black box statistical model in it's current form. From what I’ve seen, the general public thinks we’re 20+ years of AI than we really are. You need general AI before AI can drive a car, full stop. Otherwise, you need to isolate roads from other human drivers pedestrians, and cyclists. It just won’t be reasonably safe until then.
- ggggtez 9y ago>You need general AI before AI can drive a car 1.3 million people died in the USA from car crashes in 2017. An additional 20-50 million are injured. You don't need to be perfect, you just need to be better than the baseline. That said, and to be fair to your feelings, Uber certainly is not better. This is a fact I'm sure lawmakers in Arizona are discussing right now.
- woliveirajr 9y agoThis comes just few days after this: "When an AI finally kills someone, who will be responsible?" url: https://news.ycombinator.com/item?id=16584862 https://news.ycombinator.com/item?id=16584862
- justboxing 9y agoHave to quote Prof. Teddy here. Context: How new technology is introduced on public streets and we have no choice or say on whether we want it or not, even if it endangers us and gets us killed. > When motor vehicles were introduced they appeared to increase man’s freedom. They took no freedom away from the walking man, no one had to have an automobile if he didn’t want one, and anyone who did choose to buy an automobile could travel much faster and farther than a walking man. But the introduction of motorized transport soon changed society in such a way as to restrict greatly man’s freedom of locomotion. When automobiles became numerous, it became necessary to regulate their use extensively. In a car, especially in densely populated areas, one cannot just go where one likes at one’s own pace one’s movement is governed by the flow of traffic and by various traffic laws. and > Even the walker’s freedom is now greatly restricted. In the city he continually has to stop to wait for traffic lights that are designed mainly to serve auto traffic. In the country, motor traffic makes it dangerous and unpleasant to walk along the highway. (Note this important point that we have just illustrated with the case of motorized transport: When a new item of technology is introduced as an option that an individual can accept or not as he chooses, it does not necessarily REMAIN optional. In many cases the new technology changes society in such a way that people eventually find themselves FORCED to use it.) Source: The Mainfesto: INDUSTRIAL SOCIETY AND ITS FUTURE http://www.washingtonpost.com/wp-srv/national/longterm/unabomber/manifesto.text.htm http://www.washingtonpost.com/wp-srv/national/longterm/unabo...
- RyanZAG 9y agoGreat points and extremely important. But at the same time, I don't personally want to go back to an age before automobiles became commonplace. They're too useful to me. Is that selfish? Sure. But our lives are all shaped by our wants, not by our needs.
- bobthepanda 9y agoI don't think that anyone is asking for a return to nature, but America has shown that adopting the automobile as the primary mode of transportation and adapting all of society wholesale for it has serious side effects. Rather than promote it as (essentially) the only option, automobiles should be a tool in a toolkit of transportation methods.
- df5t0rw 9y ago[unconstructive but still..] So the day I could be emprisoned because of an error of coding... Like a segfault on an highway... as finally came :D Is the disclamer "no waranty of anykind" shield us from that kind of thing ? ;) (I code on some mainstream C libraries)
- Jack000 9y agoyou already can? our lives depend on all kinds of software every day. In Canada at least you'd need a P.Eng to work on stuff that directly endanger lives. https://en.wikipedia.org/wiki/Therac-25 https://en.wikipedia.org/wiki/Therac-25
- alacombe 9y agoIf I'm not mistaken, P.Eng are merely needed the rubber stamping, not to do the grunt work. I doubt they'll go through all the specs, re-run all the simulations, and verify all the parameters. Also, where is your P.Eng be any useful to justify the learning coefficients of your AI, or to protect about the cosmic ray bit-flip in the hardware your proven correct software is running on ?
- gowld 9y agoEngineering for safety is about testing, not manufacturing quality. Or course you need to build quality in order to pass tests, but perfection is not a goal of any component. Tests measure quality, and failsafes and control layers reduce failure rates.
- df5t0rw 9y agoThanks for the Therac-25 reference :)
- loup-vaillant 9y agoIf you don't offer warranties, your user will have to review your library so they can offer warranties. Someone has to sign that stuff as "production worthy or I go to prison".
- smallgovt 9y agoNot to dismiss the tragedy of this incident, but it should be expected that self-driving cars kill pedestrians -- just at a rate lower than what's expected from human drivers. Perhaps there's a better metric to look at, but I'd like to see number of deaths caused per miles driven. If Uber's self-driving cars are killing more pedestrians than a human driver would, we have a huge problem, but I'd be willing to bet they're at least an order of magnitude safer in this respect.
- macintux 9y agoFewer people will die (probably). The problem is that different people will die, and you can't celebrate with the families of the people who were slated to die and didn't.
- falcolas 9y agoAnd different people will "kill". It won't be the drunk drivers, or the road ragers, or the people texting on phones, it will be anyone unfortunate enough to be in the car at the time. A businessman. A politician. A cop. A teacher. And to say that "it's not their fault" and "it could have happened to anyone" will be cold comfort to those who just watched their car mow down an innocent, and there was nothing they could do to stop it.
- macintux 9y agoThat’s an excellent point, one I hadn’t considered. Of course any number of accidents happen today to people whose only mistake is not being prescient, or at least not driving sufficiently paranoid to avoid something that arises unexpectedly.
- vgf 9y agoI bet people at Volvo are feeling a bit anxious at the moment for that deal: https://www.media.volvocars.com/global/en-us/media/pressreleases/194795/volvo-cars-and-uber-join-forces-to-develop-autonomous-driving-cars https://www.media.volvocars.com/global/en-us/media/pressrele...
- remind_me_again 9y agoWhat I don't get is that if this is a test car, how come the the driver did not take over the helm immediately. The driver in that car should be in full alert as if driving the vehicle himself and jump in as needed. Test should not mean to let loose an autonomous car.
- ggggtez 9y agoUnlike all the other comments discussing charges, this one actually has a good point. Presumably the safety driver is there specifically to prevent this from happening. They'd still have to show that the driver was personally at fault. That would mean showing that the driver was e.g. sleeping/not paying enough attention, or something similar. At the very least, it might call into question whether safety drivers are actually providing any real safety. Localities may start to crack down on using that kind of excuse for self-driving tests.
- phyzome 9y agoDo you think you could maintain the required state of alertness, focus, and engagement necessary to hit the brakes and turn the wheel after 30 minutes (or whatever) of just sitting passively as the car drove you around? I don't think the "safety drivers" do much other than provide liability-shifting for the company.
- gowld 9y agothe drivers are employed by the company, doing company work. They may (misleadingly) shift the optics away from the automation, but they don't shift the liability.
- phyzome 9y agoSure they do, when Uber (metaphorically) throws the driver under the bus for failing in their duties as "safety driver". >:-)
- gowld 9y agoA test pseudo-"driver" ought to be doing stuff like orally making notes of the environment and car operation, collecting data the sensors might be missing, and monitoring the car's automated judgement. As a related effect, the human should be ready to emergency brake or swerve.
- fabian2k 9y agoUnless this was a situation that was impossible to anticipate and avoid, this looks bad. It would mean that both, the autonomous driving system and the safety driver failed. Not hitting pedestrians should be close to the top in priority, so while failures of the software are certainly expected during this kind of test, this is one of the worst kinds of failures that should have received a lot of attention before ever putting the vehicles on a public road. The safety driver failing makes me wonder how well qualified they are, or if there is an issue with staying alert for long times without actually driving the car.
- grecy 9y agoTo play Devil's advocate, there were over 100 people killed in the US TODAY from non-autonomous vehicles [1]. Obviously we'd need to know the number of miles driven in each category to get a meaningful comparison, but let's all keep in mind a USA where only one person per day is killed on the roads would be a two order of magnitude improvement over today. [1] https://en.wikipedia.org/wiki/Motor_vehicle_fatality_rate_in_U.S._by_year https://en.wikipedia.org/wiki/Motor_vehicle_fatality_rate_in...
- phyzome 9y agoIf you look elsewhere in the comments, you'll see some numbers. Autonomous vehicles are new enough that they come out as more dangerous even with one death.
- mdev 9y agoI wonder how software updates and are validated and tested before going to production in autonomous cars. This is scary - imagine being a developer responsible for a similar malfunction. I'm not suggesting that was the case here - just think this might need as much validation as medical equipment (hoping that it won't stifle innovation).
- amelius 9y ago> Car was autonomous with driver behind wheel Let me make a prediction. Uber will claim that the driver was in control of the vehicle at the moment of the accident. And the "driver" will receive a bonus payment in the coming months.
- swyx 9y agoI'm saddened by this incident but have thought a lot about this eventuality. there are a few levels of societal acceptance of self driving car death outcomes i can think of: A - Human equivalent: self driving car obeys reasonable rules that a human also would eg minimum speed on a highway and kills someone B - Trolley problem: (very artificial scenario) self driving car has to choose between killing N or M people where N > M and wrongly (in hindsight) chooses N C - Car fault: self driving car kills someone in a situation where no human would have As a society we would probably accept A easily but B starts to get shaky. C currently looks completely unacceptable, BUT I would argue that society has to get to a point where even C is ok conditional on the probable result that overall car deaths decline dramatically. In other words we will have to get to a point where individual deaths are extremely regrettable but the overall death reduction of adopting self driving cars are so undeniable that the individual deaths can be discussed without also talking about banning SDCs in the same breath.
- rimliu 9y agoHow does it work out? I mean you got a situation wher SDC kills someone where no human driver would, but somehow it gets safer?
- swyx 9y agoyes, because in aggregate the deaths are still reduced. we need society to get past individual death stories (which are very sad and we should do everything we can to prevent it) and not let them distract from the overall need for SDCs
- RcouF1uZ4gsC 9y agoSelf driving cars are one of the things where we absolutely cannot afford to do "move fast and break things". If there was any whiff of shortcutting, poeple need to go to jail and Uber should be bankrupted by penalties and lawsuits.
- mtgx 9y agoThe last time I heard this, the first thing that came to my mind was "I sure hope Facebook isn't going into self-driving cars." And then I learned Facebook is going into self-driving cars. Sigh.
- cdolan 9y agoDevil's Advocate argument here, but have you read books on our space race in the 60s? Should NASA have been bankrupted by penalties and lawsuits when Apollo 1 had its accident?
- azdle 9y agoIf they were dropping rockets on people standing on street corners. Yes, 100%. Your example is different because it was deaths of people involved in the projects who knew there were risks and agreed to them.
- Jagat 9y agoCan we please not overreact and send the whole self-driving research down the drain? What does the statistics say? How many miles have the self-driving cars driven, and how many deaths were they responsible for? How does it compare to a human driver? When a million humans drive a car for a mile, and 1 of them results in a death, it's easy to pinpoint the blame on a "random drunk/distracted driver". How'bout start thinking of the self-driving software as a combination of all human drivers, with just a much smaller odds of having a drunk/sun-blinded/distracted driver than an average human driver.
- objclxt 9y ago> What does the statistics say? How many miles have the self-driving cars driven, and how many deaths were they responsible for? How does it compare to a human driver? As of December 2017 Uber had driven 2 million autonomous miles[1]. Let's be generous and double that, so 4 million. The NHTSA reports a fatality rate (including pedestrians, cyclists, and drivers) of 1.25 deaths per 100 million miles[2], twenty five times the distance Uber has driven. You probably shouldn't extrapolate or infer anything between those two statistics, they're pretty meaningless because we don't have nearly enough data on self driving cars. But since you asked the question, that's the benchmark: 1.25 deaths per 100 million miles. [1]: https://www.forbes.com/sites/bizcarson/2017/12/22/ubers-self-driving-cars-2-million-miles/#69d4e968a4fe https://www.forbes.com/sites/bizcarson/2017/12/22/ubers-self... [2]: https://en.wikipedia.org/wiki/Transportation_safety_in_the_United_States https://en.wikipedia.org/wiki/Transportation_safety_in_the_U...
- rjvir 9y agoScaling those numbers paints a poor picture for Uber. Assuming 3 million total miles autonomously driven thus far from Uber's program: - Uber autonomous: 33.3 deaths per 100 million miles - Waymo: 0 deaths per 100 million miles - National average: 1.25 deaths per 100 million miles Of course, the Uber and Waymo numbers are from a small sample size. But there's also the bayesian prior that Uber has been grossly negligent and reckless in other aspects of their business, in addition to reports that their self-driving cars have had tons of other blatant issues like running red lights. It seems reasonably possible that an Uber self-driving car is about as safe as a drunk driver. DUIs send people to jail - what's the punishment for Uber?
- VikingCoder 9y ago"Uber has paused self-driving operations in Phoenix, Pittsburgh, San Francisco and Toronto, which is a standard move, the company says." ...there's a "standard move" when one of their cars kills someone? I don't think that really came across the way they wanted it to.
- richjdsmith 9y agoThis will be the first major test of liability and insurance with a self-driving vehicle.
- tracker1 9y agoReally? This is a completely new tech, and process. How is any reaction "a standard move?" I guess it could be standard for any new tech to result in a death from autonomous machinery. In any case, things like this are why I don't think fully autonomous is nearly ready in city environments. I'm not saying it isn't close, and shouldn't be worked on. I just don't think the intelligence systems are near as worked out as they should be. Not to mention the level of sensors needed.
- Tobba_ 9y agoI'm sure that pile of data will gain intelligence if we stir it hard enough. Any moment now.
- Axsuul 9y agoSad to hear it's happened this soon but this was inevitable.
- austinhutch 9y agoThere may be no company I trust less to be open and honest about this than Uber. The arms race between companies will likely keep the most important lessons from this event proprietary. I'm very much not looking forward to hearing execs answer for this as I'm sure it will have the same amount of humanity as the rest of their comms.
- WhompingWindows 9y agoThis is my thought as well. Compared with Waymo, Cruise/GM, Tesla, Lyft, and the many other start-ups in this space, I think Uber is the least ethically scrupulous. I also doubt their self driving tech is as advanced as many of the other players, and I wonder if those other companies would have been able to handle this situation.
- dmode 9y agoI know when Uber was stopped by CA DMV to operate its self driving cars without a permit, the Arizona governor went all out to promote the state as a beacon of business friendliness and deregulation etc. etc. Perhaps, when something is as critical as self-driving cars going around along with pedestrians and bikes and other vehicles, a more cautious and deliberate approach is warranted ?
- Tiktaalik 9y agoIn the early 20th century the automobile industry mobilized to downplay the deadly threat automobiles posed to pedestrians, and lobbied to create new laws to frame pedestrians as being at fault instead of car drivers (eg. jaywalking). I expect we'll soon see tech companies do the same in order to favour their autonomous automobile businesses at the expense of pedestrians and cyclists.
- burlesona 9y agoThis. There are many posts on this thread suggesting we could fix all this by lowering speed limits, etc. That's been known for a hundred years at this point. If you want to get up on the history you can grab a copy of "Fighting Traffic," by Peter Norton. He goes through all the efforts cities made in the 1920's to limit cars, and how the motor lobby formed in opposition to this and little by little reversed the tables to the situation we find ourselves in today. https://mitpress.mit.edu/books/fighting-traffic https://mitpress.mit.edu/books/fighting-traffic
- mlinksva 9y agoOr shorter version https://www.researchgate.net/publication/236825193_Street_Rivals_Jaywalking_and_the_Invention_of_the_Motor_Age_Street https://www.researchgate.net/publication/236825193_Street_Ri... or podcast version https://99percentinvisible.org/episode/episode-76-the-modern-moloch/ https://99percentinvisible.org/episode/episode-76-the-modern... Indeed it has been known for a long time. This is an opportunity to reverse bad decisions made a century ago, regardless of how quickly self-driving cars actually are adopted. https://www.strongtowns.org/slowthecars/ https://www.strongtowns.org/slowthecars/
- lr4444lr 9y agoMeanwhile... https://www.azcentral.com/story/news/local/arizona/2018/03/01/arizona-has-highest-rate-pedestrian-deaths-united-states-report-says/383640002/ https://www.azcentral.com/story/news/local/arizona/2018/03/0...
- abalone 9y agoIt's likely this was actually a bicyclist, not a pedestrian. The police are saying pedestrian walking outside the crosswalk but here's a picture of the crumpled bicycle: https://twitter.com/daiwaka/status/975767445859287042 https://twitter.com/daiwaka/status/975767445859287042 You can see it's next to a sign. That sign lets us determine exactly where it happened on Google street view: https://www.google.com/maps/@33.4370667,-111.9430321,3a,75y,132.91h,64.25t/data=!3m6!1e1!3m4!1ss_YmQlzA3ace0P2LVk4wwA!2e0!7i13312!8i6656 https://www.google.com/maps/@33.4370667,-111.9430321,3a,75y,... It's exactly where the vehicle lane crosses the bike line approaching the intersection. Mostly likely the Uber and bike collided when the Uber was crossing into the right turn lane.
- pro_zac 9y agoThe news video in the original post also says bicyclist. Speed limit goes up to 45 mph just before the bridge.
- davesque 9y agoIsn't it reaching to see a picture of a bicycle near a sign and then conclude that the accident must have happened exactly next to or near the sign? Maybe the police/witnesses dragged the bicycle to that location?
- abalone 9y agoNah. The Uber likely stopped in its tracks and it's in the picture too. You can see an official collecting evidence at the scene. The bicycle may have been pulled onto the sidewalk but it would be the sidewalk near the accident, not far away.
- dang 9y agoCould you please not use allcaps for emphasis in HN comments? This is in the site guidelines: https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html.
- sdfget434 9y agoThat car has to have a dashcam -- what's the current caselaw with regards to the 5th amendment?
- CobrastanJorji 9y agoI'm no lawyer, but I imagine that it wouldn't be hard to get a warrant for the dashcam footage. The fifth amendment is about speech, not possessions. Otherwise, all warrants would violate the fifth amendment.
- kaibones 9y agoI see the Waymo cars while I walk to lunch (AZ) quite often. One time while walking through the crosswalk a Waymo turning right cut me off as I started into the crosswalk despite my having the walk indicator. This seems to be a very difficult scenario for a self-driving car as there are often people at the corner that are either crossing the other direction or just waiting on the corner. I sent them a note via their feedback link, but never heard back.
- stevenwoo 9y agoThis is a non trivial situation for human drivers, too, when I am on a bicycle or driving a car I have to wait and look at the pedestrian until I am sure of their intention. That seems like a very difficult problem in that a lot of times people are on their phone or watching a child or dog, I often have to slow to a standstill and speak to people to ask them what they are planning on doing.
- mikelward 9y agoIndeed. Right on red is unsafe for pedestrians. I guess at least the requirement to stop before turning helps ensure the speed of impact has minimal consequences. As a driver, there are certain heuristics, e.g. did my traffic light just go red, or is the pedestrian signal/traffic light in the same direction about to go green.
- linkregister 9y agoI think the situation was been right on green, which I argue is more dangerous for pedestrians. The answer is to do what denser European cities do, which is to have pedestrian crossing signals have their own turn while all vehicle lights are red.
- gexla 9y agoUber: 1 Pedestrians: 0 Game on.
- dang 9y agoPlease don't do this here.
- Ajedi32 9y agoSo this is it then? First fatal accident involving a fully self-driving car which might have actually been the car's fault? Well, it was obviously going to happen sooner or later. It'll be interesting to see what the fallout is. Up until now regulators have been, surprisingly, taking a pretty relaxed approach to regulation of self-driving cars. Hopefully this one accident doesn't impede development on other autonomous car programs too much.
- abalone 9y agoThis may not have been an unexpected circumstance. The "pedestrian outside of the crosswalk" report is likely wrong. There is visual evidence that strongly supports that this was a case of the Uber hitting a bicyclist while merging into the right turn lane. Here's a picture of the crumpled bicycle (note dent on the front right of the car): https://twitter.com/daiwaka/status/975767445859287042 https://twitter.com/daiwaka/status/975767445859287042 The sign it is lying next to lets us locate the exact point of the collision on Google street view: https://www.google.com/maps/@33.4370667,-111.9430321,3a,75y,132.91h,64.25t/data=!3m6!1e1!3m4!1ss_YmQlzA3ace0P2LVk4wwA!2e0!7i13312!8i6656 https://www.google.com/maps/@33.4370667,-111.9430321,3a,75y,... It's right where the vehicle lane crosses the bike lane approaching the intersection. Very unlikely a pedestrian was walking a bike there. Much more likely the Uber hit the bicycle while merging. EDIT: I take back "very unlikely" a pedestrian was crossing there. There is in fact a very weird "X" pathway in the median that pedestrians are not supposed to be in. I didn't see that until I looked at the satellite view.[1] So possibly she emerged from there and was walking her bike across the street. That still looks pretty bad for Uber though, since that street is a straight shot with clear visibility and the dent's on the right side of the car. Meaning it would have swerved left to avoid a late-detected obstacle rather than swerve right away from her entering the roadway. She also would have literally had to walk straight into oncoming traffic. I still think bicyclist is the most likely scenario and it's odd the PD doesn't mention the crumpled bicycle. [1] https://www.google.com/maps/@33.4365931,-111.9425027,198m/data=!3m1!1e3 https://www.google.com/maps/@33.4365931,-111.9425027,198m/da... (street view shows a "no pedestrians" sign)
- jessaustin 9y agoLots of confusion! It seemed the video was for an injury collision rather than a fatality? This is what we get from posting a Cincinnati source for an event that occurred in Tempe.
- omarforgotpwd 9y agoWow, that's really bad! Easy to see how the code didn't factor in the possibility of someone using the bike lane, which is a very bad look for Uber.
- skarap 9y agoTo repeat my comment from a previous discussion which brought a lot of downvotes: what happens when (not if) a self-driving car runs-over and kills someone (e.g. because of a software bug)? Do such cases cause criminal penalties? Who is penalized? Or will all cases of autonomous car accidents with deaths become civil cases? If so - do human drivers get the same new rules or if they kill someone by accident (because they got distracted) they still go to jail? Is that fair? In this particular case I assume the operator will be thrown under the bus, which is also unfair.
- foobaw 9y agoI know quite a people working on this at Uber ATG. They are in panic mode.
- untog 9y agoThis opens up an interesting question going forward. We can't rely on Uber themselves to analyse the telemetry data and come to a conclusion, they're biased. So really, we need self driving car companies to turn over accident telemetry data to the police. But the police are ill equipped to process that data. We need law enforcement to be able to keep pace with advances in technology and let's face it, they're not going to have the money to employ data analysts with the required skills. Do we need a national body for this? Is there any hope of a Republican government spending the required money to do so? (no)
- dmoy 9y agoOn the one hand I'd say give it to the NTSB, because historically they are really good at this sort of thing. On the other hand, I'd wonder if increasing NTSB scope this much would drastically decrease the average quality of NTSB's work. Scaling ain't easy.
- jeiting 9y agoYeah, pilot here. NTSB is the right organization to handle this. The investigators over there do an amazing job of determining root cause from forensic evidence. I assume that will be the process here.
- kortex 9y agoNTSB is there to handle civilian transportation accident investigations. Most automotive accidents are not very "surprising", which leaves them mostly dealing with non-personal transportation accidents. We are about to have a rapid increase in surprising, non-personal transportation accidents, so I seriously hope they are afforded the resources to deal with the influx as AVs come online.
- martin_bech 9y agoShouldnt this actually be pretty easy? The system on the Uber, should have a massive amount of cameras, and lidar. Basicly dashcams on speed, recording multiple angles of the accident. I would assume that everything is beeing recorded, for debug/Testing purposes.
- DangerousPie 9y agoI know this is a slightly insensitive question to ask right now, but assuming that what happened was that the car tried to turn right and the cyclist came from behind and crossed into its path[0]: Who would actually have been in the wrong? I cycle along paths like this from time to time myself, and I always assume that I should let a turning car pass in front of me. As soon as I see the turn signal I will either fall back or even pass into the car lane to overtake on the other side. Of course that's in part because I know I would lose the fight anyway, but also because I think I am not actually supposed to be "overtaking" them on the right side, so they have the right of way before me. What do the rules say in this case? [0] This is based on this link posted elsewhere: https://www.google.com/maps/@33.4370667,-111.9430321,3a,75y,132.91h,64.25t/data=!3m6!1e1!3m4!1ss_YmQlzA3ace0P2LVk4wwA!2e0!7i13312!8i6656 https://www.google.com/maps/@33.4370667,-111.9430321,3a,75y,...
- ggggtez 9y agoThese things tend to be based on the factual evidence of the case, as well as local and state laws. Talk to your lawyer.
- phyzome 9y agoDepending on the state law, the right-turning car probably is supposed to yield to a cyclist in the bike lane going straight. But of course, every experienced cyclist knows that what is right is not what is safe; you should aim to travel just behind the car's rear bumper to give yourself time to stop if they swerve right. This is the insanity of (most) bike lanes, that you have a lane to the right of a right-turn lane that can go straight. And that's why I don't use most bike lanes. They're trouble.
- linkregister 9y agoThat move is against the law, at least in San Francisco. The vehicle should enter the bike lane to turn right.
- propman 9y agoThis is purely an emotional initial reaction to hearing this without knowing most facts, but I just have to vent and for once be part of the outrage culture and make emotionally charged statements before more info comes out. Uber ruining self driving cars that can save 20k lives each year and improve our economy and get millions out of poverty and improve everyone's quality of life by being short sighted, financial driven, and bringing the worst aspects of Silicon Valley to the extreme. I am so sorry to everyone at Google and Waymo who have tried so hard to not let anything like this happen by being extremely cautious and safe. Ughhhh I feel so frustrated, this is going to cause so much backlash. Travis, Anthony and whoever else pushed for this to go ahead without caring about safety is evil. This action doesn't have a direct correlation of evil like directly murdering someone. But these highly intelligent individuals ignored their conscience and the easy deduction that actions to compromise safety, laws, decency for quick profit are immoral. Whether they admit it or not they KNEW that this was a high possibility and refused to take precautions creating this awful culture. 20k lives a year, and all the benifits that will be delayed for years are on their head. They won't face any consequences, just convince themselves of absolution of guilt and do nothing to remedy the situation, but I have no respect for them.
- Obi_Juan_Kenobi 9y ago> 20k lives each year Road deaths are ~40k each year in the US alone. I agree about Uber; smells like shit, looks like shit, tastes like shit, you better believe it's shit to the core.
- Tharkun 9y agoIf only there was this much outrage and discussion every time a human driver killed a pedestrian.
- 4rgento 9y agoI wonder how many different "cultures" do drivers have? People from different localities drive differently. I hope they use drivers from say, NY, LA, and various small towns to teach the AI. People that lives in towns with ~ 10k people drive differently that a new yorker on the same town. EDIT: They might be training with a biased sample
- make3 9y agoWhy am I not surprised Uber is the first company to kill someone. With their top notch ethics, ah. This actually makes me really angry, more than I had anticipated.
- jehlakj 9y agoJust curious: Do tech companies “pay” the state so they can try out their latest and greatest? Or do they look for states with the least amount of restrictions?
- Zarath 9y agoIsn't this just lobbying?
- apeace 9y agoI'm really shocked at the trend in comments here. Yes, we get it. Fatalities will happen sometimes, they are unavoidable sometimes, and what matters in the long run is if we can achieve a significant overall reduction in fatalities. But my god, a person was just killed by a computer. Can't we have some compassion and humility? Let's, as a community, set the standard for how we will react to these events. Let's make sure Uber releases detailed data on what happened, whether they were at fault or not. Let's hold the media accountable for their reporting. Let's mourn the loss of life and think about how we can solve these problems. But for christ's sake, please stop posting the same thing everybody already knows, which gets posted on HN whenever a self-driving article comes out. Can't we do better? --- EDIT: I clarified what I meant here [1] Wasn't trying to say this thread should be all about mourning. This is HN so we should talk about technology, even when a person died. I'm pointing out one specific argument that gets repeated over and over in place of a substantive discussion, and I think we can do better. [1] https://news.ycombinator.com/item?id=16621589 https://news.ycombinator.com/item?id=16621589
- davesque 9y agoWhat trend in the comments is bothering you? It's a little unclear from your comment.
- ryanwaggoner 9y agoFatalities will happen sometimes, they are unavoidable sometimes, and what matters in the long run is if we can achieve a significant overall reduction in fatalities. I haven't even read any of the comments on this story yet, and this type of pro-self-driving-car response is what I expect to be in the majority. That and anything anti-Uber :)
- apeace 9y agoThe trend I'm seeing is to immediately defend self-driving cars based on "but if you look at it statistically I'm willing to bet this is better than human drivers". It is as if HN users expect the news headline to be: "an event occurs which is statistically speaking non-anomalous". If one doesn't feel we have enough data to draw conclusions yet, then sure, fine. But a person just died. This is a newsworthy story and it deserves our best attention and discussion, not repetition of something obvious ad nauseam.
- skookumchuck 9y agoIf human driven cars kill 1000 people a year, and autonomous cars kill 100, will it be politically unacceptable to switch to autonomous? I suspect it will be.
- awakeasleep 9y agoA portion of that depends on the funding on either side of the issue. If the autonomous cars kill 1100 per year, but autonomous car companies fund a bunch of studies saying the benefits outweigh the drawbacks, it'll be politically acceptable.
- skookumchuck 9y agoPeople think emotionally, not rationally. People have all sorts of greatly distorted views on the risks of various activities.
- JepZ 9y agoWhy am I not surprised that this happend with an Uber self driving car? In fact, their culture of ignoring rules and common sense might be okay for business development, but with respect to human safety it is just irresponsible and inhuman when it comes to self driving cars.
- maxyme 9y agoIf you're familiar with that part of ASU campus you honestly could have seen this coming. There are a few different self driving cars in Tempe (Waymo, Uber, GM...) and Uber drives by far the most aggressive. They drive on a pedestrian heavy road and drive faster than most of traffic. They accelerate rapidly when a light changes and can brake hard. There are always tons of pedestrians in the area and it isn't uncommon to almost get run offer when even crossing during the day.
- vamin 9y agoI wonder if it's because Uber algorithms are trained using Uber driver data (taxi drivers tend to be very aggressive drivers).
- ClassyJacket 9y agoI don't find that at all, I feel like they're happy to take their time and make more money.
- spuz 9y agoUber drivers don't get paid by the minute. It's a fixed fare.
- mdeg 9y agoDepends on where you live. Uber has a per-minute rate in some places.
- pfarnsworth 9y agoNo, drivers are paid by distance and mileage. Uber is paid fixed fare.
- fudged71 9y agoThis matches my experience driving elsewhere. You need to adapt to the context, the car should not drive the same way everywhere.
- IgorPartola 9y agoThis is what's going to happen. If you've ever seen a machine learning algorithm in action, this isn't surprising at all. Basically, they'll behave as expected some well known percentage of the time. But when they don't, the result will not be just a slight deviation from the normal algorithm, but a very unexpected one. So we will have overall a much smaller number of deaths caused by self driving cars, but ones that do happen will be completely unexpected and scary and shitty. You can't really get away from this without putting these cars on rails. Moreover, the human brain won't like processing these freak accidents. People die in car crashes every damn day. But we have become really accustomed to rationalizing that: "they were struck by a drunk driver", "they were texting", "they didn't see the red light", etc. These are "normal" reasons for bad accidents and we can not only rationalize them, but also rationalize how it wouldn't happen to us: "I don't drive near colleges where young kids are likely to drive drunk", "I don't text (much) while I drive", "I pay attention". But these algorithms will not fail like that. Each accident will be unique and weird and scary. I won't be surprised if someone at some point wears a stripy outfit, and the car thinks they are a part of the road, and tries to explicitly chase them down until they are under the wheels. Or if the car suddenly decides that the road continues at a 90 degree angle off a bridge. Or that the splashes from a puddle in front is actually an oncoming car and it must swerve into the school kids crossing the perpendicular road. It'll always be tragic, unpredictable and one-off.
- orbitur 9y ago> I won't be surprised if someone at some point wears a stripy outfit, and the car thinks they are a part of the road, and tries to explicitly chase them down until they are under the wheels. Or if the car suddenly decides that the road continues at a 90 degree angle off a bridge. Or that the splashes from a puddle in front is actually an oncoming car and it must swerve into the school kids crossing the perpendicular road. Are you working on the next season of Black Mirror? In all seriousness, my fear (and maybe not fear, maybe it's happy expectation in light of the nightmare scenarios) is that if a couple of the "weird and terrifying" accidents happen, the gov't would shut down self-driving car usage immediately.
- jessaustin 9y ago
- newnewpdro 9y agoHaving these massive robots on our public streets better at least result in unfettered, transparent public access to all the data informing the thing in the time surrounding the crash. This shift towards autonomous vehicles is utterly unnecessary. They could be simply improving the safety systems of the vehicles to intervene when the driver is about to cause an accident. Instead they're doing the opposite - expecting the human to intervene when the robot is about to cause an accident.
- danso 9y agoThe Washington Post has an updated story with the victim's name: https://www.washingtonpost.com/news/dr-gridlock/wp/2018/03/19/uber-halts-autonomous-vehicle-testing-after-a-pedestrian-is-struck/ https://www.washingtonpost.com/news/dr-gridlock/wp/2018/03/1... > Police said the vehicle was northbound on Curry Road when a woman, identified as 49-year-old Elaine Herzberg, crossing from the west side of street, was struck. She died at a hospital, the department said. No mention of her being a bicyclist. My gut instinct is to accept that the victim was indeed a pedestrian -- with the assumption that they'd have that detail cleared up by the time they have her identity ready to release to the public.
- TillE 9y ago> the vehicle was northbound...crossing from the west side of street So, she approached from the left. That would make it significantly less likely that she just suddenly appeared in front of the car, right? It's not a narrow street.
- scoggs 9y agoWhat I'm saying is unlikely as I'd most likely assume she was traveling along the sidewalk for some distance before being hit but there is always the chance she was walking the bike across the grass and came out from that direction (where those bushes are, they seem tall enough from what I can see)? This is all assuming when you say 'left' you meant on the left side of the Google Street View posted above, though.
- abalone 9y agoI'd think so too, but there is literally a crumpled bicycle in the photo of the scene. Also the Uber has a dent on the right side, which faces east. It's possible she was walking her bicycle across the street, but that still looks pretty bad for Uber. That street is a straight shot with clear visibility.
- phyzome 9y agoAnd if she was walking a bicycle, it was extremely unlikely that she "darted out". It takes some skill to do that. (Still need more info, though.)
- AsyncAwait 9y agoAs someone who cannot drive because of a disability, I am putting real hope into self-driving cars becoming a thing during my lifetime. Uber may've just set that back a decade.
- vpribish 9y agoI suppose speculators will speculate - but c'mon. just wait and we'll have video and telemetry and this whole conversation will be moot.
- joeevans1000 9y agoHype cycles are beginning to cause loss of life. Self driving cars are being allowed to operate at a far faster rate than other transportation innovations would have. This is because of the enthusiasm around technology. We need to realize the difference between social media apps and steel.
- xingi538 9y agoMy understanding, from talking to someone who works for the NTSB, is that the software controlling autonomous vehicles is currently completely unregulated, and that companies like Uber, Tesla, etc. have refused to provide access to their software for external review. Recently I've seen a lot of comments defending autonomous vehicles from a statistical standpoint, but even if these cars have the potential to be safer on average, it scares me to think that the software driving a car is less regulated than its airbags or seatbelts. Especially considering the auto-industry's tenancy to ignore safety issues without external pressure [0]. Is my information outdated? Have there been efforts to review or regulate autonomous driving software in the last year? [0] https://en.wikipedia.org/wiki/Unsafe_at_Any_Speed https://en.wikipedia.org/wiki/Unsafe_at_Any_Speed
- ggg9990 9y agoOf course it was Uber. I'm sure they don't even give a fuck any farther than the cost to their brand either.
- jonthepirate 9y agoFormer Lyft eng here. From my vantage point, as an industry, we're nowhere near where we should be on the safety side. The tech companies are developing driving tech privately instead of openly. Why can a private for profit company "test" their systems on the public roads? The public is at serious risk of getting run over by hacked and buggy guidance / decision system. Even when a human operator has his hands hovering 1 inch off the steering wheel and his foot on the brake, if the car decides to gas it and swerve into a person, it is probably too late for the human crash test driver to overtake. This is going to keep happening. The counterargument FOR this is that it is overall a good idea for the transportation system if the number of crashes & deaths is statistically less than human operated cars. I see this as the collision of what's possible with what's feasible and that we are years away from any of this being close to a good idea. :( Very sad for the family and friends.
- c22 9y agoI strongly agree with this sentiment. If this technology is going to be tested on the public then all the datasets from these vehicles should be openly shared and development should be done cooperatively. Let the market decide winners based on metrics like cabin comfort and leasing terms rather than odds of causing grievous injury.
- decacorn 9y agoThe counterargument you propose is invalid because it would be DECADES until >90% of the entire current automotive market is converted to fully autonomous. MEANING cars currently on the road either being retrofitted or completely removed from road and replaced by an AV. So we are all in a lose-lose. I'm anticipating severe backlash from Congress this week, if not today.
- Shivetya 9y agobecause it does not require handing over control to the car to get a good test. the cars can simply record their decision making process and immediately flag all exceptions, which includes hitting anything. It would be very interesting to see all exceptions because it is to be expected all these systems must fail. we don't need active testing on our streets. automakers would have dared to test ABS or "safety" systems in such a manner for the simple reason of liability.
- wruwew8uu9 9y agoWhy is Uber allowed to test its software for free on public roads ? Why doesn't it use a purpose-built test-track of its own, where it must prove that its software won't kill people (using robotic crash-test dummies to avoid) before it is allowed to use public roads ?
- wlll 9y agoI just don't trust Uber and its engineers enough to trust them as a self-driving car company. Even before this incident. Their organisation has been shown to be deceitful, their CEO to be devious. I can completely believe they would cut corners or claim safety where they know there is risk. To get to market ahead of the competition knowing that the fate of road users lay in a dice roll. Technically they had to resort to stealing Waymo's IP to get ahead, and their self-driving cars have previously been shown to behave recklessly. I do, tentatively, trust Waymo. I've seen enough about the resources they've put into this, the extensive testing they've done, and their safety record so far to at least give them a shot.
- Mtntk 9y agothere is a standard in motor industry called misra, because the target user is human you have to met some certain safety level. Otherwise bad things happen like this. Maybe self driving industry needs to have some safety rules too to prevent when the unexpected happens.
- paul7986 9y agoWhen will this company just go away ... after everything it's done ... it's now killing innocent people!
- UncleEntity 9y agoA while back I was riding my bicycle home from work and saw one of the Uber robocars coming the other direction while I was making a left turn so decided to test their reaction algorithm by starting my turn while they were still approaching -- car didn't even flinch while a human driver would've at the very least honked at me. As an aside, I've also been hit in a bike lane in Tempe by a human driver unfortunately, if it were a robocar I'd be living on the beach somewhere off the settlement check.
- nopriorarrests 9y agoI wonder how this will be treated legally. Police can't just write "killed by python script" as a cause of death, that would be crazy, and there is no legal framework for cases like that. My guess is that A.I. could be equated to cruise-control, meaning person behind the wheel is responsible. Maybe someone knows better?
- drcode 9y agoPeople are injured by malfeasance of a corporation involving many employees all the time, such as when a bridge collapses- There is nothing that says a police person needs to immediately find a single guilty person 10 minutes after an accident like this.
- nopriorarrests 9y agoI agree, for large engineering projects, such as bridges and buildings, obviously many employees are involved and in many cases you can't even single out someone who is responsible. But, to my best knowledge, there are no "corporations" on the road. No matter what company this person is driving for and under what type of contract, this person is responsible for all kinds of incidents.
- hugh4life 9y agoThe self driving car craze baffles me. I would only trust it if it were on a road made for it and the cars communicated to one another.
- jpao79 9y agoOr at least have the self driving cars driving only along specific routes well marked, well maintained autonomous driving routes similar to light rail/bus lanes so pedestrians know to be extra careful. And for long haul trucking applications, freeway lanes at specific times of late night/early morning could be dedicated for autonomous driving.
- ChuckMcM 9y agoSomething of a self-driver car Rorschach test. On the one hand there is the tragedy (car hits person, person dies), on the other there is the technology (computer doing the driving), and then there is the fog of reporting where actual data is hard to come by because people are people and report on the things they saw/heard that were important to them. Last night there was a story on CBS about the first 'self driving bus' going live in San Ramon California. [1] Where the reporter steps out in front of it to see if it will stop (spoiler alert, it does). And while it was a tragedy, its unfortunate that because it was a 'self driving' car this fatality gets more coverage than the thousands who are killed by 'human driven' vehicles. Bicycle advocacy groups have been arguing for years that better, separated, bike lanes would save lives. Perhaps the companies behind self driving can get behind that effort to protect bike riders from humans and make it easier on their cars. [1] https://www.cbsnews.com/live/video/20180319105443-californias-first-self-driving-bus-is-running-near-san-francisco/ https://www.cbsnews.com/live/video/20180319105443-california...
- zepn 9y agoThis paradigm-shift is a chance to address one of the leading causes of preventable death in the world. It doesn't surprise me for a moment that this was Uber (though it might have been a Tesla). From all I've seen and read, these companies are racing unscrupulously, and some have inferior technology compared with others. Waymo seem to be approaching the problem from a safety direction rather than a pure race for profit. We need to hold SDs to a higher standard than we hold human drivers. Not 1.5x the standard; 1000. 10,000. 100,000. And every death must be treated as a serious failure of engineering. These are preventable deaths.
- djsumdog 9y ago> You can't really get away from this without putting these cars on rails. We should just really build rails. Self driving cars are dumping billions of dollars onto a problem better solved by rails. Several cities already have self driving trains including London, Singapore and Kuala Lumpar, and they transport millions of people every day without incident: http://penguindreams.org/blog/self-driving-cars-will-not-solve-the-transportation-problem/ http://penguindreams.org/blog/self-driving-cars-will-not-sol... Self driving car research is asinine. It won't even being to solve the transport problem in America and it's round-peg/square-hole tech. It has the cool factor but there are existing tech that are insanely more useful for a fraction of the cost. American hate public transportation (thanks GM) that we'll never see real/good transport implemented in America.
- Aunche 9y agoMost people don't live in a dense enough city to justify rails.
- gscott 9y agoIt would be easier to put a small transmitter in the middle of each lane run on solar power. This would keep the cars centered in the lane except for when they are executing some action.
- cle 9y agoRail isn't something you can solve solely with tech, though. It requires building new infrastructure, which requires enormous political cooperation, which is an intractable problem in our current political climate. Self-driving cars do require some political cooperation, but it's much less because it purportedly doesn't require new infrastructure.
- ramphastidae 9y agoFrom my experience, relative to the rest of the first world, American highways and streets are dilapidated and neglected. I don’t see how that doesn’t get worse when self-driving cars start using those streets more efficiently than humans.
- Steeeve 9y agoWhy not test these things on a private track? You have a multi-billion dollar company attacking this problem and it feels like all they tested before they hit the public roads was lefty and righty.
- melicerte 9y agoIf you skip the emotional part of the news, the interesting question is: who is responsible when a self driving car made by a company kills someone?
- blauditore 9y agoWow, this is sad. I always imagine I would feel uncomfortable when developing software in certain areas such as this, or e.g. for space rockets containing humans. Errors have a much higher impact than when only developing web applications where the worst case scenario is a tempoarily unreachable website, or maybe some data loss.
- ada1981 9y agoCould this help Uber? American's seem to enjoy the "X doesn't kill people. If only more people had X, less people would have to die." argument. <braces for downvotes>
- cwbrixey 9y agoThe problem is likely a failed ABS Brakes and on all cars. When the brake is applied and then it fails, there is less than 5 seconds to a crash and likely fatality. No time to react. Experiencing the brake failure on two cars, I have tried to get the attention of NHTSA for a decade. NHTSA has a lock on faulty research to blame an innocent driver for all accidents instead of finding the correct root cause of the crash. My estimate is 50% to 70% of all fatal crashes is caused by a defective ABS Brake.. Finally with no driver to blame, NHTSA will have to solve the correct fail mode for these crashes. The Congressional Sudden Acceleration investigation found nothing to make the roads safer and Toyotas have SA crashes today and the certified accident investigator only logs items to blame the innocent driver. Unless the braking technology is totally changed in self driving cars, I expect daily crashes with no one to blame. I have sent Elon Musk letters that the Tesla has ABS Brake issues causing crashes, but their engineers join in blaming the driver and do not fix the problem Accident investigators are clueless Lawyers and DAs are clueless News Reporters are clueless NHTSA is clueless NTSB is clueless Carnage on the roads goes on unabated and we convict an innocent driver.
- downandout 9y agoThe title here should be amended to “...hits, kills jaywalking pedestrian...”. Let’s get the facts straight. This person was walking outside the crosswalk. The fact that a computer was behind the wheel is irrelevant. A human broke a law designed to prevent this exact scenario, and the result was both predictable and tragic. It’s terrible, but ultimately the person’s fault.
- mo1ok 9y agoThe law is that pedestrians always have right of way. Jaywalking is a fine, but not a jail sentence. Not coming to a full stop for jaywalking pedestrians, however, is how I failed my first driver's test.
- downandout 9y agoThe law is that pedestrians always have right of way That actually depends on the state. “Arizona law requires pedestrians to cross the street at corners and/or designated crosswalks...[if] it seems unlikely that a driver should have avoided---as in a case where the pedestrian darts right out into traffic, then it may be that the pedestrian will be deemed 100% at fault for his/her injuries.” [1] I’m sure that Uber will be sued over this, and they’ll probably settle quickly and quietly to avoid mass hysteria resulting from misleading headlines such as this one. But that doesn’t mean the jaywalking pedestrian isn’t at fault. Walk in traffic, die in traffic. It’s a pretty straightforward physics problem. [1] http://www.zacharlawblog.com/2015/11/whos-at-fault-in-an-accident-involving-a-jay-walker-.html http://www.zacharlawblog.com/2015/11/whos-at-fault-in-an-acc...
- danso 9y agoThe blog you quote also notes that a driver may still be found at fault: > Arizona law also requires drivers of motor vehicles to pay attention and to drive "reasonably" for all traffic conditions. "All traffic conditions" includes the existence of pedestrians in or near the roadways. > So, should an accident occur between a jaywalker and a car---if shown that the driver could have/should have seen the person and could have/should have been able to avoid, then without question the driver can be held responsible. We don't know enough either way to cast judgment on fault yet. But to your original point, about the headline being misleading, we don't know enough to know whether the victim was jaywalking, only that preliminary reports seem to suggest she was engaging in that behavior. But labeling her a "jaywalker" strongly implies that she was cited as such, which of course hasn't happened in this case. Calling her a "pedestrian" is a fair choice at this point, not a "misleading" one. edit: the headline for this story has since been changed from "Self-driving Uber car hits, kills pedestrian in Arizona" to "Self-driving Uber car kills Arizona woman crossing street", which seems fair to me.
- marcell 9y agoForgive my ignorance, but isn't this not supposed to happen with LIDAR equipped cars? My understanding is that a LIDAR provides a completely accurate 3D map of the surrounding area around a self driving car. This is in contrast to Tesla's image recognition approach which makes a 3D map from 2D images. So is seems like a pretty giant bug if a self driving car ever crashes into another object with LIDAR, since it should always know the location of external objects. Please correct me if I am wrong!
- grmarcil 9y agoYou're not wrong, but it is more complicated than that. Lidar gives you an array of 3D points and intensity, corresponding to where the lasers bounced back, and how strong the reflection was. Roughly speaking, from there you have to decide 1) which sets of points belong to the same object, 2) what those objects are, and 3) what those objects intend to do in the future. So yes, a lidar-equipped AV completely not sensing a pedestrian would be surprising, but you can see how it might have incorrectly classified the pedestrian, or misunderstood the pedestrian's intent.
- wiz21c 9y agoI once read somewhere that privacy issues (which are very important to us, IT people) were not treated enough because they didn't have enough blood on their hands. At least with automated cars, there will be blood.
- thecombjelly 9y agoThis seems like a good time to question if we really should have cars at all. Autonomous cars might be better in some ways but they are still tons of metal flying at high rates of speed. Accidents will happen and people and other animals will die on a regular basis. Cars also require tons of infrastructure that walking and biking don't. You also have the environmental destruction of GHG emissions and from the mining of rare metals needed for batteries, you have roads and parking lots destroying habitat and using up valuable space, air pollution and smog from tailpipes or energy generation, noise pollution, and more harmful effects. Autonomous cars might mitigate some of those things but most of it will still be there (or we'll just use cars even more and so we'll have just as many deaths total along with the rest of it?). What about doing research and testing a world without any cars? It will probably be a better one.
- Nomentatus 9y agoParis has greatly reduced traffic, thinking along these lines.
- Zigurd 9y agoThe article says almost nothing about it other than that the pedestrian was "outside the crosswalk." But the details are what matters. Without the details it is not possible to say if striking a pedestrian was avoidable. There is also a large grey area: Could the collision been mitigated? What other risks were involved? The bad outcome would be that it turns out that pedestrian safety is too underdeveloped in this system to really be safe.
- ptr_void 9y agoMy non-expert opinion is that we will not see self driving cars become reality in our lifetime. I don't understand why anyone believes training on some videos/pictures to calculate some probabilities would ever be enough to handle all the complexities of the real world.
- lettergram 9y agoGiven I've seen (just last year) an Uber self driving car run a red light in SF, nealy hitting several people - this is not at all supprising. I do think Uber should be charged if the car is found at fault. Not a civil case, criminal. We know machine learning algorithms fail all the time (like this). It shouldn't be alright to just ignore this.
- darkstar999 9y ago> Not a civil case, criminal. Has there ever been a case where a car manufacturer is charged with a crime for a defect that results in a death?
- linkregister 9y agoI don’t know about cars, but there is precedent for company officers for being criminally liable for negligent homocide. Even in non-homocide cases, individuals sometimes face criminal charges, as the Volkswagen engineer behind the emissions cheating scandal found out.
- wiz21c 9y agoThere are roughly 3e8 cars in the US, they kill 3e4 people a year => each car kills 1e-4 person
- deleted 9y ago[deleted]
- otalp 9y agoVery Relevant video on what the discussions about 'the ethics of self driving cars' miss: https://www.youtube.com/watch?v=ozcaLnTuidU https://www.youtube.com/watch?v=ozcaLnTuidU Summary: We spend too much time talking about what decision the car should make in these situations, not enough on how allowing a corporation to make those life and death decisions changes our society.
- wiz21c 9y agoThere are roughly 3e8 cars in the US, they kill 3e4 people a year => each car kills 1e-4 person a year. If we have say 100 AV right now in US, each car kills 1e-2 person a year. So that's 100 times more dangerous than humans...
- osrec 9y agoI really don't understand the need to put a self driving car around pedestrians or other human drivers. As with any machine learning/control system, wild instabilities can and will crop up. Why don't we simplify the problem domain and keep well suited, designated infrastructure just for self driving vehicles, and solve the last mile problem with a slow 15mph creep to the ultimate destination. I mean, it's impressive that cars can drive themselves through a busy intersection alongside other human drivers, but it is by no means necessary, especially when adding humans into the mix adds a degree of uncertainty that is very difficult to account for...
- nkrisc 9y agoAnd now the costs of developing autonomous cars has been socialized to those unfortunate enough to be walking in front of them while they learn. Perhaps her estate should receive a perpetual royalty.
- schintan 9y agoI think the test cars should be covered in layers upon layers of foam or another kind of shock absorbing material. This should reduce the collision impact at least a little and can be the difference between someone getting killed and escaping with injuries in some cases.
- gldev 9y agoSo, what's the statistic of actual self driving cars killing people vs the actual people killing others or themselves.
- justonepost 9y agoThere were an estimated 40,100 motor vehicle deaths last year, or a drop of 1 percent from the prior year.
- waraey 9y agoUbye
- basura045478 9y agoI see a lot of detailed analysis in this thread, which is impressive given that literally nobody has read anything more than the half dozen factoids that have been released. At best, some of you are looking at maps of the incident site to figure out potential failure cases. Knowing that you don't know something is as important as having the facts. To harken back to Cheney, these aren't even unknown unknowns, you're basing opinions on known unknowns.
- danso 9y agoCheney? I think you mean Don Rumsfeld: https://www.youtube.com/watch?v=GiPe1OiKQuk https://www.youtube.com/watch?v=GiPe1OiKQuk
- basura045478 9y agoyou got me
- kumarski 9y ago"Uber is now the target of at least three potential class action lawsuits, at least five state attorney general investigations, and an inquiry by the FTC because of Sullivan’s decision to pay off hackers and the cover ups." via twitter.com/adamscrabble
- smsm42 9y agoI think it would be insane to expect 100% safety from any technology, let alone new technology. People do crazy things on the road, I am witnessing it almost daily. And if you look up dashcam videos on the internet, you'll be scared to ever drive again. Expecting that some magic technology can deal with all this craziness with 100% safety is impossible. And then we'll add bugs and malfunctions, which absolutely every technology has, especially - new one. So, brace for the incoming wave of similar news. These things will happen, and these things will be heavily publicized. Hopefully it won't cause stupid overreaction to the tune of banning the technology altogether or surrounding it with a bubble of regulations so think as to make in infeasible.
- jostmey 9y agoBoth the computer and the driver failed to avoid the pedestrian. It's possible that the backup driver wasn't paying attention and the technology for autonomous vehicles is not ready. It's also possible that the situation was challenging for both the computer and human and that both failed.
- hackpert 9y agoWhile incredibly sad, this incident is not terribly surprising because the technology is nowhere near safe enough. Unfortunately, this will inevitably set the field back by at least 10 years with stricter regulations. We've seen the same with pharma and aviation, where innovation was slowed drastically and is only realistic for big companies. This is especially true here because if self-driving vehicles get banned from public roads, companies like Waymo will be forced to develop bigger private "test tracks" that approximate cities to have any hope of building deployable technology, and they will face the same fundamental limitation – the data will come from an approximation/model and not the actual location with real-life scenarios. Although there's no doubt that regulations are crucial to prevent such mishaps, I do hope lawmakers can find the right equilibrium on the tradeoff between safety and innovation.
- cbhl 9y agoThe last time I visited Phoenix, I recall being shocked at far apart traffic lights were in the city. Between the Wal-marts and the giant four-to-six bedroom homes, it might be normal to see a major street have a mile between traffic lights (and presumably, crosswalks). It was very different from, say, driving in New York, San Francisco or Seattle. I'd be curious whether "walking outside of the crosswalk" turns out to be material in the analysis by NHTSA/NTSB. Were the crosswalks big enough and close enough that a pedestrian would have normally walked inside one? Was the interchange a regular 90-degree crossing of two roads, or was it something more irregularly shaped? What is the annual rate at which pedestrians get hit at this intersection by human drivers? Do self-driving cars need more examples of "pedestrians walking outside the crosswalk" in their training sets?
- robterrell 9y agoI hope they aren't expecting people to only appear at intersections: "The California Vehicle Code says you can actually cross any street as long as you aren't a hazard to vehicles. It is also legal to cross mid-block when you're not between two intersections with signals." [1] The article points out that LA has a different rule. Uber's going to need to geofence locations and use different rulesets for different cities. [1] https://www.scpr.org/news/2015/04/14/50992/how-do-you-cross-a-street-in-socal-without-getting/ https://www.scpr.org/news/2015/04/14/50992/how-do-you-cross-...
- manmal 9y agoSure, but it’s illegal in most countries (AFAIK also in the US) to not use a crosswalk when you are in the vicinity of one. Eg in Austria you will be fined (or worse, drivers license suspended) if you don’t use a crosswalk that is within 50m of you.
- gleenn 9y agoYou should be killed by an autonomous vehicle because you jay-walk under any circumstances. I hope you realize you are comparing being fined for a tiny crime and getting killed.
- dang 9y agoWe changed the URL from https://www.wcpo.com/news/arizona-police-investigating-self-driving-uber-car-involved-in-crash-overnight https://www.wcpo.com/news/arizona-police-investigating-self-... to one that is longer and doesn't autoplay a video.
- jordanpg 9y agoThose who say it's not safe enough: given that no engineered system is 100% safe, when/how can you say that a system is safe enough?
- pbhjpbhj 9y agoHad the car passed the driving test? There should probably be a specific, complex and comprehensive test for autonomous vehicles. Also I'd want to see shared liability, the company are driving it (by proxy through their software) so they should be liable to some extent.
- drstewart 9y ago>There should probably be a specific, complex and comprehensive test for autonomous vehicles Maybe we should start with a specific, complex and comprehensive test for human drivers first. And to build on the sentiment of this thread, every driver should finance their own test course to practice on before "subsidizing" their learning on public roads.
- deleted 9y ago[deleted]
- pbhjpbhj 9y agoIn the UK, for motorbike tests one does a computer based test, then practices with a company on a private off-road test area. One must pass a test then before being able to practices under instruction on public roads. Once sufficiently practiced one can take the test. Basically what you propose? As for comprehensive testing - I think the UK car and motorbike tests are quite good, not comprehensive, but they demonstrate a general ability across a range of skills. Humans can be expected to act relatively consistently (in such things), the test must be more comprehensive when treating a system that you can't expect to have innate consistency.
- t0mbstone 9y agoBased on landmarks from the photo from the news article, and the fact that the accident supposedly happened near Mill and Curry, I'm assuming that this was the location of the accident: https://www.google.com/maps/place/N+Mill+Ave+%26+E+Curry+Rd,+Tempe,+AZ+85281/@33.4369934,-111.9429875,3a,75y,84.18h,60.6t/data=!3m6!1e1!3m4!1scUyILaxFs5z63AL2SupCJw!2e0!7i13312!8i6656!4m5!3m4!1s0x872b0931b4d9dd05:0x5d55a20356caaf8!8m2!3d33.4377022!4d-111.9433046 https://www.google.com/maps/place/N+Mill+Ave+%26+E+Curry+Rd,...
- polygon-pusher 9y agoTests? what tests? We are too busy fighting over if controller tests are still worth it.
- justaaron 9y agoI never understood the recent push towards self-driving cars, as it already seems perverse that the entire surface pavement has been dedicated primarily to motor vehicles and only secondarily to our actual selves, as pedestrians. Putting further pressure on what should really be 2 discrete planes of activity (perhaps one in tunnels below ground or in the air, and I don't mean the pedestrians!) Perhaps now the arrogance of such bad ideas becomes a little bit more clear to the tech set of folks, that in my view were excessively pushing such strange goals upon a public that wasn't clamoring for it.
- sg0 9y agoI'm paranoid when I'm on a bike. Any road with a dedicated bike lane may be classified as bike-friendly, but I can't consider it so if cars are on the same road. IMO, the only bike-friendly routes are where there are no cars. I wish pavements could be made wide enough for bikes everywhere, so that bikers could be on the road only for a limited amount of time while crossing intersections.
- amclennon 9y ago> Elaine Herzberg, 49, was walking outside the crosswalk on a four-lane road in the Phoenix suburb of Tempe Although I agree with your statement in general, it sounds like she was already walking her bicycle while crossing the intersection, and the fact that she had a bicycle was a moot point.
- cf498 9y agoLooking further then the devastating tragedy at hand, it might be necessary to get the question of responsibility publicly answered. I dont think I am the only one here who has deliberately chosen not to work in fields where human lifes are at risk. Despite the likely outcome, that the engineers behind this took every safety percussions, I think its extremely important, to get the message across, that people with an CS background with such use cases are going to be held to the same standard as for example mechanical and electrical engineers.
- icc97 9y agoOne aspect that comes from this is that now car crashes can be treated more like aircraft crashes. Each self-driving car now has a black box in it with a ton of telemetary. So it's not just "don't drink and drive", knowing that they'll probably reoffend soon anyway. Every crash and especially fatality can be thoroughly investigated and should be prevented from ever happening again. Hopefully there's enough data in the investigation so that Tesla / Waymo and all other car companies can include the circumstances of the failure in their tests.
- Maxious 9y agoNTSB are investigating this incident including electronic recorders https://www.ntsb.gov/investigations/Pages/HWY18FH010.aspx https://www.ntsb.gov/investigations/Pages/HWY18FH010.aspx and they have another investigation from 2017 still to report https://www.ntsb.gov/investigations/Pages/HWY18FH001.aspx https://www.ntsb.gov/investigations/Pages/HWY18FH001.aspx
- fudged71 9y agoAlthough it's comforting that this exact situation shouldn't happen again in an Uber autonomous car... there is no mechanism to share that learning with the other car companies. There seriously fucking needs to be a consortium for exactly this purpose: sharing system failures. Also my problem with this is that a human death is functionally treated as finding edge cases that are missing a unit test, and progressing the testing rate of the code... and that really bothers me somehow. We need to avoid treating deaths as progress in the pursuit of better things
- goshx 9y agoThinking about different scenarios as unit tests it shouldn’t be hard for them to simulate all sorts of different scenarios and share those tests. Perhaps that would become part of a new standard for safety measures in addition to crash tests with dummies. In fact, I really think this will become the norm in the near future. It might even be out there already in some form.
- piinbinary 9y ago
- qwerty456127 9y agoJust out of curiosity, how many people have been killed by human-driven cars on the same day in Arizona?
- WhompingWindows 9y agoMy guess is 2 or 3 deaths that day. Okay, according to the 2016 Arizona Crash Facts Summary [0], there were 952 fatalities on the road that year, including 193 pedestrian fatalities and 31 pedalcyclist fatalities. So, on any given day in 2016, there were 2.6 fatalities, with less than 1 in the pedestrian/pedalcyclist groups. [0]: https://www.azdot.gov/docs/default-source/mvd-services/2016-crash-facts.pdf?sfvrsn=6 https://www.azdot.gov/docs/default-source/mvd-services/2016-...
- undoware 9y agoHeadline should read 'woman crossing street kills electric cars'
- nwellinghoff 9y agoI love how everyone is throwing fuel on the fire here with no actual details as to what happened in the accident. It could simply be she ran out into oncoming traffic and got hit. Hard to say a human driver could have performed any better. The devil is in the details.
- CardenB 9y agoAgreed. We need a lot of time to digest this. At least anything before the NTSB investigation is jumping to conclusions.
- SuperNinKenDo 9y agoGiven the number of fatal pedestrian hits by human drivers, I'd be interested to see how Uber's self driving cars stack up against the apes. Having said that, one concern one has with self-driving cars is that one can't "reach an understanding" with them the same way pedestrians and drivers regularly negotiate how they're going to behave with each other. If one doesn't know one is dealing with a self-driving car, one might consider certain situations safe, because they usually would be, but the car negotiates and notices things differently than a human.
- dchichkov 9y agoAnd yet (disclaimer - reflects only my personal view, might not correspond to the current state of affairs at Uber, it is possible that Uber cars are still safer than human drivers, but still - one who forgets the history tend to repeat it): https://www.forbes.com/sites/samabuelsamid/2016/12/15/the-trouble-with-uber-fail-fast-and-iterate-but-not-at-the-cost-of-human-lives https://www.forbes.com/sites/samabuelsamid/2016/12/15/the-tr...
- 11thEarlOfMar 9y agoIt's not hard to believe that self-driving autonomous cars will make the roads safer overall. The issue is that while fewer lives will be lost, it will be a different set of lives than would have been lost without self-driving technology. Those lives will have their day in court.
- ensignavenger 9y agoThe various reports on this aren't clear- did the car hit a pedestrian, or a cyclist?
- nimbs 9y agoTempe Police say woman killed by self-driving Uber car was pushing bicycle across street when struck.
- Peter-W 9y agoShe stepped out in front of the car in the middle of the road, it's not like a human driver would have done any better.
- zengid 9y agoDid the person riding along attempt to take control? I wonder if they will get held responsible..
- arca_vorago 9y agoUber is responsible for this, and corporations are people, right? That reminds me I have an episode of opening arguments to listen to on the subject.
- xbeta 9y agoStatistically speaking, I am curious to know the data on these areas: - number of miles driven per fatal accident on self-driving - number of miles driven per fatal accident on a human driver. It is important to know whether our machine is now doing worse/better than our counter-part and this means a lot for our self-driving initiatives.
- fnbr 9y agoThe numbers that I have seen indicate that humans have a fatal accident roughly once per hundred million miles, while we have one fatal accident for a self-driving car, with somewhere around ten million miles driven across all self-driving cars. I've heard Uber is around 3 million self-driving miles. So Uber would be 30x worse than humans.
- emodendroket 9y agoInteresting analysis, but the data seems a little sparse to draw this conclusion.
- xbeta 9y agoGood to know! But I am more curious for the data cover every self-driving vehicles, not just about Uber. It could be Uber is doing worse, but my ask is whether we (as an industry) is still on a right direction for this "bold bet".
- plaguuuuuu 9y agoWe also don't know how many fatal crashes were avoided due to human intervention (Uber has people inside the cars). It is almost certainly a whole lot worse than 30x at this stage.
- jakelazaroff 9y ago1.15 per hundred million vehicle miles traveled by humans [1]. Uber only reached a million miles in September, with Waymo a little ahead at four million [2]. Note that this is far too little data from which to draw any conclusions, since the sample size for fatalities involving self driving cars is one and the number of miles driven is many orders of magnitude less. [1] http://www.iihs.org/iihs/topics/t/general-statistics/fatalityfacts/state-by-state-overview http://www.iihs.org/iihs/topics/t/general-statistics/fatalit... [2] https://www.theverge.com/2017/11/28/16709104/waymo-self-driving-autonomous-cars-public-roads-milestone https://www.theverge.com/2017/11/28/16709104/waymo-self-driv...
- igammarays 9y agoMy personal hunch is that fully autonomous self-driving tech is not theoretically possible under currently known computational models, because it implies many well-known NP-Hard problems. Self-driving companies are betting on the ability to find a heuristic/approximation that works "sufficiently well". But I strongly feel that the chasm that needs to be crossed to be "sufficiently good" is not one of magnitude (i.e. we just need more testing!), but of theoretical boundaries, due to the existence of at-least two sub-problems which are not computationally solvable: 1. prediction of what pedestrians/cyclists will do next, and 2. accounting for sensor input distortion under bad weather conditions. Humans can solve these problems due to life experience, not just driving experience. In other words, I think we're gonna need fully-conscious AI to solve self-driving. The only way self-driving tech will reach production is if the input space is restricted, which is a significant-but-not-groundbreaking iteration on what we've been doing for decades with airplane autopilots and self-driving monorails. Sure, we can have self-driving cars on specifically designed freeways, but nothing more.
- emodendroket 9y ago> Sure, we can have self-driving cars on specifically designed freeways, but nothing more. But at this point what makes it better than a train?
- pinum 9y agoI'm not necessarily arguing for this, but one viewpoint might be: A vehicle that can autodrive the freeway (i.e. most of the way), and reverts to manual control for the shorter sections before and after the freeway, would have a significant convenience benefit over a train. Take the train, and you have no vehicle with which to go from the destination station to your endpoint. Also, you could travel at any time instead of being held to the schedule.
- emodendroket 9y agoWell, fair enough, I suppose.
- 9y ago
- jarjoura 9y agoIt's fascinating that so many brilliant people in this thread can talk so casually about any single loss of life for the tech built by the very same people in this thread. I would be devastated if I learned my code ended even one person's life. You're in a bubble if you think a world hyper connected to social media that's in the same world scared that autonomy is about to kill millions of jobs in one jab and would NOT over-react to a single accident. From the article it's impossible to know if the cyclist was at fault, so I won't jump to conclusions, but we can't, especially as the creators of the future of autonomous vehicles talk so dissociatively about human life. Either we go out into the public roads with very high certainty that OUR software and OUR hardware won't kill someone, or we wait till we get there. Public opinion on human driving is doing just fine with human drivers right now, so we can and should take our time to get to the future we want or risk a backlash and a guilty conscious.
- habosa 9y agoThank you for adding this perspective. Honestly I am not sure how to rationalize the dueling thoughts in my head. On one hand, the "just one isn't so bad" argument is rational. In terms of fatalities per mile, self driving cars already seem to be safer than humans as a class. Therefore it would be wrong of me to say that this tech does not belong on the road when I believe I should be allowed to drive. On the other hand, you said it best. If I ever wrote code running on a machine that killed somebody I don't know how I'd continue in my career. Hell, I work at Google very far from Waymo but if one of our cars struck and killed someone I'd feel some personal responsibility. So ... I guess it's complicated.
- larkeith 9y ago> Public opinion on human driving is doing just fine with human drivers right now There were over 40,000 motor vehicle deaths in 2016 in the US [1] - more than a hundred daily. While loss of human life is always a tragedy, individual fatalities are absolutely worth it if we can begin to reduce that count sooner than by proceeding with excessive caution. It would be morally unacceptable to delay development merely to avoid a guilty conscience. [1] http://www.nsc.org/NewsDocuments/2017/Fatality-estimates-June17.pdf http://www.nsc.org/NewsDocuments/2017/Fatality-estimates-Jun...
- trhway 9y agohttps://www.abc15.com/news/region-southeast-valley/tempe/tempe-police-investigating-self-driving-uber-car-involved-in-crash-overnight https://www.abc15.com/news/region-southeast-valley/tempe/tem... "The fleet of self-driving Volvos arrived in Arizona after they were banned from California roads over safety concerns."
- arnaetra 9y agoI have not been following the development of self-driving car tech very closely, but I have some familiarity with the difficulty of the challenges involved and I have a feeling that we are at least two decades away from having fully autonomous tech authorized for use on public roads. Am I underestimating the progress of the tech? I have the impression that there is a tremendous amount of unjustified hype in this field.
- 0xffff2 9y agoYou're not underestimating anything. Rather, the vast majority of developers (much less everyone else) have no familiarity at all with the challenges that self-driving tech has to overcome.
- lacerta 9y agoIt is both an over and underhyped field depending on the area you are looking at. HUGE difference between consumer self driving car [Everywhere, at all times] and the Machines as a Service [Geo, time, weather-fenced operations][1]. Waymo appears to be at the head of the pack; Sacha Arnoud, Director of Engineering for Waymo gave a talk a few weeks ago at MIT[2] and gives a good idea. We are about 5 years out until these start rolling out as MaaS (machines as a service). Probably 10+ years for level 4 highway operations for consumer models according to Frazzoli. [1]Emilio Frazzoli, CTO of nuTonomy https://www.youtube.com/watch?v=dWSbItd0HEA https://www.youtube.com/watch?v=dWSbItd0HEA [2]https://www.youtube.com/watch?v=LSX3qdy0dFg https://www.youtube.com/watch?v=LSX3qdy0dFg
- redm 9y agoIt's terrible when anyone is killed in an automobile accident. The irony is in the promise of autonomous vehicles to prevent this very thing. I've heard the general report, and I find it interesting that a supervisor was at the wheel, and they, as well as the car, failed to prevent the pedestrian from getting hit. I read they were not in a crosswalk and I'm sure the specific details of the accident matter greatly. It makes me wonder if a human driver with no autonomous system would have faired any better since someone paid to be alert and a car designed to be alert both failed to prevent the accident. I'll reserve final judgment until more details are out.
- mr_toad 9y agoIt doesn’t matter how good the driver is, AI or human, if you unexpectedly walk right out in front of a car moving at 40mph it’s not going to be able to stop.
- princeb 9y agonow the question is why is a car (autonomous or not) driving at 40mph on a road where people can be expected to walk right out in front of a car? would you drive 40 mph down a city street with trucks and buses parked head to tail on both sides of the road?
- raphaelj 9y agoTo put this accident in perspective, Uber self-driving cars totaled about 2 to 3 millions miles, while the fatality rate on US roads is approximately 1.18 deaths per 100 millions miles [1]. [1] https://www.nhtsa.gov/press-releases/usdot-releases-2016-fatal-traffic-crash-data https://www.nhtsa.gov/press-releases/usdot-releases-2016-fat...
- cjdaly 9y agothat doesn't sound like a fair comparison. How many human interventions were there in the 2-3 million Uber miles?
- thegabez 9y agoKnowing that makes this much more infuriating.
- goshx 9y agoThat’s not apples to apples. How many cars account for the nhtsa number and how many for Uber’s program?
- utopcell 9y agoI'd say that miles driven is a good normalizer. In fact, NHTSA statistics includes miles driven under adverse conditions (rain, snow, etc) while I'd bet that this is not the case for Uber.
- 9y ago
- lifeisstillgood 9y agoThere are only two paths from here - an escalation of the scramble to real world driving hidden under self-serving rationalisations, ("the bigger picture") or a step back to some industry self-regulation, where self-driving just does not happen till the sensors, the maps and the algorithms are much much much improved. We know very little about the circumstances here, apart from the obvious tragedy, but given that we learnt from Tesla that you cannot rely on cameras alone, whatever is learnt from this must be shared amoung all the industry and serve as the baseline for future. I would prefer an outright ban on driverless cars in real world settings (until perhaps each competing car can safely navigate the worst sensor data other companies can offer) but as a minimum we need a neutral clearing house similar to the airline industry. There are on this forum enough industry insiders, plus a sprinkling of regulators that a global self-regulated path could easily be forged.
- FlyingSideKick 9y agoLet’s take the extreme example where a bug in a self driving semi truck leads to it mowing down 50 people on a busy sidewalk. How are the victims to get justice? In almost all incidents besides a human truck driver having a major health incident, that driver would go to jail but it seems that there will be little repercussions beyond fines for autonomous driving companies. I think once a mass fatality occurs people will scream for autonomous driving execs and programmers to be held liable.
- lopmotr 9y agoThe way I see it, by using the road, you're sort of giving up the right to revenge justice. It's a game of Russian roulette. People make mistakes and kill others or themselves no matter how careful they try to be. It's like asking where's the justice if you die from a heart attack or cancer? Those aren't crimes, they're bad luck.
- aurizon 9y agoUber must have a full video of this - just in case. I can hardly think they did not have a full record of this, as well as all miles traveled? It may be in these 1366+ comments, but I have not read them all to see.
- rboyd 9y agoFTA "Elaine Herzberg, 49, was walking her bicycle outside the crosswalk". The article says "as soon as she walked into the lane of traffic she was struck". The police sergeant also "said he believed Herzberg may have been homeless". These three things may together indicate that even a human driver might have struck and killed the lady if she entered into the roadway unsafely. I'm not sure how everyone (especially on Twitter) can be jumping all over Uber yet until the investigation is complete. Sad of course, either way, but not yet enough evidence to assume that the algorithm+driver combo was any less safe than a human driver alone.
- JimboOmega 9y agoFinding any tidbits on what actually did happen has been very difficult. I get that the investigation is of course ongoing, but that's what I want to know - did the tech actually make a mistake here? And a mistake in a broader sense - was it an avoidable accident? If it wasn't this barely feels like news, other than as a milestone. Also... I don't see how her being homeless has anything to do with it.
- rboyd 9y ago> Also... I don't see how her being homeless has anything to do with it. well, higher than average rates of substance abuse in the homeless population. other than that I'm not sure how it could be relevant or why the article mentioned it. we wouldn't know without an autopsy but being drunk could explain walking out into traffic.
- heedlessly2 9y agoHomeless people tend to be in poor mental health and possibly under the influence of drugs/alcohol. All 3 of these things can contribute to bad judgement when she got hit. It's unfortunate that this happened. But we do need take into context the situation and all factors involved.
- DoreenMichele 9y agoAlso... I don't see how her being homeless has anything to do with it. I can think of a number of ways it may be relevant. In addition to what I said in this discussion, I left a comment about that here: https://news.ycombinator.com/item?id=16625242 https://news.ycombinator.com/item?id=16625242
- muxator 9y agoSorry, but what's the point of this? > Elcock said he believed Herzberg may have been homeless. I do not think that Herzberg possibly being homeless adds any meaningful information. On the contrary, I feel this may subtly support unconscious prejudices.
- cloakandswagger 9y agoSpend some time in any major city and you'll see homeless people doing all sorts of reckless things around cars. Just last week I saw a homeless man jaywalk into oncoming 40+ MPH traffic without so much as looking or stopping. In this sense, it is a possibly relevant detail of the story.
- danso 9y agoHe said this in response to a reporter who asked if she was homeless: https://www.facebook.com/cnn/videos/10158139292591509/ https://www.facebook.com/cnn/videos/10158139292591509/ Can't speak for the reporter who asked that, but I can take a guess about why it was asked. The victim's death and identity has been known for half the day. Her being homeless might possibly figure into next-day stories about why we haven't heard much from grieving family members. But yes, you're right, it is a detail that will figure into people's prejudices.
- nothrows 9y ago> “The pedestrian was outside of the crosswalk. As soon as she walked into the lane of traffic she was struck” Uber has some fucking shitty programmers guaranteed. They murdered this lady. Think about it: Smart cars basically have 360 degrees of sensors. There’s no way it didn’t detect that lady coming up on the car and the fact that it kills her says to me there was no counter measure. It probably didn’t even slow down until the moment of impact. That's some fucking elementary school shit. > Chance of Collision? 100%. Maintain Speed In structural engineering if you designed a bridge poorly and it collapsed killing people you'd lose your ability to practice engineering. The same should be applied.
- lopmotr 9y agoThere's no indication that this is the fault of the car or its human driver. Unfortunately, the media won't notice that. She stepped out in front of the car and since she was struck immediately, it sounds like the car had no time to stop or swerve, let alone time for the human driver to react in any way. EDITed to remove offensive word.
- dang 9y ago> rabble Please follow the site guidelines when commenting here. Adding flamebait into a flammable topic sparks explosions, making this place worse for everyone. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- booleandilemma 9y agoI feel like I should share this here. The first person killed by a car: http://www.guinnessworldrecords.com/world-records/first-person-killed-by-a-car http://www.guinnessworldrecords.com/world-records/first-pers...
- xbmcuser 9y agoWhy am I not surprised the first death of a pedestrian came from a Uber driven car.
- itsuart 9y agoSo, who is going to jail (or at least - trial) over this?
- kappi 9y ago1500 comments before knowing the real reasons. It could be suicide. The dead woman has history of substance abuse and arrested 6 times. http://www.dailymail.co.uk/news/article-5519433/Self-driving-Uber-car-runs-kills-pedestrian-Arizona.html http://www.dailymail.co.uk/news/article-5519433/Self-driving... http://fortune.com/2018/03/19/uber-self-driving-car-crash/ http://fortune.com/2018/03/19/uber-self-driving-car-crash/
- ISL 9y agoIt needn't be suicide; from the second link, the victim may have stepped from a shadowy spot/out of view. A car cannot avoid what it can't see.
- femto 9y ago> “They are going to attempt to try to find who was possibly at fault and how we can better be safe, whether it’s pedestrians or whether it’s the vehicle itself.” Autonomous vehicles should automatically be 100% liable in every accident in which a person is injured, and it should be paid for by a levy on every vehicle. A levy is fair because the per vehicle risk is much more uniform than with a driver behind the wheel. 100% liability is fair because the software should be written so that the vehicle predicts the path of all objects within its range and adjusts is speed/trajectory so that there is negligible risk of collision given the worst case behaviour of the object. If an object doesn't show on the car's sensors, then its still the car's fault as the sensors should be built to they do pick up all objects. There is a complete power imbalance otherwise: software cannot be injured in a collision but people can, so all people should be 100% covered to give the software incentive to be the best it can. Summary: a car is governed by predictable physics, hence there is no such thing as an accident involving an autonomous vehicle, only mistakes.
- JimboOmega 9y agoGiven current road and vehicle design, that's an incredibly impractical goal. There simply isn't enough separation between pedestrians and roadways; to keep injury risk negligible you'd also have to keep speed incredibly low (way below speed limits) on all but the best limited access highways. If the vehicle can only crawl at 5MPH because you never know when a pedestrian might just dive in front of you... that's just impractical for real vehicle operation. It's one thing to hit the brakes because somebody decided to jaywalk without looking; another to expect there is always enough space to stop in those situations.
- femto 9y agoI disagree. Pedestrian density is generally low enough that the car could generally be doing 60km/h and not hit a "worst case" pedestrian. For example, how many people do you see walking along freeways? If a person is on a freeway then cars should be slowing down for them. It's a rare enough event that cars could be programmed to avoid all collisions with minimal impact on average speeds. If a car is around people then it should be going at a low speed. If there are enough people around that it can't get speed up, then that car is effectively in a "shared" or "local traffic" area and should be going slowly. I'd argue that the effect on average speeds will be similar to having low speed limits on residential streets:a slower period at journey beginning/end but the majority of the journey would be at speed on sparsely populated arterial roads. Here's another argument: intrinsically safe programming might even increase average speeds? Why do we even need traffic lights and pedestrian crossings with autonomous vehicles? If vehicles were 100% safe, we could do away with dedicated crossings, and there would be no need for vehicles to waste time at red lights, merely slowing down on the relatively rare times when it is necessary.
- curveship 9y agoHere we go. We'll now have the first traffic fatality trial where it's not drivers-trying-drivers but people-trying-a-megacorp. (Disclaimer: I'm a bike advocate, so I may have a different perspective on some of this than most.) Our car-based transportation system is far and away the most dangerous thing any of us accept doing on a daily basis. 40,000 die a year. But when cases come to court, everyone on the jury has in the back of their mind "that could have been me if I lost concentration at the wrong moment, or made one bad judgement, etc etc." So penalties are comparatively light for traffic fatalities. Big punishments are only meted out if the case is so egregious -- repeated drug use, flagrantly reckless behavior -- that the jury can be convinced that the driver is different from them. In other words, drivers don't get punished for doing something dangerous, because everybody on the road is doing something dangerous. They get punished for doing something more dangerous than the norm. In this case, there's no question that the "driver" is different than the jury -- it's a computer. Now the symmetry that made jurors compare themselves to the accused is broken. The result, and what self-driving car advocates don't get, is that self-driving cars don't just have to be safer than human drivers to be free of liability, they need to be safe period. In a trial, they don't benefit from the default "could have been me" defense. That's a HUGE requirement. In fact, it's probably impossible with our current road system. It won't just take better self-driving cars, but better roads and a major cultural change in our attitudes about driving. As a bike advocate, I welcome this shift, but I also see how deluded many of the current self-driving projects are. Software moves fast, but asphalt and mentalities move slow. We're not years away from a self-driving transportation system, we're decades. And this trial is just the beginning of that long story.
- femto 9y agoThere's a current trend for people to anthropomorphise cars, with the backing of the industry (two eyes/lights and a mount/grill on the front of "him/her"). Won't the industry go into overdrive on the anthropomorphism front to try and preserve this judicial empathy?
- CydeWeys 9y agoPeople can't be cars, so, no.
- dilanj 9y agoAccording to the latest info, it doesn't look like the system was at fault at all. Seem like the likely homeless woman abruptly stepped into traffic. Every accident still of-course is terrible, but some maybe are unavoidable. https://www.sfchronicle.com/business/article/Exclusive-Tempe-police-chief-says-early-probe-12765481.php https://www.sfchronicle.com/business/article/Exclusive-Tempe...
- question_that 9y agoIf she stepped into traffic outside a crosswalk then I'm not sure what result anyone is expecting.
- beedogs 9y agoFunny how this story has been pushed off the front page of HN prematurely.
- aanet 9y agoI would hate to have been the (backup driver) in this sad situation. Regardless, the regulations couldn't come soon enough. From SF Chronicle [1]: <QUOTE> The self-driving Volvo SUV was outfitted with at least two video cameras, one facing forward toward the street, the other focused inside the car on the driver, Moir said in an interview. From viewing the videos, “it’s very clear it would have been difficult to avoid this collision in any kind of mode (autonomous or human-driven) based on how she came from the shadows right into the roadway,” Moir said. The police have not released the videos. The incident happened within perhaps 100 yards of a crosswalk, Moir said. “It is dangerous to cross roadways in the evening hour when well-illuminated, managed crosswalks are available,” she said. ... “I suspect preliminarily it appears that the Uber would likely not be at fault in this accident, either,” Moir said. However, if Uber is found responsible, that could open a legal quagmire. “I won’t rule out the potential to file charges against the (backup driver) in the Uber vehicle,” Moir said. But if the robot car itself were found at fault? “This is really new ground we’re venturing into,” she said. </QUOTE> [1] https://www.sfchronicle.com/business/article/Exclusive-Tempe-police-chief-says-early-probe-12765481.php https://www.sfchronicle.com/business/article/Exclusive-Tempe...
- chriskanan 9y ago>>The pedestrian was outside of the crosswalk. As soon as she walked into the lane of traffic she was struck. >>Tempe Police Chief Sylvia Moir said that from viewing videos taken from the vehicle “it’s very clear it would have been difficult to avoid this collision in any kind of mode (autonomous or human-driven) based on how she came from the shadows right into the roadway. A lot of comments on here are faulting machine learning for this or algorithmic flaws, but unless we see the video it is really hard to blame the algorithms. Based on the quote from the story, it sounds like someone stepped out into the street, not in the crosswalk, at night, directly in front of a car going 40 miles per hour. How could a human or any algorithm cope with that scenario?
- 40four 9y agoLook, this is a super sad story & it obviously illicits many emotions & thoughts from all of us. As a community of programmers, this is a topic very near & dear to or hearts. But we have to be realistic here. Fatalities caused by automobiles are always going to be a problem. I don't care if 100% of vehicles are automated & they are all communicating to each other through the internet. There will still be fatalities. Errors will happen. We can't even program basic websites without some chance of errors & some chance of the whole thing come crashing to a halt. Why would anyone think we could program cars to drive themselves without an error every now & then? I don't care if we knew that the AI driving tech was 100% perfect. There would STILL be fatalities. You can't teach a computer program to break the laws of physics. If an person or vehicle crosses in front of your path, & it is unreasonable to predict, by human brain or computer, you WILL collide with it. Let's be real. We don't know what happened here & maybe never will. It's unfortunate & we all share our sympathies with those involved. But this isn't the 1st death that involved an automated vehicle & it won't be the last. I think the self driving tech we have is already amazing so let's not diminish it. As programmers we can't break the laws of physics. Freak accidents will always happen. (I'm not saying this is what happened, because I have no idea) but if a pedestrian or bicyclist falls in front of a vehicle at the last second,no human or computer driver can prevent that. Physics takes over. These moments will be important, now & in the future. how about we stop fighting with each other, & figure out how to process tragedies like this & communicate to the public that automobile fatalities will never be solved with software?
- msie 9y agoEveryday I see crazy, drunk or angry people just walk across the road recklessly. Some seem to walk in defiance of the cars.
- keypusher 9y ago> Elaine Herzberg, 49, was walking her bicycle outside the crosswalk on a four-lane road in the Phoenix suburb of Tempe about 10 p.m. > Tempe Police Chief Sylvia Moir said that from viewing videos taken from the vehicle “it’s very clear it would have been difficult to avoid this collision in any kind of mode (autonomous or human-driven) based on how she came from the shadows right into the roadway." This seems like an unfortunate accident, but it's not at all clear that the car was at fault or that it could have done anything to prevent it. There was even a human behind the wheel and they didn't react in time either.
- thfaway 9y agoA human being would have honked the horn while driving past something behind which someone can appear suddenly..But I doubt you can add those kinds of logic into a machine learning system...
- gkya 9y agoI can't describe how shocking it is watching many HN commented blame a person killed by a machine and defend the thing instead. There are even those who are saying that such deaths are necessary and useful for the advancement of technology.
- tim333 9y ago>The self-driving Volvo SUV was outfitted with at least two video cameras, one facing forward toward the street, the other focused inside the car on the driver, Moir said in an interview. >From viewing the videos, “it’s very clear it would have been difficult to avoid this collision in any kind of mode (autonomous or human-driven) based on how she came from the shadows right into the roadway,” Moir said. ( https://www.sfchronicle.com/business/article/Exclusive-Tempe-police-chief-says-early-probe-12765481.php https://www.sfchronicle.com/business/article/Exclusive-Tempe... ) Not saying the software wasn't partly at fault but it doesn't look that clear cut. It sounds like better sensors could have helped.
- scottmcdot 9y agoShouldn't '[Coming] from the shadows' be irrelevant when the sensors are LIDAR?
- ACow_Adonis 9y agoOne also needs to consider the relative dynamic range of the camera/video in terms of both sensors and playback. If the hardware is not capable of capturing sufficient dynamic range to be able to see into the shadows while driving in daytime/nighttime in this location, one must ask why not? That seems obviously negligent. If the car can see into the shadows (say either with lidar or sufficiently sensitive hardware) then a self driving car either just failed to identify and predict the object and subsequently killed a pedestrian, or it detected them and killed them anyway. If it killed them anyway, it may be that it was physically impossible for them to avoid the detected object, or forensics (if properly performed) would show that the collision was avoidable. All of these scenarios seem pretty inconsistent with the hypothesis of the police chief knowing what the duck he's taking about, and I question what the hell he's doing releasing such a statement before the evidence is in...
- drieddust 9y agoIs it normal for police to give these kind of statements right away? I thought they need to present evidence to the court of law instead of giving verdict themselves.
- kwhitefoot 9y agoWhy is everyone concentrating on the software? There was a human in charge and the car was exceeding the speed limit. That sounds like either driving without due care and attention or reckless driving. After all the driver's reaction time is almost certain to be much longer when supervising an autonomous car than when driving directly making it much more important to adhere to the rules. And if it can be shown that it was company policy to allow the cars to exceed the speed limit then heads should roll all the way to the top of the company.
- kawfey 9y agoIt was exceeding the speed limit by 3mph, I don't believe this far exceeds safe margins.
- the_cat_kittles 9y agocould there be some way of emitting a signal on your person so cars never get confused? seems like a pain in the ass, but maybe it would be worth it? cars can know for sure there are people wherever the signal is emitted from? dunno if its feasible, curious
- HGGLLJNLJHU 9y agohttp://www.autonocast.com/blog/2018/1/18/46-part-two-of-a-conversation-with-velodyne-about-the-past-present-and-future-of-lidar http://www.autonocast.com/blog/2018/1/18/46-part-two-of-a-co...
- bambax 9y agoIf the car is deemed non-responsible it makes it the perfect crime... How long before someones tries to program a car to "hunt" a victim and hit her when she makes a mistake and it will appear it was a pure accident with no-one at fault?
- hndamien 9y agoI don't see why this lesson could not be learned on a test track or simulator.