9 ms·
DOD officials say autonomous killing machines deserve a look
- kneel 11y agoThey're kind of like smart land mines, we'll kill people when you're not around except this time we promise we'll try to only kill bad guys, pinky promise.
- ZoeZoeBee 11y agoIf anyone believes using autonomous killing machines is inherently evil and no doubt beset with Unintended Consequences, I invite you to donate to the "Campaign to Stop Killer Robots", and hopefully make autonomous killing machines illegal by international law. http://www.stopkillerrobots.org/ http://www.stopkillerrobots.org/
- Nutmog 11y agoIs there any argument against autonomous guns, other than that they might go wild and cause a lot of unexpected deaths? We shouldn't mind them sometimes making mistakes and killing innocent people because human soldiers already do that often enough. Perhaps the robots will be slightly more accurate than humans, and that's surely good for everybody except their enemies. Maybe the real question we should be asking is why humans are allowed to kill people? When two countries fight each other, soldiers on both sides somehow decide it's OK to kill the other. They can't both be right, so in any war, thousands of flesh and bones killing machines (all soldiers on the "wrong" side) effectively go wild and try to kill lots of inappropriate people. That shows that human decision making is extremely poor, and can even unanimously agree on the same lethal wrong decision.
- deleted 11y ago[deleted]
- RobertoG 11y ago"Is there any argument against autonomous guns, other than that they might go wild and cause a lot of unexpected deaths?" Yes, that a robot always obey orders. In my opinion that is the most dangerous thing about this issue. Anyway, it's only a philosophic question because this is going to happen. "We" can talk about it, but "we" are not deciding anything. "They can't both be right" Not, but they can both be wrong, that is what normally happens.
- mtreis86 11y agoHumans are not much better than robots at disobeying orders, as demonstrated in the Milgram experiments.
- shpx 11y agoMilgram conducted 23 different kinds of experiments, each with a different scenario, script and actors. This patchwork of experimental conditions, each conducted with a sample of only 20 or 40 participants, yielded rates of obedience that varied from 0% to 92.5%, with an average of 43%. Contrary to received opinion, a majority of Milgram’s participants disobeyed. [0] What's the obedience rate of a robot? [0] http://theconversation.com/revisiting-milgrams-shocking-obedience-experiments-24787 http://theconversation.com/revisiting-milgrams-shocking-obed...
- studentrob 11y agoThey don't need to go wild to cause more civilian deaths than soldiers would. There is much less risk sending a robot to kill than there is sending a human. Humans fear death. Robots do not. Contractors claim that drones are accurate. However that can never guarantee that the human controllers are accurate. Humans controlling robots may err to the side of killing too many than too few, to a greater degree than soldiers would. So yeah I think there are some reasonable arguments against them. Jet fighters and bombers are somewhat limited by personnel and higher equipment costs. Drones do not require as much training to operate and will not have as much of a personnel constraint in the future. They could be as dangerous or worse than nuclear weapons for a country that is being attacked by them in the future. Rather than wiping out a population, drones could create slaves.
- nxzero 11y agoWow, surprise; no sarcasm, to me, this means they already have one and believe the public will support its release.
- valine 11y ago"These are hard questions, and a lot of people outside of us tech guys are thinking about it." It seems to me there is an easy answer. Building Robots that can kill people without supervision is currently a terrible idea. AI, or whatever you would like to call it, should not be allowed to take a humans being's life. We make our law enforcement officers pass psych exams before they are put in situations where they need to kill someone. Until a robot can pass the same exam, I'm not comfortable with autonomous killing machines.
- DamnYuppie 11y agoSadly I am sure we could program to easily pass that test. Machines killing without oversight is a terrible idea regardless of the # of tests they can pass.
- adrianN 11y agoYou could say the same about people. I'm not sure why we treat machines differently. If we can build robots that can discriminate people we're okay with killing ("enemies") from innocents about as well as human soldiers, where is the problem? I don't think we currently can do that, but that might change in the future.
- spatulan 11y agoWe've had autonomous killing machines since WW2, and nobody seemed to care until recently when everything got reframed in a scary Skynet/Terminator way. Most people seem to get their knowledge on the subject more from movies than reality.
- harryf 11y ago...and we've already had an instance of autonomous killing machine gone wild. - http://www.wired.com/2007/10/robot-cannon-ki/ http://www.wired.com/2007/10/robot-cannon-ki/
- deleted 11y ago[deleted]
- ianamartin 11y agoI find it interesting the way this was described at the end of the article. The idea that this is a necessary development in the case that some enemy uses ECM to disrupt the link between the robot and its human controller. Because that will probably sound reasonable to most people. "Hey, hey, hey now. We're not sending unmanned terminators out to battle to search and destroy any living thing. This our cute little droney-drone drone. We call him Charlie the unicorn. Now if the bad baddy bad terrorists do something bad to Charlie and make it so he can't receive orders, don't you want Charlie to be able to protect himself?" And the robot apocalypse begins. Not with an army of soul-crushing t-1000s, but with an M-79 grenade launcher dressed up as a puppy. My guess is that by 2035, we will be mostly okay with it though. Putting AI in charge of driving cars is, by definition, letting AI make life/death choices. If we're okay with that, we are inherently accepting that these ethical situations can and will be accurately modeled. If you can tell a car how to make a decision between hitting an old lady in the street vs. crashing into a tree and killing the passenger and get that right enough to please the public, I'm sure we can figure out how to tell a robot in a battle situation which person to shoot . . . well enough to please the public.
- paulsutter 11y agoSounds like Wing Attack Plan R. How could that go wrong? https://www.youtube.com/watch?v=n8qCkVklFWE&feature=youtu.be&t=208 https://www.youtube.com/watch?v=n8qCkVklFWE&feature=youtu.be... It's Dr Strangelove all over again. (Dr Strangelove was about a crazy general who launched a nuclear attack, using a provision that he was able to do so on losing contact with Washington)
- Joof 11y agoThis happened to a Russian nuclear submarine that got caught in a US training exercise near Cuba. 2/3 officers voted to authorize a nuclear attack. https://en.wikipedia.org/wiki/Vasili_Arkhipov https://en.wikipedia.org/wiki/Vasili_Arkhipov
- Ciantic 11y agoI would argue US should start training their AI already, in combat situation human senses becomes more suspectible for finding threats where there isn't any. They could use the AI for real-time analysis of video feed in helicopters etc. Highly publized incident comes to mind where the poor camera man was gunned down mistakenly when human operators thought he was wielding RPG, whilte it was likely a camera he was holding. Could the AI have detected it?
- mgiannopoulos 11y agoThis is how it begun, robot historians will write.
- throweway 11y agoIf there are any left
- vectorjohn 11y agoAnd if they lost the knowledge of English grammar.
- throweway 11y agoDaleks!
- pmlnr 11y agoThe Daleks are not machines; there is a living thing inside of the shell.
- ryporter 11y agoAutonomous killing machines are a natural progression of military technology. They will certainly be created by someone at some point in the future. Thus, our military should definitely be researching this topic, and that's all that they are doing now.
- deleted 11y ago[deleted]
- vlehto 11y agoEverything DoD says or does is partially American propaganda. (I say "propaganda", because "information war" is American propaganda.) And we are dealing with a U.S. hegemon. It all started with American revolutionary war, and continued as "democratization". U.S. was based on an idea of liberating people from monarchs. And as U.S. set out to do that, DoD /CIA got really good at meddling other countries business. Now the original idea has been abandoned, democratization might not do any good anymore, even cold war is over, but Yankees still keep "power projecting". Institutions tend to keep on doing what they are good at. If powerful institution loses purpose, it invents a new one. Because there is certain "survival of the fittest" even when dealing with taxpayer money. And ultimately I'm grateful for this as a whole, because U.S. set a model of democratic free market society that has been copied and improved around the world. Back to propaganda. DoD is scared that other countries would increasingly use autonomous weapons in area denial missions. This would be really detrimental to "power projection". For example you don't wan't Chinese to use swaths of cheap autonomous boats to occupy south China sea. U.S. carrier fleet is way too expensive to deal with such saturation. Missile may cost more than entire boat. Other nasty possibility is cheap unmanned Cessnas flying around with short range Infra Red seeking missiles. That would make SEAD mission lot more demanding, as you need to kill the Cessna first and so notify everybody that "we are coming". U.S. is technology leader. Whatever Lockheed Martin does, is copied around the world. Whatever they don't do, gets significantly less eyeballs. DoD uses this as an advantage. Most recent example is infrared search and track(IRST). USAF was lacking in this respect just recently, because USAF has radar stealth. Putting money into IRST in late 80's would have been smart move to anybody else. But as DoD didn't do it, herd mentality went with RADAR. And USAF has stealth, nobody else does. Now U.S. employs autonomous weapons in assault missions in ground war. If other countries copy that tech, it does hardly anything to U.S. assets in air or sea. But for "short while" U.S. gets diminished casualties and even more frightening weapons. If people find autonomous weapons too inhumane in attack role of ground war, that might result in international ban of all autonomous weapons. Win-Win. We have precedent. DoD teaching Cambodian guerrillas to set up mines. -> Ottawa treaty. I'm not saying U.S. did that on purpose. But I'm pretty sure DoD military analysts's learned from that experience.
- goldenkey 11y agoI think you brought up a better point. Invading countries are going to have a hell of a time if sentries are set up. Booby traps and mines are one thing. But autonomous sentries are well, very hard to remove without risking harm
- bad_alloc 11y agoJust playing the devil's advocate here: * No soldiers of the side deploying armed drones need to be in danger. * Robots do not act cruelly unless specifically instructed. Humans do have a pretty bad record of unnecessary cruelty due to racism, boredom, intoxication etc. * If you log all descision making processes, you can justify each action taken. It's like bodycams for police officers. If you'd make all logs public after the war it would be possible to identify war crimes and who gave the order (unlike now). * Nothing requires a machine to use lethal force all the time. Systems which have the primary purpose of capturing combattants can be considered when there's no risk of losing one of your own soldiers. * Your robots priority doesn't have to be self-preservation (unlike a human soldier). When in doubt, don't shoot and analyze the situation. All in all, if the military would use these autonomous killing machines with the intent of minimizing covilian casualties, would this not be an improvement over the current state of warfare? Of course it won't make war per se less likely, but not using these machines doesn't either. So why not use them?
- nxzero 11y agoStarting to think HN is full of sock puppets. Here's a downside, robots don't care about killing the population that paid to create them. Basically, every single claim you're making is false or is easily spun to be a negative.
- danieldk 11y agoRobots do not act cruelly unless specifically instructed. I agree that in theory, killbots fighting killbots could lead to very clean wars. The problem is that the least powerful party will quickly resort to 'kill and torture as many civilians as possible' as a means of revenge, psychological warfare, terrorism, etc. The ethics of robots will be the ethics of humans. More powerful and effective killing machines will amplify the behavior of immoral humans.
- atemerev 11y agoThis is inevitable. Remote controlled drones are prone to jamming, hacking and human factor. Whoever deploys autonomous warfare systems first will have an advantage in battlespace.
- velox_io 11y agoI'm surprised there isn't currently a 'personal air support drone', that can fit into a troop's backpack. Which is little more than a flying grenade (with a video stream that can go round corners). Such a device could be made from off the shelve components and help protect against snipers.
- FranOntanaya 11y agoThere's already a few. http://www.businessinsider.com/heres-the-tiny-drone-the-us-military-is-testing-2015-6 http://www.businessinsider.com/heres-the-tiny-drone-the-us-m... https://www.youtube.com/watch?v=1tetyswGyGA https://www.youtube.com/watch?v=1tetyswGyGA
- nickpsecurity 11y agoThe first use will be for border security as in Babylon A.D.: https://youtu.be/MQNUvaPi4Qk?t=42m15s https://youtu.be/MQNUvaPi4Qk?t=42m15s Lot of border. Fast response needed. Damage whole families trying to make it. Operate with little human input for a lot of them. Perfect thing for militarist governments to delegate to killing machines instead of people. Side benefit of dodging some responsibility for bad choices where they blame it on machine logic.
- bane 11y agoIn "The Golden Oecumene" trilogy (one of the densest and greatest looks at a possible real future I've ever read), the world is run by a collection of benevolent super-intelligence AIs. One of the themes in the book is the notion of hyper-extending current technology trends and exploring what society will be like under such circumstances. In the series, the take on the military is fascinating. Extending out the notions of precision and limiting collateral damage, orbital weapons are able to take out specific neural connections in targets and cause them to change their thinking process entirely. While the weapons in this future picture are large automated robots and AIs of a type, the actual operator is human. In fact a single human is all that remains (and is needed) to provide all the judgment and justification needed to take action. But the books still posit that a human-in-the-loop is still necessary. Great and very challenging books https://en.wikipedia.org/wiki/The_Golden_Oecumene https://en.wikipedia.org/wiki/The_Golden_Oecumene
- vonnik 11y agoIs it just me, or does this seem like an Onion headline? It's the juxtaposition of the very serious "autonomous killing machines" with the casual "deserve a look", I think. Like they might have autonomous killing machines for lunch if that was offered as the special
- x5n1 11y agoCan't wait until a dictator uses autonomous killing machines to, you know, just take over the world.
- faddat 11y agoNo thank you. I like my earth earth-y and not scorched Armageddon style. Hubris!