3 ms·
I think the proposed ban is: don't develop weapons with software that can make the killing decisions without humans in the loop. That itself isn't so impossible
by Jach 9y ago
I think the proposed ban is: don't develop weapons with software that can make the killing decisions without humans in the loop. That itself isn't so impossible a ban to make something like the CWC out of, but nations couldn't even stop 3D gun printing, despite the same sort of worries.
Additionally, even with that ban, you could have the exact same video with the minor difference that each drone sends its video stream to a human somewhere else who presses a button to authorize each suggested-by-the-drone kill. And if we got that far, the pressure to get rid of the ban would be immense, because tool AIs are better as agent AIs.
And if we can't even handle regular old microsystems technology, how are we going to handle nanotech? https://www.amazon.com/Military-Nanotechnology-Applications-Preventive-Contemporary/dp/0415407990 https://www.amazon.com/Military-Nanotechnology-Applications-... (and briefly covered in this talk by the same author http://www.youtube.com/watch?v=MANPyybo-dA http://www.youtube.com/watch?v=MANPyybo-dA) discusses it but in the 11 years since it was published I see no reason to think the world is any better prepared.
- bufferoverflow 9y agoYou can't really ban software. Sooner or later someone will write it, opensource it, and it will be on GitHub/piratebay.
- soVeryTired 9y agoIt's probably impossible to stop someone weaponising a drone and piloting it with AI. But you can control how well the result is executed. If a computer scientist teamed up with an engineer and a chemist they could probably jerry rig something that would work. Sort of. But if Northrop Grumman tried to build these things with a billion dollar budget behind them, they might actually succeed in replicating the drones in the video.
- nradov 9y agoWeapons that make killing decisions without humans in the loop have existed for a long time. For example captor naval mines that sit tethered in place and then launch a torpedo when they detect a vessel nearby. Those aren't going away.