5 ms·
We've almost had several nuclear weapons launched due to flaws in human decision making, two that were launched with the inputs of humans, and a ton of wars lau
by savanaly 7y ago
We've almost had several nuclear weapons launched due to flaws in human decision making, two that were launched with the inputs of humans, and a ton of wars launched with the input of humans. What about an AI being involved automatically makes the situation so much worse?
- throwaway2048 7y agoWe understand how people work and think pretty well, their edgecases, and countermeasures to said edgecases. We don't understand edge cases of AI much at all, and the terrain-space of "possible minds" they might be is vastly broader than that of a human mind, and utterly outside our experience. An AI might work with absolute 100% flawless precision for 100 years, then decided one day to kill everyone. A lot harder to see that coming from a totally alien intelligence than a human one. AI does not think like humans, have human values, or care about what humans care about, that might make them extremely unpredictable and dangerous. There will be no time for iterative development, or learning from our mistakes, a sufficiently advanced AI knows we would try to stop it, and make sure that we never can. https://www.youtube.com/watch?v=tcdVC4e6EV4 https://www.youtube.com/watch?v=tcdVC4e6EV4
- yaur 7y agoLook at any of the "flash crashes" of recent years were out of control AI escalated the problem much faster than humans could react to it. Just take that and imagine that there are nuclear weapons involved.
- kasey_junk 7y agoOk. None of those have had any long term negative outcomes. What was I supposed to imagine?
- azinman2 7y agoA stock dipping isn’t so bad because it can go back up. A nuclear missiles cannot unexplode.
- kasey_junk 7y agoAnd professionals price the downside into those trades. You don’t engineer trades the same way you do nukes cause it literally doesn’t matter if you get them wrong. As the history of “flash crashes” has shown.
- throwaway2048 7y agoA Bit easier to recover from a market dip than a nuclear strike don't you think?
- cheez 7y agoIt wasn't even that you recovered from the dip, the trades were actually busted (invalidated.) Can't unexplode a bomb, for sure.
- kasey_junk 7y agoTrades are not routinely busted during flash crashes.
- cheez 7y agoThey were in "the" flash crash.
- gknoy 7y agoIt had some pretty long term negative effects for Knight Capital.
- kasey_junk 7y agoKnight didn’t suffer from a flash crash. They suffered from a operational risk incident. This is literally something that professionals price into their trades. The long term negative ramifications were nothing. The next day a new firm was running the same trades under the same name.
- cheez 7y agoI thought Knight got bought out a year later?
- ChrisLomont 7y agoAnd for those few failures think of the trillions and more of the decisions that machines made that did not harm, but made lives better than before machines were doing work for us.