4 ms·
The threat basically boils down to runaway destructive swarms which destroy infrastructure or poison the atmosphere etc. Imagine an AI agent which manipulates
by radicaldreamer 2y ago
The threat basically boils down to runaway destructive swarms which destroy infrastructure or poison the atmosphere etc.
Imagine an AI agent which manipulates exposed SCADA systems. That could be incredibly destructive!
- moralestapia 2y ago/s? GP's point (and I agree) is that an evil actor could, in principle, do those things already (and a much more intelligent one, while we're at it). And yet, it doesn't happen. Why? Because reality is not a "winner takes all" game. Actions carry consequences and other factors limit the extent of damage any actor could do. It is way more threatening to human life that there exists, today, a huge stockpile of nuclear weapons all around the world.
- 39896880 2y agoAn evil actor could do those things, but they don’t because smart people work really hard to build systems that make doing those things more difficult and/or with dire consequences to the potential actors. Shrugging at the AI threat reminds me of “I felt better so I stopped taking the medication.”
- moralestapia 2y ago>smart people work really hard ... Nah, you'll be surprised at how dumb things in the real world could be; like, the nuclear briefcase password is probably 0000-0000. Punishment and retaliation is what deters most people from going rogue. Note that by retaliation I do not mean "fear of retaliation", I mean the actual consequences that come to you from FAFO in the real world.
- radicaldreamer 2y agoThe codes to launch the nukes was literally just zeroes until 1977. https://en.wikipedia.org/wiki/Permissive_action_link#:~:text=According%20to%20nuclear%20safety%20expert,all%20missile%20launch%20control%20centers https://en.wikipedia.org/wiki/Permissive_action_link#:~:text....