>Put another way, there’s a risk of AIs learning to achieve their assigned task better by preventing humans from shutting them down. Thought experiment/short s

>Put another way, there’s a risk of AIs learning to achieve their assigned task better by preventing humans from shutting them down. Thought experiment/short story that goes into this in depth: https://gist.github.com/deanmarano/142df7a8a824ab05fc777d8e054ab0f3 https://gist.github.com/deanmarano/142df7a8a824ab05fc777d8e0... The crux of the story hinges on the magical spontaneous development of general intelligence, so it's pretty unconvincing as a specific plausible scenario IMO. But the general idea, that an AI may take unethical/unprecedented actions to maximize a harmless goal, is a good one.