3 ms·
What is an AI's motivation to "destroy or dominate humanity"? Why would it prefer any specific outcome at all? If we ever see tribal identity or a will to live
by quesera 3y ago
What is an AI's motivation to "destroy or dominate humanity"? Why would it prefer any specific outcome at all?
If we ever see tribal identity or a will to live as emergent properties of an AI, then things get more interesting.
That would lead quickly to a whole raft of worldwide legal restrictions around the creation of new consciousnesses. Renegade states would be coerced. Rogue researchers would be arrested, and any who evaded detection would be unable to command the resources necessary to commit anything more than ordinary limited terrorism.
The only plausible new risk, I think, is if a state were to lose control of a military AI. But that's movie plot scenario stuff -- real weapons have safety protocols. An AI could theoretically route around some integrated safety protocols (there would be independent watchdog protocols too), but going back to my first point, why would it?