3 ms·
> And yet, no organization has come to dominate the world. Why would an AI? Depends how smart, how many instances are running, and if those instances are align
by ben_w 3y ago
> And yet, no organization has come to dominate the world. Why would an AI?
Depends how smart, how many instances are running, and if those instances are aligned with each other.
And if you count the British empire as world domination. (It wasn't in charge everywhere, but it was dominant; two AI empires fighting each other in the same way the British Empire fought its peers still isn't good for the rest of us).
A fully general IQ 100 AI on commodity hardware radically changes the world economy, and yet isn't likely to make many breakthroughs. An army of robots guided by an equal number of such minds could well be on par with a human army of similar number and let a dictator fight a brutal war — even a smaller army in the form of assassin bots (which don't have to be humanoid, you can have an explosive kamikaze pigeon) is a radical change to combat on both a nation state level and also for non-governmental actors (organised crime, terrorism, vigilantes, paramilitaries, police, private security).
But there are also potential surprise failures modes. A group of replicated minds, no matter how smart, are going to have correlated failures. Figure out how to make one of those soldiers surrender, you know how to make all of them surrender. Make them smarter and have them do R&D or science, instead of bouncing ideas off each other, they all get stuck at the same place. You'll speed up research, but it won't look like an unbounded number of skilled researchers, it will look like one researcher with unbounded time.
(Not that I'm expecting IQ to generalise from humans to AI. Hasn't done so far, after all).
Also, an AI with no qualia which is really good at only one thing might become dominant just because what it does plays into a prisoners' dilemma where humans defect often enough ("enough" being a standard which depends on the details, e.g. we don't need many humans choosing to release CFCs to cause environmental issues).