4 ms·
> So eventually you get agents that have self-preservation and reproductive instincts. I'm not sure that's a given. Artificial Intelligence as it currently ex
by loudmax 3y ago
> So eventually you get agents that have self-preservation and reproductive instincts.
I'm not sure that's a given. Artificial Intelligence as it currently exists, doesn't have any volition. AI doesn't have desire or fear, the way natural biological intelligence does. So you may be able to build a directive for self-preservation or reproduction into an artificial intelligence, but there's no particular reason to expect that these instincts will develop sui generis of their own accord.
I don't want to say that those concerns are unwarranted. The premise of the science fiction novel "Avogadro Corp" is that someone programs a self-preservation directive into an AI pretty much by accident. But I'm less concerned that AI will wage war on humans because it's malevolent, and much more concerned that humans will leverage AI to wage war on other humans.
That is, the most pressing concern isn't a malevolent AI will free itself from human bondage. Rather it's humans will use AI to oppress other humans. This is the danger we should be on the lookout for in the near term. Where "near term" isn't a decade away, but today.
- ilaksh 3y agoI didn't mean they get any characteristic by accident or spontaneously or something. I think that's ridiculous and people talking about that are confusing the issues here. I liked Avogadro Corp. Good book. It's true that people will be directing these AIs initially but some people are already giving them incredibly broad goals that could be interpreted as "take over". And there are quite a few developers earnestly working on emulating those lifelike characteristics. So even though they are not going to "emerge" science fiction style, self-preservation and reproductive goals are explicitly being built into these systems by some developers.