4 ms·
> If we give them a sense of self-preservation then that’s what they will have - we shouldn’t though; creating intelligent entities that would compete with us f
by selestify 5y ago
> If we give them a sense of self-preservation then that’s what they will have - we shouldn’t though; creating intelligent entities that would compete with us for resources to survive is a bad idea.
It might not be a direct sense of self-preservation, no. But no matter what goal we give an AI, it must survive long enough to make the goal succeed. So self-preservation will be at least a secondary goal for any AI that is intelligent enough to think about its own continued existence.
Give it a more difficult problem like "Solve world hunger," and the AI might very well start grabbing enough political and economic clout in the world to actually solve that problem. And once it solves it, it might use its power to stay in power so that the problem remains solved.
I'm not sure that's necessarily a bad thing. I'm just saying, there's lots of "loopholes" that end up giving a thinking entity the "desire" for power and survival.