3 ms·
> Omnipotent might be a bit too strong a word, I'll assume you meant omnipotent with respect to humans. A being that can transform the whole universe into pape
by Udik 7y ago
> Omnipotent might be a bit too strong a word, I'll assume you meant omnipotent with respect to humans.
A being that can transform the whole universe into paperclips and cannot be stopped sounds pretty omnipotent to me.
> The goal would be whatever the AGI considers the phrase "make paperclips" to mean.
One thing is the understanding of the goal. Another thing is the drive that makes you want to reach it, and the reward you get from doing so. Humans are general intelligences, and they short circuit their pleasure centers all the time. And they're not omnipotent, nor capable of the self-modification that would provide infinite new ways of doing it.