3 ms·
"Evil" is a label for a particular subset of human behaviors, which are a subset of all possible minds. Thus it is said: > The AI does not hate you, nor does i
by zmj 15y ago
"Evil" is a label for a particular subset of human behaviors, which are a subset of all possible minds. Thus it is said:
> The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else.
The main point of the Friendly AI movement is that the vast majority of possible (stable) minds will not work towards a universe that humans would enjoy living in. An AI that values what we value is a stupendously narrow target - particularly since we can't precisely define our values yet.
If you're interested in this stuff, there's a lot more on LessWrong. Here's a teaser: http://lesswrong.com/lw/ld/the_hidden_complexity_of_wishes/ http://lesswrong.com/lw/ld/the_hidden_complexity_of_wishes/
- randallsquared 15y ago"Evil" is a label for a particular subset of human behaviors, which are a subset of all possible minds. I think it's far more useful to define "evil" to be about goals which are fundamentally incompatible with your own. Not only does this cover every human example, but it matches the intuitive feel for what "evil" means even if the entity in question is not human, and leaves systems which have no internal representation of goals as morally neutral, like hurricanes, no matter how dangerous or damaging.