3 ms·
It sounds like a piece of fearmongering nastiness until you think of it in terms of mathematics rather than psychology. A so-called "artificial intelligence" i
by eli_gottlieb 13y ago
It sounds like a piece of fearmongering nastiness until you think of it in terms of mathematics rather than psychology. A so-called "artificial intelligence" is just an extremely sophisticated active, online learning agent designed to maximize some utility function or (equivalently) minimize some loss function. There's no term in a loss function for "kill all humans", but neither is there one for "do what humans want", or better yet, "do what humans would want if they weren't such complete morons half the time".
- TeMPOraL 13y agoOr as Eliezer nicely phrased it once in a paper[0], > "The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else." [0] - http://yudkowsky.net/singularity/ai-risk http://yudkowsky.net/singularity/ai-risk