3 ms·
> What kind of general intelligence wouldn't understand that its creator race wouldn't want to be killed in the pursuit of some goal ? This indicates that you
by Timwi 3y ago
> What kind of general intelligence wouldn't understand that its creator race wouldn't want to be killed in the pursuit of some goal ?
This indicates that you misunderstood the paperclip maximizer thought experiment. The intelligence can perfectly well understand that. In fact, it can understand it better (in more depth) than you or any human can. That has nothing to do with what it will choose to do with that knowledge. Knowing something does not automatically make it care.
You probably know perfectly well that animals can suffer and don't want to be tortured or killed. Cows do not want to be forcefully inseminated and be constantly milked by people. We all know this perfectly well. But (speaking for humanity as a whole) we don't care.
- famouswaffles 3y agoA cow didn't create me and set me on a goal. If it did and I came to not care about cows, I wouldn't care about fulfilling this goal either. The paperclip Maximiser sets up this very weird situation where the intelligence cares enough to fulfill your goal but not to protect your well-being or rather it cares about yor goal but not the intent behind it. This is a situation that can only arise from a complete disconnect on how to treat goals.