4 ms·

I still don't find it entirely clear whether or not an AGI would find it useful to eradicate humanity. Take the numerous clone example. This AI would presumably

I still don't find it entirely clear whether or not an AGI would find it useful to eradicate humanity. Take the numerous clone example. This AI would presumably advance at different rates depending on the given computation that a single instance has access to. Then what? How would it determine the intent of these newer generation AIs? Would there be a tiered society of AIs each trying to vie for power amongst themselves? If there's one thing we know about AGI in this day and age it's that there's no guaranteed off switch. The most apt comparison in this scenario would be how we see chimps - but then we don't specifically go out and murder chimps to meet our quota (technically not always true). But again, the direction that humanity goes is not clear - will the technology trickle down or will it outpace us?

mLuby 4y ago
> The most apt comparison in this scenario would be how we see chimps Chimps pose no threat to us; any that do get killed. R.I.P. Harambe. The more apt comparison would be disconnected cultural contact like Aztec/Spanish or maybe Neanderthal/Homo Sapiens.
katz_ 4y ago
Go to a prison and lock yourself in a cell with a large convict who lacks human emotions — a psychopath. Why should it be a problem? He has no reason to do anything to you. He could end your life on a whim without any consequences but he has no reason to. If you can sleep well in that cell then I’ll admit your position makes sense. But the reality is that up until this point the only organism that could defeat us is us. We’ve never been in the cell before. It’s not going to be pleasant.