4 ms·
Because humans aren't powerful enough to completely exterminate each other (even a nuclear war wouldn't kill literally everyone in the world), but an unaligned
by lumenwrites 3y ago
Because humans aren't powerful enough to completely exterminate each other (even a nuclear war wouldn't kill literally everyone in the world), but an unaligned AI, in the worst case scenario, could just kill everybody (to eliminate humans as a threat, or to use the atoms we're made out of for something else, or just as a side effect of doing whatever it actually wants to do). It could be powerful enough to do that, and have no reason not to.
- dr_dshiv 3y agoI don’t find it plausible in a highly intelligent system to do that. Small chance.
- digging 3y agoActually, it's an unknowable chance.
- TeMPOraL 3y agoImagine humanity is some random species of wildlife, or insects, and AI is humanity. As a "highly intelligent system", we have a long history of extincting animal species, and we're well on track to eventually extinct most of them, despite it's highly likely this will make Earth uninhabitable for us, ending with humanity dying off too. Why do you think AI can't casually extinct us, because it doesn't need us (or thinks it doesn't), and we're just in the way of whatever it is that it wants to do?
- dr_dshiv 3y agoWe know it will be more intelligent than us. As we get more intelligent we care more about these things (biodiversity, etc). Why wouldn’t AI?
- TeMPOraL 3y ago> As we get more intelligent we care more about these things (biodiversity, etc). Why wouldn’t AI? Well, we care for various reasons, major one being our own survival and comfort. Given what that means in practice, we'd be better off dead than having an AI care about us like we care about animals and plants.