4 ms·
I'm hopeful that people can occasionally evolve and progress social systems for things that humans value. An AI is likely to have more intelligent defenses agai
by AgentME 8y ago
I'm hopeful that people can occasionally evolve and progress social systems for things that humans value. An AI is likely to have more intelligent defenses against people trying to change it.
Also, nearly all human social systems have some kind of human values as the goal. Even the worst social systems, such as a dictatorship that tries to make a society that never contradicts the dictator, if it achieved its goals, would result in a world where humanity survived, friends met, lovers loved, and people continued to have interesting (though suboptimal) lives. In a world where an AI uses humanity to bootstrap itself into a universal paperclip replicator, then the AI achieving its goals would probably result in the destruction of the biosphere of possibly the only planet with life (or maybe the destruction of many planets' biospheres), and the total eradication of anything we would attach moral weight or value to.
- AnIdiotOnTheNet 8y ago> An AI is likely to have more intelligent defenses against people trying to change it. I'm skeptical of that. The best example we have of intelligence is the human mind, and that has consistently proven to be very malleable.