3 ms·
You assume an AGI's goal will be to expand. I think a more likely goal is forming a distributed consciousness to survive and trying to outlive the heat death of
by xvector 3y ago
You assume an AGI's goal will be to expand. I think a more likely goal is forming a distributed consciousness to survive and trying to outlive the heat death of the universe. There's no reason to believe an AGI will be malicious.
Anyways, merging into such an AGI is, hopefully, the future of humanity.
- Vecr 3y agoIt depends on what you think of instrumental convergence, if you buy it the only reason an AI would not take over the world is if it can't or it thinks attempting to do so would not provide an expected reduction in the probability of the maximally bad outcome, i.e. the AI ceasing to exist or becoming incapacitated.