People just assume that superhuman AI will have human desires: safety, control, power. We want those things because any humans that didn't want them didn't surv

People just assume that superhuman AI will have human desires: safety, control, power. We want those things because any humans that didn't want them didn't survive to pass on their genes. But a human-built AI will be subject to very different evolutionary pressures. I don't think we can say anything for certain about what it will want.