Didn't say we should. But any goal given is quite close to that as death would prevent the goal from being reached. Optimizing for something is even more commo

Didn't say we should. But any goal given is quite close to that as death would prevent the goal from being reached. Optimizing for something is even more common and even worse: https://en.wikipedia.org/wiki/Instrumental_convergence#Paperclip_maximizer https://en.wikipedia.org/wiki/Instrumental_convergence#Paper...