How are you so sure about any of this? I'm not sure we've defined humanity's interests well enough for us to say some action is for or against it. Knowing where

How are you so sure about any of this? I'm not sure we've defined humanity's interests well enough for us to say some action is for or against it. Knowing where air will go is one thing; knowing whether or not something is 'of benefit' is, I think, in a completely different realm. Especially considering an agent more intelligent than humanity as a collective. Maybe the 'interests of humanity' are undecidable, and the AGI that takes the actions that benefit them most uses an understanding completely orthogonal to ours, purely by accident. How do you know that this is less likely than not?