When humans build a dam an ant hill might get destroyed. Humans don’t hate ants, they just have other goals. In the case of an unaligned superintelligent AGI

When humans build a dam an ant hill might get destroyed. Humans don’t hate ants, they just have other goals. In the case of an unaligned superintelligent AGI those goals may be something that just happens to satisfy its reward function but is otherwise “dumb” or unintentional (like making a lot of paper clips). Intellectual capability does not get alignment for free. What you see in the communicated text interface and the goals/system behind it are not the same (that cartoon with the smiley face), and we don’t understand how to evaluate the underlying state.