> This isn't an argument, it is an assumption. The goals could be our lives. So it's just a statement of reality for the sake of the rest of the comment, indee

> This isn't an argument, it is an assumption. The goals could be our lives. So it's just a statement of reality for the sake of the rest of the comment, indeed not an argument. The AI will have goals and those will be more important than someone else's goals, at least outside of some sort of control mechanism. They could be summarized with the same words, but will still have a different perception. The rest is wondering at whether we can have any confidence as to whether our lives will be its goals. This is a problem long-term AI safety advocates are trying to solve.