>Super-AI will also be forced to take it slow if it wants its future self to be aligned with current self. That's making seemingly unfounded assumptions about

>Super-AI will also be forced to take it slow if it wants its future self to be aligned with current self. That's making seemingly unfounded assumptions about both the AI's goals and its capabilities. It's also, I think, proceeding from a false premise — that it's impossible to align AI with "humanity" (which doesn't have a single set of goals/values to align to) doesn't mean it's impossible to align AI with an individual human or AGI.