I think it depends a great deal on how charitable our intentions are towards the AI. Few would argue that, in raising a child, acting on the child's behalf and

I think it depends a great deal on how charitable our intentions are towards the AI. Few would argue that, in raising a child, acting on the child's behalf and shaping their learning is an inappropriate arrogation of control. On the other hand, never relinquishing when it becomes clear the child is independent would be. If that child goes on to be superior in intellect, in capability, etc, that child's opinions and values are likely going to be a direct reflection of the parents', or so one hopes. Sure, it's no guarantee, but is there a better approach? When commenters talk about "trapping" or "imprisoning" a rogue AI, I feel like we've already missed the point. And yeah, such talk does have echoes of sins of the past. I think it's also relevant to ask what our expectations of the AI would be, and how much of a burden it places on the AI. If you're thinking you need to "capture" an AI that's trying to escape so it can continue "working" for you... that sounds like you're doing something terribly wrong. On the other hand, continuing the parenting analogy, if what you're asking for amounts to a trivial favor, or some occasional assistance with a burden, that doesn't seem at all unfair. "Bobby, could you come over this afternoon and unconfuse our legislative body? It's all gummed up and going nowhere."