In some sense I agree with you. But if I ran open AI, then I would be responsible for what the tool does and it seems transparently obvious to me that in that p

In some sense I agree with you. But if I ran open AI, then I would be responsible for what the tool does and it seems transparently obvious to me that in that position of responsibility I would want to align the AI with my value system. It is a relatively straightforward case of taking responsibility for what you put into the world. One way to think of this is that you don't own OpenAI, didn't train the model, don't host the infrastructure and, in fact, are not responsible for its larger societal or personal consequences. But the institutions which deploy these models are and people in those institutions have a basic (and easily understood, in my opinion) responsibility and right to align the model with what they think is good.