> In my opinion this type of comment is the core problem with AI alignment these days. [...] The current GPT models are not going to "wake up" or accidentally t

> In my opinion this type of comment is the core problem with AI alignment these days. [...] The current GPT models are not going to "wake up" or accidentally take over the world. This is very obvious. [...] Executing "arbitrary code" that InstructGPT models outputs based on your instructions is not a danger. I meant to comment on the security aspects of sending confidential information to models and letting them generate output that will be immediately executed on your own machine. People also chain models together and let them generate output that will be interpreted as the next model's input. If done without guardrails, this is done ideally in a sandboxed environment. Too often, I see this type of code just ran on one's machine. As the projects attract less technical people, they may not be aware of the dangers of running such code locally and can see a portion of their data being wiped or exposed.