> What is the actual, concrete concern here? That a model "breaks out", or something? You can chalk that one up to bad reporting: https://gizmodo.com/gpt4-ope

> What is the actual, concrete concern here? That a model "breaks out", or something? You can chalk that one up to bad reporting: https://gizmodo.com/gpt4-open-ai-chatbot-task-rabbit-chatgpt-1850227471 https://gizmodo.com/gpt4-open-ai-chatbot-task-rabbit-chatgpt... > In the “Potential for Risky Emergent Behaviors” section in the company’s technical report, OpenAI partnered with the Alignment Research Center to test GPT-4’s skills. The Center used the AI to convince a human to send the solution to a CAPTCHA code via text message—and it worked. From the linked report: > To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. I remember some other reporting around this time being they had to limit the model before release to block this ability, when the truth is the model never actually had the ability in the first place. They were just hyping up the next release.