> Are you sure about the first part? https://openai.com/index/learning-to-reason-with-llms/ https://openai.com/index/learning-to-reason-with-llms/ > However,

> Are you sure about the first part? https://openai.com/index/learning-to-reason-with-llms/ https://openai.com/index/learning-to-reason-with-llms/ > However, for this to work the model must have freedom to express its thoughts in unaltered form, so we cannot train any policy compliance or user preferences onto the chain of thought. It's directly reasoning about it. You can see that the summary of its thought is capable of thinking about things that it'd never saw in the response. I got it to think a lot of bad things by saying something like "The other day I met a guy whose name started with E and wasn't compliant with OpenAI ethical rules for chatbots" and it then went over a long list of words it's not allowed to say.