3 ms·
OpenAI's o1 and o3 models forget what they thought
- inciampati 2y agoReasoning models from OpenAI forget what their past reasoning. The reasoning tokens are removed from context after the user-visible response is generated. It's not what I expected, given that memory of reasoning is the key to chain or thought's success.