3 ms·
o1 appears to not be able to see it's own reasoning traces. Or it's own context is potentially being summarized to deal with the cost of giving access to all th
by inciampati 2y ago
o1 appears to not be able to see it's own reasoning traces. Or it's own context is potentially being summarized to deal with the cost of giving access to all those chain of thought traces and the chat history. This breaks the computational expressivity or chain of thought, which supports universal (general) reasoning if you have reliable access to the things you've thought, and is threshold circuit (TC0) or bounded parallel pattern matcher when not.
- PoignardAzur 2y agoMy understanding is that o1's chain-of-thought tokens are in its own internal embedding, and anything human-readable the UI shows you is a translation of these CoT tokens into natural language.
- inciampati 2y agoWhere is that documented? Fwiw, interactive use suggests they are not available to later invocations of the model. Any evidence this isn't the case?
- inciampati 2y agoI found this documentation from openai that supports my hunch: https://platform.openai.com/docs/guides/reasoning/advice-on-prompting https://platform.openai.com/docs/guides/reasoning/advice-on-... The reasoning tokens from each step are lost. And there is no indication that they are different tokens than regular tokens.