3 ms·
My understanding is that o1's chain-of-thought tokens are in its own internal embedding, and anything human-readable the UI shows you is a translation of these
by PoignardAzur 2y ago
My understanding is that o1's chain-of-thought tokens are in its own internal embedding, and anything human-readable the UI shows you is a translation of these CoT tokens into natural language.
- inciampati 2y agoWhere is that documented? Fwiw, interactive use suggests they are not available to later invocations of the model. Any evidence this isn't the case?
- inciampati 2y agoI found this documentation from openai that supports my hunch: https://platform.openai.com/docs/guides/reasoning/advice-on-prompting https://platform.openai.com/docs/guides/reasoning/advice-on-... The reasoning tokens from each step are lost. And there is no indication that they are different tokens than regular tokens.