I think recent Anthropic work showed that they "plan" future tokens in advance in an emergent way: https://www.anthropic.com/research/tracing-thoughts-language

I think recent Anthropic work showed that they "plan" future tokens in advance in an emergent way: https://www.anthropic.com/research/tracing-thoughts-language-model#:~:text=Does%20Claude%20plan%20its%20rhymes? https://www.anthropic.com/research/tracing-thoughts-language...