I think the ideas is that the LLM cannot think internally. It’s output is its thinking process. Especially with an auto regressive architecture like GPT, where

I think the ideas is that the LLM cannot think internally. It’s output is its thinking process. Especially with an auto regressive architecture like GPT, where each output token becomes part of the input. I imagine it like handing the LLM a piece of scratch paper.