4 ms·
Is this true? Non-reasoning LLMs are autoregressive. Reasoning LLMs can emit thousands of reasoning tokens before "line 1" where they write the answer.
by johnfn 7mo ago
Is this true? Non-reasoning LLMs are autoregressive. Reasoning LLMs can emit thousands of reasoning tokens before "line 1" where they write the answer.
- computerex 7mo agoThey are all autoregressive. They have just been trained to emit thinking tokens like any other tokens.
- rimliu 7mo agothere are no reasoning LLMs.
- johnfn 6mo agoThis is an interesting denial of reality.
- aqfamnzc 6mo agoA "reasoning" LLM is just an LLM that's been instructed or trained to start every response with some text wrapped in <BEGIN_REASONING></END_REASONING> or similar. The UI may show or obscure this part. Then when the model decides to give its "real" response, it has all that reasoning text in its context window, helping it generate a better answer.
- bearjaws 6mo agoreasoning is just more tokens that come out first wrapped in <thinking></thinking>