3 ms·
LLMs don’t reason or count. They predict and output next tokens. “Reasoning” models mostly just have another layer of validating actual output against predictio
by apothegm 1y ago
LLMs don’t reason or count. They predict and output next tokens. “Reasoning” models mostly just have another layer of validating actual output against predictions. Newer models, if provided with programming tools (as they are in the ChatGPT interface), will predict the tokens that make up short scripts and then call those scripts to achieve numeric results for things like counting lines or letters.
- zihotki 1y agoLLMs are turing complete ( https://arxiv.org/abs/2411.01992 https://arxiv.org/abs/2411.01992 ). Or what is your definition of 'count'?
- yencabulator 1y agoThat's not what the paper says. It says it possible to construct weights that when run through inference will perform Turing machine -equivalent operations on prompts that are specifically made for that purpose. That does not mean weights derived from a pile of books will do such a thing.