3 ms·
These newer "reasoning" LLMs really don't feel like pure text completers any more.
by simonw 2y ago
These newer "reasoning" LLMs really don't feel like pure text completers any more.
- jordemort 2y agoAnd yet
- gavinray 2y agoIs it not physically impossible for LLM's to be anything but "plausible text completion"? Neural Networks as I understand them are universal function approximators. In terms of text, that means they're trained to output what they believe to be the "most probably correct" sequence of text. An LLM has no idea that it is "conversing", or "answering" -- it relates some series of symbolic inputs to another series of probabilistic symbolic outputs, aye?
- int_19h 2y agoAt this point you need to actually define what it means for an LLM to "have an idea".
- Borealid 2y agoWhat your parent poster said is nonetheless true, regardless of how it feels to you. Getting text from an LLM is a process of iteratively attempting to find a likely next token given the preceding ones. If you give an LLM "The rain in Spain falls" the single most likely next token is "mainly", and you'll see that one proportionately more than any other. If you give an LLM "Find an unorthodox completion for the sentence 'The rain in Spain falls'", the most likely next token is something other than "mainly" because the tokens in "unorthodox" are more likely to appear before text that otherwise bucks statistical trends. If you give the LLM "blarghl unorthodox babble The rain in Spain" it's likely the results are similar to the second one but less likely to be coherent (because text obeying grammatical rules is more likely to follow other text also obeying those same rules). In any of the three cases, the LLM is predicting text, not "parsing" or "understanding" a prompt. The fact it will respond similarly to a well-formed and unreasonably-formed prompt is evidence of this. It's theoretically possible to engineer a string of complete gibberish tokens that will prompt the LLM to recite song lyrics, or answer questions about mathemtical formulae. Those strings of gibberish are just difficult to discover.
- Workaccount2 2y agoThe problem is showing that humans aren't just doing next word prediction too.
- Borealid 2y agoI don't see that as a problem. I don't particularly care how human intelligence works; what matters is what an LLM is capable of doing and what a human is capable of doing. If those two sets of accomplishments are the same there's no point arguing about differences in means or terms. Right now humans can build better LLMs but nobody has come up with an LLM that can build better LLMs.
- baq 2y agoThat’s literally the definition of takeoff, when it starts it gets us to singularity in a decade and there’s no publicly available evidence that it’s started… emphasis on publicly available.
- myk9001 2y ago> it gets us to singularity Are we sure it's actually taking us along?
- johnisgood 2y ago> but nobody has come up with an LLM that can build better LLMs. Yet. Not that we know of, anyway.
- Aeolos 2y agoGiven the dramatic uptake of Cursor / Windsurf / Claude Code etc, we can be 100% certain that LLM companies are using LLMs to improve their products. The improvement loop is likely not fully autonomous yet - it is currently more efficient to have a human-in-the-loop - but there is certainly a lot of LLMs improving LLMs going on today.
- 2y ago