3 ms·
LLMs have the ability to convince you that they've "reasoned". sometimes, an application will loop the output of an LLM to its input to provide a "chain of reas
by bigfishrunning 8mo ago
LLMs have the ability to convince you that they've "reasoned". sometimes, an application will loop the output of an LLM to its input to provide a "chain of reasoning"
This is not the same thing as reasoning.
LLMs are pattern matchers. If you trained an llm only to map some input to the output of John Steinbeck, then by golly that's what it'll be able to do. If you give it some input that isn't suitably like any of the input you gave it during training, then you'll get some unpredictable nonsense as output.
- simianwords 8mo agothis is outdated stuff from 3 years ago. > If you trained an llm only to map some input to the output of John Steinbeck this is literally not possible because the llm does not get generalised reasoning ability. this is not a useful hypothetical because such an llm will simply not work. why do you think you have never seen a domain specific model ever? if you wanted to falsify this claim: "llm's cant reason" how would one do that? can you come up with some examples that shows that it can't reason? what if we come up with a new board game with some rules and see if it can beat a human at it. just feed the rules of the game to it and nothing else. here is gpt-5.4 solving never before seen mathematics problems: https://epochai.substack.com/p/gpt-54-set-a-new-record-on-frontiermath https://epochai.substack.com/p/gpt-54-set-a-new-record-on-fr... you could again say its just pattern matching but then i would argue that its the same thing we are doing.
- bigfishrunning 8mo agoDomain specific LLM's absolutely exist, don't assume i've never seen one. You seem very misinformed on what is "literally not possible". https://www.ibm.com/think/topics/domain-specific-llm https://www.ibm.com/think/topics/domain-specific-llm
- simianwords 8mo agothere are close to zero domain specific models that beat frontier SOTA models even in their own domain. (other than few edge cases like token extraction) why do you think that's the case? lets start from here. the real answer is that you get benefits from having data from many sources that add up expontentially for intelligence. > LLMs are pattern matchers but lets try to falsify this. can you come up with a prompt that clearly shows that LLM's can't reason?
- RobRivera 8mo agoWhat do you do for work?
- simianwords 8mo agolets keep it focused on the discussion - in a previous thread you called me a troll. start with a way to falsify that it can't reason.