4 ms·
I'd respectfully disagree with this characterization of LLMs. While they certainly excel at pattern recognition, calling them mere "autocomplete machines" vastl
by ttul 2y ago
I'd respectfully disagree with this characterization of LLMs. While they certainly excel at pattern recognition, calling them mere "autocomplete machines" vastly undersells their capabilities. LLMs demonstrate complex reasoning, multi-modal understanding, and emergent behaviors that go well beyond simple pattern continuation.
They've succeeded in areas like mathematical problem-solving, creative tasks, and various real-world applications outside of GitHub Copilot. Sure, LLMs have limitations, but reducing them to autocomplete overlooks their nuanced language understanding and generation abilities. I also think the "lossy translation" argument doesn't give enough credit to the sophisticated ways problems can be reformulated for LLMs.
- lolinder 2y agoI never said that we couldn't use them for other things—it turns out that a lot of problems can be translated to autocomplete! And yes, in many cases the loss can be made minimal by being clever with the translation. What I'm saying is that nearly every failure of LLM applications boils down to the engineers not understanding that they're just autocomplete engines. Most new LLM products are put together by someone who claims to be an "AI Engineer" but who approaches an LLM with magical thinking and only a vague understanding of the way they work internally. They're autocomplete machines. That's not a bad thing or an argument that they're incapable of solving complex problems, it's just the reality of what they're doing, and a good AI engineer understands that and works with it.
- billti 2y agoIn that vein, posting comments to hackers news is just an auto-complete, or “what should the next token be” problem, right? :-) Yet here we all are, reading the comments, looking for insights, knowledge, and entertainment.
- complaintdept 2y ago> LLMs demonstrate complex reasoning, multi-modal understanding, and emergent behaviors that go well beyond simple pattern continuation. Can they win Wordle yet?
- arcbyte 2y agoEither this whole comment is from a GPT or the author is a major contributor to the GPT training dataset. Anyway, LLMs are nothing more than very expansive error reduction algorithms. They don't reason. They store and manipulate meaning in an automated way, but they don't reason.
- martin-t 2y agoI don't understand how anybody can still claim LLMs show "complex reasoning". It's been shown time and time again that they'll produce a correct chain of reasoning when given a problem (e.g. wolf, goat, cabbage crossing a river; 3 guards and a door; etc.) that is roughly similar to what's in the training data but will fail when given a sufficiently novel modification _while still producing output that is confidently incorrect_. My own recent experience was asking ChatGPT 3.5 to encode an x86 instruction into binary. It produced the correct result and a page of reasoning which was mostly correct, except 2 errors which if made by a human would be described as canceling each other out. But GPT didn't make 2 errors, that's anthropomorphizing it. A human would start from the input and use other information plus logical steps to produce the output. An LLM produces a stream of text that is statistically similar to what a human would produce. In this particular case, it's statistics just weren't able to cover the middle of the text well enough but happened to cover the end. There was no "complex reasoning" linking the statements of the text to each other through logical inferences, there was simply text that is statistically likely to be arranged in that way.
- ericlewis 2y agoPerhaps it’s because I know human beings that have the exact same operation and failure mode as the LLM here and I’m probably not the only one. Failing at something you’ve never seen and faking through it is a very human endeavor.
- martin-t 2y agoRegarding errors: I don't know the exact mechanism in the brain that causes humans to make them but i believe it's a combination of imperfect memory, attention span and general lack of determinism. None of these affect logical reasoning as performed by a machine. Regarding faking it till making it: This is a more general point that there's a difference between simulating human behavior and logical reasoning.
- danielmarkbruce 2y agoIf you teach your kids to read, they behave almost exactly like an LLM in so many cases it's eery.
- skybrian 2y agoI wouldn't say they're mere autocomplete machines, but their tendency to go into a loop to complete a pattern does break the magic, since it's a rather machine-like thing to do.