4 ms·
LLMs are radically unlike organic minds. Given their performance, I think it is important to pay attention to their weirdnesses — I can call them "intelligent"
by ben_w 3y ago
LLMs are radically unlike organic minds.
Given their performance, I think it is important to pay attention to their weirdnesses — I can call them "intelligent" or "dumb" without contradiction depending on which specific point is under consideration.
Transistors outpace biological synapses by the same degree to which a marathon runner outpaces continental drift. This speed difference is what allows computers to read the entire text content of the internet on a regular basis, whereas a human can't read all of just the current version of the English language Wikipedia once in their lifetime.
But current AI is very sample-inefficient: if a human were to read as much as an LLM, they would be world experts at everything, not varying between "secondary school" and "fresh graduate" depending on the subject… but even that description is misleading, because humans have the System 1/System 2[0] distinction and limited attention[1], whereas LLMs pay attention to approximately everything in the context window and (seem to) be at a standard between our System 1 and System 2.
If you're asking about an LLM's intelligence because you want to replace an intern, then the AI are intelligent; but if you're asking because you want to know how many examples they need in order to decode North Sentinelese or Linear A, then (from what I understand) these AI are extremely stupid.
It doesn't matter if a submarine swims[2], it still isn't going to fit into a flooded cave.
[0] https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow
[1] https://youtu.be/vJG698U2Mvo?si=omf3xleqPw5u6Y2k https://youtu.be/vJG698U2Mvo?si=omf3xleqPw5u6Y2k
https://youtu.be/ubNF9QNEQLA?si=Ja-9Ak4iCbcxbWdh https://youtu.be/ubNF9QNEQLA?si=Ja-9Ak4iCbcxbWdh
https://youtu.be/v3iPrBrGSJM?si=9cKHXEvEGl764Efa https://youtu.be/v3iPrBrGSJM?si=9cKHXEvEGl764Efa
https://www.americanbar.org/groups/intellectual_property_law/publications/landslide/2014-15/march-april/that-s-wrap-online-agreements-gaming-kids/ https://www.americanbar.org/groups/intellectual_property_law...
[2] https://www.goodreads.com/quotes/32629-the-question-of-whether-a-computer-can-think-is-no https://www.goodreads.com/quotes/32629-the-question-of-wheth...
- lukeschlather 3y ago> if a human were to read as much as an LLM, they would be world experts at everything It would take a human more than one lifetime to read everything most LLMs have read. I often have trouble remembering specifics of something I read an hour ago, never mind a decade ago. I can't imagine a human being an expert in something they read 300 years ago.
- glial 3y ago> LLMs are radically unlike organic minds. I used to think this too, but now I'm not so sure. There's an influential school of thought arguing that one of the primary tasks of the brain is to predict sensory input, e.g. to take sequences of input and predict the next observation. This perspective explains many phenomena in perception, motor control, and more. In an abstract sense, it's not that different from what LLMs do -- take a sequence and predict the next item in a sequence. The System 1 snd System 2 framework is appealing and quite helpful, but let's unpack it a little. A mode of response is said to be "System 1" if it's habitual, fast, and implemented as a stimulus-response mapping. Similar to LLMs, System 1 is a "lookup table" of actions. System 2 is said to be slow, simulation-based, etc. But tasks performed via System 2 can transition to System 1 through practice ('automaticity' is the keyword here). Moreover, pre-automatic slow System 2 actions are compositions are simpler sets of actions. You deliberate about how to compose a photograph, or choose a school for your children, but many of the component actions (changing a camera setting, typing in a web URL) are habitual. It seems to me that what people call System 2 actions are often "stitched-together" System 1 behaviors. Solving calculus problem may be System 2, but adding 2+3 or writing the derivative of x^2 is System 1. I'm not sure the distinction between Systems 1 and 2 is as clear as people make it out to be -- and the effects of practice make the distinction even fuzzier. What does System 2 have that LLMs lack? I'd argue: a working memory buffer. If you have working memory, you can then compose System 1 actions. In a way, a Turing machine is System 1 rule manipulation + working memory. Chain-of-thought is a hacky working memory buffer, and it improves results markedly. But I think we could do better with more intentional design. [1] https://mitpress.mit.edu/9780262516013/bayesian-brain/ https://mitpress.mit.edu/9780262516013/bayesian-brain/ [2] https://pubmed.ncbi.nlm.nih.gov/35012898/ https://pubmed.ncbi.nlm.nih.gov/35012898/