4 ms·
There really is no good psychological equivalent. About the best analogy I can come with is freestyle rapping where the genre requires that you just keep talki
by HarHarVeryFunny 2y ago
There really is no good psychological equivalent.
About the best analogy I can come with is freestyle rapping where the genre requires that you just keep talking with minimal time to think.
An LLM isn't an intelligent being deciding to talk when it has something to say - it's an LLM - a text continuation machine - that will generate a word every time the generation scaffolding pushes the button. Just like the freestyle rapper, it doesn't have the option of not saying something just because it has nothing to say. It's "concerned" about flow (just keeping the sentence going), not content.
- crabmusket 2y agoI love the idea of saying "the computer was just freestyling that bit".
- pixl97 2y agoIf you seperate your brain into different components and functions, which portion of your brains work like your description? If we take something like an embodied AI that has locomotion, audio/visual IO, and the ability to perform actions and part of that action loop is triggering an LLM when does it start looking more like us?
- HarHarVeryFunny 2y agoI really doubt that an LLM (a transformer) can be extended into a brain just by adding all the missing pieces. A pre-trained transformer is just fundamentally different - it's really just a rules-based expert system (cf. Cyc) not the beginnings of any cognitive architecture. That said, if you wanted to make the least-worst analogy between a pre-trained transformer and part of the brain, then I suppose it'd be like a single pass though the cortex (although the same could be said of a CNN, which tells you how poor the analogy is).