3 ms·
"The training algorithm is designed to create the most plausible text possible" That may be how they're trained, but these things seem to have emergent behavio
by pmoriarty 4y ago
"The training algorithm is designed to create the most plausible text possible"
That may be how they're trained, but these things seem to have emergent behavior.
- gwright 4y agoI'm not sure why you call it "emergent" behavior. Instead, my take away is that much of what we think of as cognition is just really complicated pattern matching and probabilistic transformations (i.e. mechanical processes).
- zmmmmm 4y agoyeah ... the depressing thing is that a large amount of human behaviour may well be exactly like LLMs - we think, "what should I say now" to reply to something and in the vast majority of cases the response is based almost entirely on "what would another reasonable person similar to me say in this situation?". I think that is in part why we find LLMs so appealing and lifelike.