2 ms·
> Do LLMs present emergent capabilities You say no. I will have to disagree. Not in the fuzzy sense of "emergent = intelligent" people seem to be using. But in
by namaria 2y ago
> Do LLMs present emergent capabilities
You say no. I will have to disagree. Not in the fuzzy sense of "emergent = intelligent" people seem to be using. But in that LLMs are under the hood doing complex linear algebra, and when you pair numbers with words (or token word fragments), something like human language seems to emerge.
LLMs have no concept of language, just matrices. The fact that we can map language to matrices with training, and then matrices to language with generative transformers, doesn't mean there's anything like intelligence going on. It's just pattern matching all the way down. But a surrogate of NLP emerges out of this.