2 ms·
In a sense, LLMs emergently figured out the deep structure of language before we did, and that’s the most remarkable thing about them.
by sebmellen 1y ago
In a sense, LLMs emergently figured out the deep structure of language before we did, and that’s the most remarkable thing about them.
- hashmush 1y agoI dunno, it seems you have figured it out too, probably before LLMs? I'd say all speakers of all languages have figured it out and your statement is quite confusing, at least to me.
- Waterluvian 1y agoWe all make grammar mistakes but I’ve yet to see the main LLMs make any.
- sebmellen 1y agoYes of course we’ve implicitly learned those rules, but we have not been able to articulate them fully ala Chomsky. Somehow, LLMs have those rules stored within a finite set of weights. https://slator.com/how-large-language-models-prove-chomsky-wrong-with-steven-piantadosi/ https://slator.com/how-large-language-models-prove-chomsky-w...