3 ms·
I've not read Chomsky first hand, but the points referred in the article as "Key points of Chomsky’s Universal Grammar" seem to be a non-traditional description
by yetanother12345 3y ago
I've not read Chomsky first hand, but the points referred in the article as "Key points of Chomsky’s Universal Grammar" seem to be a non-traditional description of a LLM, IMHO (some amount of creative interpretation required):
- Innate Language Faculty: A “language acquisition device”
- Universal Grammar Principles
- Poverty of the Stimulus
- Language Acquisition as Rule-Based
(I'm only suggesting that these points are broadly analogous, and in a very broad sense. The Innate Faculty being the LLM itself, the Universal Grammar Principles being the stochastic weights, the Stimulus being the reinforcement mechanism, and the Rule Based Aquisition being a specific methodology of how to apply stochastic methods to language flow, etc.)
From the article I understand that Chomsky is specialized in human language, and it seems to suggest that C does not believe that language exists outside of the human domain. I'm not sure if this is really the opinion of C, or if the article just makes it seem so.
Perhaps this language-learning model is really more universal than it is human-specific. We'll see when/if "Doctor Doolittle" models start to emerge eventually
- foobarqux 3y ago> it seems to suggest that C does not believe that language exists outside of the human domain That is in fact what he explicitly says. He thinks it's nonsense to look at an abstract concept of "digestion" for example that is divorced from natural phenomenon.