4 ms·
I'm inclined to agree, but positing that "the meaning of a word is its use in a language" is a perfectly respectable philosophical position. In this sense, GPT
by macrolocal 5y ago
I'm inclined to agree, but positing that "the meaning of a word is its use in a language" is a perfectly respectable philosophical position. In this sense, GPT3 empirically bolsters Wittgenstein.
- PaulHoule 5y agoGiven that Chomksy's paradigm (and all the others) have failed so completely at automated language understanding I'm much more inclined to believe that the "language instinct" is a peripheral for an animal and if you want language understanding you need the animal or a simulation of the animal. Thus I reject Wittgenstein.
- macrolocal 5y agoThat's why it's so amazing that language models have gotten so far with just proximity statistics! Btw, this paper https://arxiv.org/abs/2106.07890 https://arxiv.org/abs/2106.07890 outlines a promising approach to mapping the semantics encoded in these models. Understanding their limits could make your rejection of Wittgenstein all the more precise.