3 ms·
I feel like that point was equally made with “colorless green ideas sleep furiously” Moreover, in linguistics 101, students are often introduced to case studie
by wodenokoto 4y ago
I feel like that point was equally made with “colorless green ideas sleep furiously”
Moreover, in linguistics 101, students are often introduced to case studies of people with aphasia and similar issues which illustrates how humans can produce coherent and grammatical speech without meaning (just like chatgpt) and how people can lose the understanding of certain classes of words.
Lastly, NN are often seen as a way to model functions (again, students are often asked to produce different logic gates by hand, to convince themselves that NN can be Turing complete) so rather than language being inherently probabilistic chatgpt might just have reasonably inferred the rules of language.
- narag 4y agoThank you, I didn't know about that sentence. Anyway my point is not that language is inherently probabilistic, but that the way our brains implement language could be. Or more precisely, one layer of language could be this way, with other "watchdog" layer on top of it filtering when the less rigorous layer goes rogue and spits nonsense. The base layer could be the graphical one, middle layer language, top layer logic. Between layers, the jokes.