2 ms·
https://faculty.washington.edu/ebender/papers/Stochastic_Parrots.pdf https://faculty.washington.edu/ebender/papers/Stochastic_Par... > As we discuss in §5, LM
by hprotagonist 6y ago
https://faculty.washington.edu/ebender/papers/Stochastic_Parrots.pdf https://faculty.washington.edu/ebender/papers/Stochastic_Par...
> As we discuss in §5, LMs are not performing natural language understanding (NLU), and only have success in tasks that can be approached by manipulating linguis- tic form [14].
- drdeca 6y agoThis doesn't answer my question. I asked what you mean by "sample their training data", and questioned the meaning of "do anything novel". The quote you gave doesn't clarify anything? "Some people say that it doesn't perform 'NLU' ." . Ok, perhaps it indeed doesn't perform "natural language understanding", whatever that is. So? How does that say anything about what I said? Obviously GPT3 isn't a person, or even an agent. The thing it is meant to do is model the distribution of text. Do not pretend that I am pretending otherwise.