This doesn't answer my question. I asked what you mean by "sample their training data", and questioned the meaning of "do anything novel". The quote you gave d

This doesn't answer my question. I asked what you mean by "sample their training data", and questioned the meaning of "do anything novel". The quote you gave doesn't clarify anything? "Some people say that it doesn't perform 'NLU' ." . Ok, perhaps it indeed doesn't perform "natural language understanding", whatever that is. So? How does that say anything about what I said? Obviously GPT3 isn't a person, or even an agent. The thing it is meant to do is model the distribution of text. Do not pretend that I am pretending otherwise.