4 ms·
Of course it isn't how the human mind works. You can ask a person "did you come up with that sentence, or is it something you read?" And they can answer that q
by hyperpape 6y ago
Of course it isn't how the human mind works.
You can ask a person "did you come up with that sentence, or is it something you read?" And they can answer that question. The answer isn't perfectly reliable, but it isn't completely unreliable either. You can't do that with GPT-2/GPT-3.
Big picture: the human mind is a machine of sorts. It's not the same kind of machine as any form of machine learning we've developed so far.
- ben_w 6y ago> The answer isn't perfectly reliable, but it isn't completely unreliable either. How would we be able to tell how reliable it is in general? """The left brain of people whose hemispheres have been disconnected has been observed to invent explanations for body movement initiated by the opposing (right) hemisphere, perhaps based on the assumption that their actions are consciously willed.""" - https://en.wikipedia.org/wiki/Neuroscience_of_free_will#Related_brain_disorders https://en.wikipedia.org/wiki/Neuroscience_of_free_will#Rela...
- alisonkisk 6y agoThe point is that humans have a basic ability to make specific coherent observations about themselves and the world. GPT can't do that except occasionally by accident in the middle of a muddle.
- _flux 6y agoIn this case you could do it with GPT-x as well, if you have access to the learning material (so the OpenAI could do it when providing the model as a service): grep the learning data after-the-fact. No idea if it would be feasible to integrate this information directly into the model. With my limited understanding of neural networks, this seems difficult.