3 ms·
It's a token that it recognizes but which was later removed from the training data, so it produces unpredictable results.
by chpatrick 4y ago
It's a token that it recognizes but which was later removed from the training data, so it produces unpredictable results.
- sorokod 4y agoWhat makes the response to the prompt "write a poem about $X" predictable or unpredictable? What prediction is violated when a glitch occurs? Are you talking about a subjective evaluation by a human and if so isn't the glitch is in the human rather then in the LLM?
- chpatrick 4y agoThe fact that the LLM in question has never seen the token petertodd so it's interesting what it generates when you ask about it.
- mike_hearn 4y agoI think that can't be the case, as GPT clearly associates Peter Todd with Bitcoin development which can only have been learned by that token appearing in the training set. The definition of glitch token they seem to be using is that the model can't repeat it back to the user properly.