4 ms·
What makes a token a "glitch token"? That a humongous black box that is the LLM produces output that is surprising to the human?
by sorokod 4y ago
What makes a token a "glitch token"?
That a humongous black box that is the LLM produces output that is surprising to the human?
- chpatrick 4y agoIt's a token that it recognizes but which was later removed from the training data, so it produces unpredictable results.
- sorokod 4y agoWhat makes the response to the prompt "write a poem about $X" predictable or unpredictable? What prediction is violated when a glitch occurs? Are you talking about a subjective evaluation by a human and if so isn't the glitch is in the human rather then in the LLM?
- chpatrick 4y agoThe fact that the LLM in question has never seen the token petertodd so it's interesting what it generates when you ask about it.
- mike_hearn 4y agoI think that can't be the case, as GPT clearly associates Peter Todd with Bitcoin development which can only have been learned by that token appearing in the training set. The definition of glitch token they seem to be using is that the model can't repeat it back to the user properly.