4 ms·
> "It is not designed to tell you the "most likely" text that follows," It is exactly designed to do that. A temperature of 0 this is what you are approximatin
by wantsanagent 2y ago
> "It is not designed to tell you the "most likely" text that follows,"
It is exactly designed to do that. A temperature of 0 this is what you are approximating. The crucial point though is that it is the most likely next word given the proceeding multi-token context, not just the previous token.
- elcomet 2y agoIt's not designed to output the most likely séquence. It's designed to output the most likely next token. That's quite different.