4 ms·
The probability of token generation is a function of the logits. Do you have an actual point related to the linked paper?
by _delirium 2y ago
The probability of token generation is a function of the logits. Do you have an actual point related to the linked paper?
- anon291 2y agoThat is one way of sampling tokens. It is not the only way. Logits do not map neatly to belief, although it is convenient to behave as if they do