4 ms·
I wonder if there is a clever/more efficient shortcut that could come from before the sample is taken on each token. We have the logits after all.
by mlsu 3y ago
I wonder if there is a clever/more efficient shortcut that could come from before the sample is taken on each token. We have the logits after all.