3 ms·

Could be that it doesn’t have tokens with high enough probabilities so it outputs nothing.

• minimaxir 3y ago
  By construction, softmaxing the logits will force all the probabilities to sum up to 1.