4 ms·

> then some lower probability tokens may be chosen Can you explain how it chooses one of the lower-probability tokens? Is it just random?

• acchow 3y ago
  Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.
  • acchow 3y ago
    Oops backwards. Increasing temperature...