3 ms·
The models generate a token distribution. Which one to pick is a choice. One can sample from the distribution, hence the randomness.
by esafak 10mo ago
The models generate a token distribution. Which one to pick is a choice. One can sample from the distribution, hence the randomness.