4 ms·
Relying on token probabilities seems like the exact opposite of random
by rcme 3y ago
Relying on token probabilities seems like the exact opposite of random
- esafak 3y ago"Random" is a loose term. We're discussing a technical subject. Talk about the distribution the random numbers are sampled from.
- sigmoid10 3y agoThe neural network just generates a set of probabilities for all tokens. The actual next token is then sampled from this set, which is always random for T>0 (and in the case of GPT4 even for T=0, because of the way the model itself works).