7 ms·
No, any randomness is from the temperature setting that just tells mainly tells how much to sample the probability mass of the next output vs choose the exact n
by cma 2y ago
No, any randomness is from the temperature setting that just tells mainly tells how much to sample the probability mass of the next output vs choose the exact next most likely (which tends to make them get in repetitive loop like convos).
- pegasus 2y agoThere's randomness besides what's implied by the temperature. Even when temperature is set to zero, the models are still nondeterministic.