3 ms·
There's no theory. Just in real life usage, it is extremely uncommon to stochastically query the model and use the most common answer. Using it with temperatur
by throwaway63820 3y ago
There's no theory.
Just in real life usage, it is extremely uncommon to stochastically query the model and use the most common answer. Using it with temperature 0 is the "best" answer as it uses the most likely tokens in each completion.