3 ms·
So your theory would have it that if you repeated the question at temp 1 it would give the wrong answer more often than the correct answer?
by scrollop 3y ago
So your theory would have it that if you repeated the question at temp 1 it would give the wrong answer more often than the correct answer?
- throwaway63820 3y agoThere's no theory. Just in real life usage, it is extremely uncommon to stochastically query the model and use the most common answer. Using it with temperature 0 is the "best" answer as it uses the most likely tokens in each completion.