4 ms·
With a fixed seed there will be the same floating point rounding errors. A fixed seed is enough for determinism. You don't need to set temperature=0. Setting t
by impossiblefork 1y ago
With a fixed seed there will be the same floating point rounding errors.
A fixed seed is enough for determinism. You don't need to set temperature=0. Setting temperature=0 also means that you aren't sampling, which means that you're doing greedy one-step probability maximization which might mean that the text ends up strange for that reason.