3 ms·
By setting the temperature to 0 you get greedy decoding, which does a lot more than just making it predictable, and can degrade outputs. Random sampling exists
by orbital-decay 1y ago
By setting the temperature to 0 you get greedy decoding, which does a lot more than just making it predictable, and can degrade outputs. Random sampling exists for a reason! Gemini 2.5 Pro in particular doesn't like temp 0, for example.
Focus on correctness, not determinism.
- matusp 1y agoDeterminism does not require temperature=0. You can have a deterministic behavior even with >0 temperature as long as you fix your random seeds.