3 ms·
I see. Can you say more about this? What’s the trade-off of removing it?
by vickychijwani 24d ago
I see. Can you say more about this? What’s the trade-off of removing it?
- sssilver 24d agoThis explains it pretty well: https://academy.claude.com/courses/building-with-the-claude-api/temperature https://academy.claude.com/courses/building-with-the-claude-...
- YZF 24d agoYou get a probability curve for the next token prediction. You can just pick the highest probability. That said the non-determinism serves a real purpose- it allows different outputs and paths to be explored. So that's kind of the tradeoff.