That's not a usable workaround. In most cases it doesn't actually produce full determinism[1]. And even if it did, a certain degree of non-determinism is actua

That's not a usable workaround. In most cases it doesn't actually produce full determinism[1]. And even if it did, a certain degree of non-determinism is actually desirable. The most probable tokens might not be correct, and randomness is partly responsible for what humans interpret as "creativity". Even hallucinations are desirable in some applications (art, entertainment, etc.). [1]: https://medium.com/google-cloud/is-a-zero-temperature-deterministic-c4a7faef4d20 https://medium.com/google-cloud/is-a-zero-temperature-determ...