3 ms·
It’s my understanding that 0 is completely deterministic, except for when the model is updated, which does happen occasionally.
by LeoPanthera 4y ago
It’s my understanding that 0 is completely deterministic, except for when the model is updated, which does happen occasionally.
- valgaze 4y ago@haolez I just tested w/ davinci-003 w/ temperature to 0 Prompt: https://imgur.com/YtQ4fbf https://imgur.com/YtQ4fbf -- Reveal the question marks in an interesting way: The dog goes ????????????? -- With temperature == 0, it consistently ("pretty deterministically"?) generated "woof!" ex. The dog goes woof!
- gwillen 4y agoTheir docs say (somewhat recently updated, I think) that even 0 is not perfectly deterministic in all cases (though it's very close). Some people had previously observed this and speculated that it was some kind of floating point roundoff issue, when two outputs have almost identical scores.
- Jensson 4y agoGPU's often do floating point computations in nondeterministic order for performance reasons, so you would get small differences even for exactly the same order. It is probably that.