3 ms·
Maybe you can help me make this more deterministic? I am already setting temp to 0, but i keep getting different responses to the same prompt. https://gist.git
by derwiki 3y ago
Maybe you can help me make this more deterministic? I am already setting temp to 0, but i keep getting different responses to the same prompt.
https://gist.github.com/derwiki/99079de4cfcb4f196b1ca561b3d77a9f https://gist.github.com/derwiki/99079de4cfcb4f196b1ca561b3d7...
- Tostino 3y agoLooks to be an OpenAI problem due to how they host the API. People are speculating that different servers in their pool are ot always on the exact same version of the model, and you can get pointed to a different version...no proof I saw, but quite a few people complaining about it. All the local models I've used were deterministic with temp 0.