3 ms·
Only the training is non deterministic. As long as you use the same seed for inference, it’ll give you the same answer. ChatGPT changes this seed under the hoo
by dartos 3y ago
Only the training is non deterministic. As long as you use the same seed for inference, it’ll give you the same answer.
ChatGPT changes this seed under the hood with each request
- squeaky-clean 3y agoEven if you keep the same seed, it is non-deterministic. https://ai.plainenglish.io/gpt-4-is-non-deterministic-af202847529c https://ai.plainenglish.io/gpt-4-is-non-deterministic-af2028...
- dartos 3y agoThat link is dead. Either way, you can’t interact with gpt4 without openai’s api, so you don’t know what they’re doing in between your request and inference. But LLMs are deterministic when all the parameters are the same between inferences