4 ms·
Yes, same prompt and same version. GPT-4 is especially stochastic, even with temperature=0.
by claytonjy 3y ago
Yes, same prompt and same version. GPT-4 is especially stochastic, even with temperature=0.
- croes 3y agoSo all these comments claiming that an article about the GPT's responses is wrong are useless. There are also such comments on this article. https://news.ycombinator.com/item?id=37361521 https://news.ycombinator.com/item?id=37361521
- rytill 3y agoI wonder why that is. Maybe they’re A/B testing assistant prompts, or there’s noise built into the architecture somewhere.
- nomel 3y agoThere was a post about it a while back. From what I recall, it’s an efficiency/cost reduction side effect, but it could be made deterministic, if they wanted to eat the cost.