4 ms·
Isn't the whole point of these LLMs be that they are non-deterministic? And with OpenAI opaquely 'tweaking' the model, it's no surprise you don't get the same o
by wildrhythms 3y ago
Isn't the whole point of these LLMs be that they are non-deterministic? And with OpenAI opaquely 'tweaking' the model, it's no surprise you don't get the same output.
- meowtimemania 3y agoI think they are seeded. With the same seed, and input, the same model will output the same answer.
- pixl97 3y agoI don't think that is exactly true... I've seen arguments based on floating point calculations that accruing errors in FP can generate different results.
- nomel 3y agoI've seen suggestions that it's an implementation problem, in the pipeline, that the same computation, with the same values, and same FP errors (they're deterministic) doesn't result in the same output with a temperature of 0, along with theories that the problem is not chased because it's probably related to optimization/cost reduction. (trouble finding sources, but it being a bug was from someone involved with OpenAI)