4 ms·
> I have not tried public LLMs myself. Do they give reproducible results? Public LLMs I don't know but images generated using StableDiffusion are, of course, t
by TacticalCoder 3y ago
> I have not tried public LLMs myself. Do they give reproducible results?
Public LLMs I don't know but images generated using StableDiffusion are, of course, totally deterministic.
There really is no reason a LLM cannot be deterministic and if it isn't: fix it (even if this comes at a tiny performance cost).
- mcbuilder 3y agoIf you fix the random number seed virtually all LLMs should be deterministic. However, just 1 token difference in the input could produce a very different output, depending on the sampler, model, etc. So, LLMs can be deterministic, but in practice they are pure alchemy.