3 ms·
If you fix the random number seed virtually all LLMs should be deterministic. However, just 1 token difference in the input could produce a very different outpu
by mcbuilder 3y ago
If you fix the random number seed virtually all LLMs should be deterministic. However, just 1 token difference in the input could produce a very different output, depending on the sampler, model, etc. So, LLMs can be deterministic, but in practice they are pure alchemy.