3 ms·
> LLMs are not inherently non-deterministic. Reproducible does not mean deterministic. You cannot determine in advance what a prompt will give as output, even
by iLoveOncall 6mo ago
> LLMs are not inherently non-deterministic.
Reproducible does not mean deterministic. You cannot determine in advance what a prompt will give as output, even with a temperature of 0 and a fixed seed, therefore they are not deterministic.
- nemo1618 6mo agoHuh? I'm not aware of anyone else who defines "deterministic" that way. "Deterministic" comes from "determinism," as in "the effects are fully determined by the causes" -- not "determine" as in "deduce."