2 ms·
> You can set the temperature of LLMs to 0 and that will make them deterministic. It will make them more deterministic, but it will not make them fully determi
by jihadjihad 1y ago
> You can set the temperature of LLMs to 0 and that will make them deterministic.
It will make them more deterministic, but it will not make them fully deterministic. This is a crucial distinction.
- falcor84 1y agoGoogle is significantly less deterministic than AltaVista was.
- cookingrobot 1y agoThat’s an implementation choice. All the math involved is deterministic if you want it to be.
- Jaxan 1y agoIt will still be nondeterministic in this context. Prompts like “Can you do X?” and “Please do X” might result in very different outcomes, even when it’s “technically deterministic”. For the human operating with natural language it’s nondeterministic.