4 ms·
>LLM’s are inherently non-deterministic. I'm not an ML guy but I was curious about this recently. There is some parameter that can be tuned to produce determin
by 000ooo000 1y ago
>LLM’s are inherently non-deterministic.
I'm not an ML guy but I was curious about this recently. There is some parameter that can be tuned to produce determinism but currently it also produces worse results. Big [citation needed], but worth a google if it's of interest. Otherwise in agreement with your post.
- agarren 1y agoTemperature? Definitely tweaks the results…but I don’t know if “deterministic” is a term you can use in any way, shape, or form, in the context of LLMs. https://www.ibm.com/think/topics/llm-temperature https://www.ibm.com/think/topics/llm-temperature
- Ancapistani 1y agoUnless I’ve misunderstood something, setting a constant seed and a temperature of zero would give deterministic results. Not good results necessarily, but consistent.