3 ms·
> LLMs, by their very nature are probabilistic I believe that if you can tweak the temperature input (OpenAI recently turned it off in their API, I noticed), a
by pmarreck 1y ago
> LLMs, by their very nature are probabilistic
I believe that if you can tweak the temperature input (OpenAI recently turned it off in their API, I noticed), an input of 0 should hypothetically result in the same output, given the same input.
- bdhcuidbebe 1y agoThat only works if you decide to stick to that exact model for the rest of your life, obviously.
- oceanplexian 1y agoThe point is he said "by its nature". A transformer based LLM when called with the same inputs/seed/etc is literally the textbook definition of a deterministic system.
- sarchertech 1y agoNo one uses temperature 0 because the results are terrible.