33hsiidhkl

4 ms·

1. 1.▲
   by 33hsiidhkl 1y ago

   When should a model's output be deterministic? When should a model's output be non-deterministic? When many humans interact with the same model, then maybe the model should try different seed values, and make measurements. When mo
2. 2.▲
   by 33hsiidhkl 1y ago

   temperature does not affect token prediction in the way you think. The seed value is still the seed value, before temperature calculations are performed. The randomness of an LLM is not related to its temperature. The seed value is what det
3. 3.▲
   by 33hsiidhkl 1y ago

   I don't really understand your point. An LLM is loaded with a seed value, which is a number. The number may be chosen through some pseudo- or random process, or specified manually. For any given seed value, say 80085, the LLM will alwa
4. 4.▲
   by 33hsiidhkl 1y ago

   It absolutely is deterministic, for any given seed value. Same seed = same output, every time, which is by definition deterministic.
5. 5.▲
   by 33hsiidhkl 1y ago

   For any given seed value, the output of an LLM will be identical- it is deterministic. You can try this at home with Llama.cpp by specifying a seed value when you load a LLM, and then seeing that for a given input the output will always be