3 ms·
llms are also deterministic
by kolinko 2y ago
llms are also deterministic
- manmal 2y agoNo, in most cases the same input will yield a different output.
- coldtea 2y agoin a deterministic way based on seeds
- Drakim 2y agoOnly because most tools provide a randomize seed alongside the input, but you don't have to do that.
- Zambyte 2y agoNo, LLMs are deterministic. What you are describing is a randomized seed, which is another input to the LLM. Some interfaces expose this input, and some do not.
- kolinko 2y agoOnly if you have a non-zero temperature. You have to program in nondeterminism, because otherwise they are 100% deterministic.