3 ms·

you mean... an algorithm? what is a "deterministic LLM"?

• julienreszka 5mo ago
  see the temperature parameter ? with current tech even if you set it to zero when you provide the same input multiple times you will rarely get the exact same output.
  • blinkbat 5mo ago
    yeah. because it's an LLM. again, you are looking for an algorithm.
  • jll29 5mo ago
    The temperature parameter cannot be set to 0 via GUI, merely to a sall vale close to 0, as that would lead to a division by 0 in the code.
    • julienreszka 5mo ago
      in proper implementation 0 means greedy decoding