2 ms·
> Any non-determinism present with 0 temperature it's not some mysterious LLM-inherent property, Of course it's not mysterious. It is well understood by all wh
by chrisjj 7d ago
> Any non-determinism present with 0 temperature it's not some mysterious LLM-inherent property,
Of course it's not mysterious. It is well understood by all who are aware of the fundamental unreliability of all major LLMs in general use today.
- coldtea 6d agoThe phrasing still makes it sound like it's due to the LLM. It's not. It's do to compiler and CPU, and OS optimizations, and a non-LLM program could suffer the same just as well.
- chrisjj 6d agoThis unreliability is entirely due to the implentation of the LLM. Yes, any other program implemented equally carelessly could suffer the same. But you'd be hard pressed to find any as unreliable as a typical LLM.