3 ms·
> LLMs are deterministic. In theory, yes. In practice, parallelism combined with floating point math make current implementations fundamentally non-determinist
by TeMPOraL 2y ago
> LLMs are deterministic.
In theory, yes. In practice, parallelism combined with floating point math make current implementations fundamentally non-deterministic.
- Tycho 2y agoCan you elaborate more on the parallelism aspect?
- deleted 2y ago[deleted]
- mensetmanusman 2y agoNot fundamentally, but extremely costly to keep track of everything. Still deterministic though.