4 ms·
I've seen this debate several times and often there's a terminology issue, where the same word isn't being interpreted the same way by different sides. Often i
by Terr_ 2mo ago
I've seen this debate several times and often there's a terminology issue, where the same word isn't being interpreted the same way by different sides.
Often it's a difference between repeatable versus predictable, or whether a system has chaotic aspects like the configurations of a double-pendulum or weather-forecasting.
Sometimes it's the difference between determinism in-theory versus in-practice, especially when various optimizations are being applied to save money.
- yencabulator 2mo agoAlso, people seem to not realize that chaos can be 100% deterministic. Consider Mandelbrot or Conway's Game of Life. The LLM inference process can be 100% deterministic but the weights can still make the end result quite chaotic. Just because temperature>0 improves results doesn't mean its an innate part of the mechanism. Just because scale-out architectures introduce jitter in communication doesn't mean that's an innate part of the mechanism.