2 ms·
Also, people seem to not realize that chaos can be 100% deterministic. Consider Mandelbrot or Conway's Game of Life. The LLM inference process can be 100% dete
by yencabulator 2mo ago
Also, people seem to not realize that chaos can be 100% deterministic. Consider Mandelbrot or Conway's Game of Life.
The LLM inference process can be 100% deterministic but the weights can still make the end result quite chaotic. Just because temperature>0 improves results doesn't mean its an innate part of the mechanism. Just because scale-out architectures introduce jitter in communication doesn't mean that's an innate part of the mechanism.