4 ms·
Tricky though because this generation of LLMs involve random sampling, so unlike computer code and libraries it's non-deterministic and inherently unreliable. N
by QuadrupleA 11mo ago
Tricky though because this generation of LLMs involve random sampling, so unlike computer code and libraries it's non-deterministic and inherently unreliable. Not sure if autoregressive random token sampling will ever be the winning paradigm.