3 ms·
LLMs sample the next token from a conditional probability distribution, the hope is that dumb sequences are less probable but they will just happen naturally.
by quadrature 8mo ago
LLMs sample the next token from a conditional probability distribution, the hope is that dumb sequences are less probable but they will just happen naturally.
- tempaccount420 8mo agoIt's more like the choice between "the" and "a" than "yes" and "no".
- mattmanser 8mo agoFunny how those probabilities consistently at 2pm UK time when all the Americans come online...