3 ms·
In some ways it's obvious why. An LLM produces a probability distribution and then a random word is sampled. Imagine if you said to a secretary that you're 60%
by anon291 2y ago
In some ways it's obvious why. An LLM produces a probability distribution and then a random word is sampled.
Imagine if you said to a secretary that you're 60% yes and 40% no, and she arbitrarily decided to write NO in your report and then a day later the board asked you why you made that decision.
You'd be confused too.