3 ms·
> LLMs select the next word randomly from a set probability distribution, so there is no "best choice" unless you run the LLM with a temperature of 0 which woul
by Marsymars 1mo ago
> LLMs select the next word randomly from a set probability distribution, so there is no "best choice" unless you run the LLM with a temperature of 0 which would give out terrible results.
I'm not understanding how the word with the highest probability isn't the "best choice"?
- baobabKoodaa 1mo agoYou will understand if you run some LLM models with a greedy sampler that does that. The text quality begins to deteriorate rapidly. This is a very counter intuitive result so I don't blame you for not understanding until you actually tried it and experienced it for yourself.
- Marsymars 1mo ago> You will understand if you run some LLM models with a greedy sampler that does that. The text quality begins to deteriorate rapidly. Right, I've done this, and this makes sense to me, but I'm not following how that falsifies the top probability word being the best choice in any particular instance. "Picking only the best word at each decision point results in a worse final result" seems like an imminently reasonable hypothesis.
- StevenWaterman 1mo agoI think you're using different definitions of best. If best = leads to a correct answer overall then by definition anything that leads to a bad outcome can't be best
- Max-Limelihood 1mo agoBecause it's pure exploit on the explore/exploit tradeoff. The best outputs come when the LLM comes up with lots of different ideas, considers them, and selects the best one. If you sample at low temperature it tends to regenerate the same ideas over and over.