> Does an LLM have any idea of what "best" is? "Best" here isn't being used to imply a conscious decision, but at each stage which token has the best score com

> Does an LLM have any idea of what "best" is? "Best" here isn't being used to imply a conscious decision, but at each stage which token has the best score coming out of the model, so the overall best is the sequence of those best tokens. When judging another output it is essentially running the numbers the same way. It is a bit more complicated than that as the output tokens become part of the context for the next choice, but I think that simplified way of thinking about it holds water.