> The very fact that there is generally no "best next token" with 100% certainty This is not entirely accurate. Sure, there's never a token with 100% certainty

> The very fact that there is generally no "best next token" with 100% certainty This is not entirely accurate. Sure, there's never a token with 100% certainty, but there are often tokens with 99.9% probability, but this technique of course does not change how such a token is sampled.