The probability of tokens is unfortunately a poor proxy for confidence because it is entirely possible for "mixing glue" to appear in a sentence about making pi

The probability of tokens is unfortunately a poor proxy for confidence because it is entirely possible for "mixing glue" to appear in a sentence about making pizza depending on context. It might even be likely if the user has asked the model to lie.