True, but even with the base model it is hard to go from logits to a confidence level for freeform answers. For multiple choice questions it is easy, since you

True, but even with the base model it is hard to go from logits to a confidence level for freeform answers. For multiple choice questions it is easy, since you just look at the probabilities for each of the allowable tokens in the answer (which is presumably what they did in that benchmark) but I have no idea how to do it more generally.