4 ms·

Thanks for sharing the tip, would definitely try this out in near future! > figure out how to pull out entropy scores Can you elaborate on this? "entropy score

by rkwz 3y ago

Thanks for sharing the tip, would definitely try this out in near future! > figure out how to pull out entropy scores Can you elaborate on this? "entropy scores" == how unique a value is?

fnordpiglet 3y ago
Entropy scores would be, essentially, the probability the output string accrued through the inference process. It’s a poor score for how confident the inference was by the LLM. It doesn’t mean correctness by any means, but a worse entropy score means, in a way, more guessing on each token.
- rkwz 3y ago
  Thanks, TIL!