4 ms·
The jargon to google here is "length bias" It turns out if you generate two LLM responses and ask a judge to choose which is better, many judges have a bias in
by michaelt 1y ago
The jargon to google here is "length bias"
It turns out if you generate two LLM responses and ask a judge to choose which is better, many judges have a bias in favour of long answers full of waffle.
- mh- 1y agoThanks for that pointer. The abstract of this paper seems interesting: https://arxiv.org/html/2407.01085v3 https://arxiv.org/html/2407.01085v3 > use of [LLMs] as judges [..] reveals a notable bias towards longer responses, undermining the reliability of such evaluations. To better understand such bias, we propose to decompose the preference evaluation metric, specifically the win rate, into two key components: desirability and information mass [..] (If you're interested, give it a click. I tried to pare this down to avoid quoting a wall of text.)