3 ms·
The issue is apparent when you consider the kind of mistakes LLM’s make. If I ask you to guess a blue whale’s body temperature you’re not going to save 500C be
by Retric 3y ago
The issue is apparent when you consider the kind of mistakes LLM’s make. If I ask you to guess a blue whale’s body temperature you’re not going to save 500C because you understand if that were true various other things would be happening.
An LLM is more likely to give the correct answer to the blue whale question, but when you greatly penalize wildly incorrect answers they do noticeably worse.