3 ms·
The hallucinations are a result of RLVR. We reward the model for an answer and then force it to reason about how to get there when the base model may not have t
by mountainriver 1y ago
The hallucinations are a result of RLVR. We reward the model for an answer and then force it to reason about how to get there when the base model may not have that information.
- mdp2021 1y ago> The hallucinations are a result of RLVR Well let us reward them for producing output that is consistent with database accessed selected documentation then, and massacre them for output they cannot justify - like we do with humans.