>On the other hand, maybe always trying to avoid hallucinations has some other undesired consequences, which model trainers and product managers would like to a

>On the other hand, maybe always trying to avoid hallucinations has some other undesired consequences, which model trainers and product managers would like to avoid. (Actually, if you are in a position to know of such undesired consequences, and are free to tell the world about them, I will be really curious to learn more!) I'm not that, but I'd wager attempts to limit hallucinations in the model itself would mess with creative writing exercises Same as if you would ask it to write a short story for kids about a lion that loves green hats, then finish with "Don't hallucinate".