> It's also a possible secondary objective when training the LM itself. Perhaps if you train the LM using this as this secondary loss function it might encourag

> It's also a possible secondary objective when training the LM itself. Perhaps if you train the LM using this as this secondary loss function it might encourage the LM to always generate truthful outputs. After all we get through uncountable rounds of this during our lives, school and everything else. With the example of your second bullet point: Young me: "I think that the capital of France is London" Adult: "No" Me: "Of course, the capital of France is Paris" Adult "Yes." And grades are a very clear loss function.