I recommend this excellent presentation: https://www.youtube.com/watch?v=yBL7J0kgldU&t=2819s https://www.youtube.com/watch?v=yBL7J0kgldU&t=2819s and they expe

I recommend this excellent presentation: https://www.youtube.com/watch?v=yBL7J0kgldU&t=2819s https://www.youtube.com/watch?v=yBL7J0kgldU&t=2819s and they experimentally proved that LLMs often do know something is not right, but they aren't trained to express it. Because they did not get enough examples of faulty reasoning and, most importantly, how to recover from it. Adding these examples to training set vastly improved the output.