That you think this is weird advice or advice that makes LLMs look good shows that your position is one of reflective opposition rather than understanding and e

That you think this is weird advice or advice that makes LLMs look good shows that your position is one of reflective opposition rather than understanding and experience with the things. If you interact with them much it's an obvious course of action. It will come up with nonsense, and if you tell it it's nonsense it will immediately apologise and explain why the nonsense was nonsense. It will come up with good information, and if you tell it the information was bad it will immediately apologise and offer nonsense explaining why. You can easily get it in a loop of it agreeing that solution A is bad and offering solution B, then agreeing that we previously excluded solution B and offering solution A instead. It is a very quick way to get an intuitive understanding of their limitations.