I'm building LLM-based tools fulltime now, and one of the techniques that works wonderfully is to check the LLM output with LLM itself: asking it to figure out

I'm building LLM-based tools fulltime now, and one of the techniques that works wonderfully is to check the LLM output with LLM itself: asking it to figure out if the output actually follows the guidelines you've set. And if it doesn't, send the response back with the error message (or messages, nobody limits you to just one check) — it's quite good at correcting mistakes! What's awesome here, is that you often have to use the most advanced LLM available for generation (GPT-4), but you can use much simpler models to categorise the answer!