> The real value of this process is looking at your data and doing careful analysis. Even though an AI judge can be a helpful tool, going through this process i

> The real value of this process is looking at your data and doing careful analysis. Even though an AI judge can be a helpful tool, going through this process is what drives results. I would go as far as saying that creating a LLM judge is a nice “hack” I use to trick people into carefully looking at their data! Interesting conclusion. One of the reasons I like programming is that in order to automate a process using traditional software, you have to really understand the process and break it down into individual lines of code. I suppose the same is true for automating processes with LLMs; you still have to really understand the process and break it down into individual instructions for your prompt.