Interesting! How would you say you bootstrapped your evaluation system(s)? This is a great perspective. We managed to bring our error rate (that is, there's al

Interesting! How would you say you bootstrapped your evaluation system(s)? This is a great perspective. We managed to bring our error rate (that is, there's always a valid result) down to about 4% without evaluation-driven prompt engineering, but it did involve looking at real-world usage every day, noticing patterns, and doing our best (ugh, this is where evals would have been nice) to not regress things. Combined with some other pieces - basically things that end users can customize definitions for, which we parameterize into our prompt - this seemed to get it very close.