The more you can afford to build up your understanding of the problem space and define what inputs & outputs look like, the more flexible you can be with evals.

The more you can afford to build up your understanding of the problem space and define what inputs & outputs look like, the more flexible you can be with evals. Unfortunately, this is a lot of work and requires thinking and discussion with your team and those involved. https://poyo.co/note/20260217T130137/ https://poyo.co/note/20260217T130137/ I wrote about general ideas I take towards simple single prompt features, but most of it is applicable to more involved agentic approaches too.