algomaniac

4 ms·

1. 1.▲
   by algomaniac 5mo ago

   Thanks! In practice it can be a fraction of that. The judge sees a much smaller slice than the original call, and it's usually a smaller model making it 10-20x cheaper than the model running your agent. In some cases we've also se
2. 2.▲
   by algomaniac 5mo ago

   Hey HN, We spent the past year working on evals for teams running AI agents in production. We kept seeing rules that worked fine in evals stop working after a while (or miss inconsistently). And as teams added more rules, the agent started
3. 3.▲
   Show HN: Open Bias – proxy that enforces agent behavior at runtime(github.com)

   21 points by algomaniac 5mo ago|4 comments