2 ms·
Thank you! Both of those papers are super new and super relevant. The only big gap left is that they aren't using claude code/codex as harnesses. I'll try to r
by achalpandey 3mo ago
Thank you! Both of those papers are super new and super relevant.
The only big gap left is that they aren't using claude code/codex as harnesses. I'll try to reuse their constructed user sessions.
PS: Your work at stet is also interesting. That's definitely a problem right now that's hard to track. The only real solution is more robust CI/CD. I have since added harder validation like essentially running a full benchmark run on every prod push.