mikemerrill

2 ms·

1. 1.▲
   by mikemerrill 1y ago

   Agreed that it's not the best way to use agents right now (they still need supervision) but I think in the coming year(s) we'll reach a point where they'll be good enough to run on their own (see Codex). If you're intere
2. 2.▲
   Terminal-Bench: a benchmark for AI agents in terminal environments(tbench.ai)

   17 points by mikemerrill 1y ago|3 comments
3. 3.▲
   by mikemerrill 1y ago

   We (an open community of AI researchers at Stanford, Anthropic, UW, and more) just released Terminal-Bench, a new open-source framework for evaluating how well AI agents perform in terminal environments. Given how much we all use the termin