4 ms·
1,500 tool calls per task sounds like a nightmare for unit economics though. I've been optimizing my own agent workflows and even a few dozen steps makes it har
by storystarling 9mo ago
1,500 tool calls per task sounds like a nightmare for unit economics though. I've been optimizing my own agent workflows and even a few dozen steps makes it hard to keep margins positive, so I'm not sure how this is viable for anyone not burning VC cash.
- zozbot234 9mo ago"tool call" is just a reference to any elementary interaction with the outside system. It's not calling third-party APIs or anything like that.
- storystarling 9mo agoTrue, but that's still 1,500 inference cycles. Even without external API fees, the latency and compute burden seems huge. I don't see how the economics work there without significant subsidies.
- darrinm 9mo agoFWIW many tool calls can be and often are made in one inference cycle.