2 ms·
> According to Perplexity, my AI chatbot of choice, this week‑long autonomous browser experiment consumed in the order of 10-20 trillion tokens and would have c
by simonw 10mo ago
> According to Perplexity, my AI chatbot of choice, this week‑long autonomous browser experiment consumed in the order of 10-20 trillion tokens and would have cost several million dollars at then‑current list prices for frontier models.
Don't publish things like that. At the very least link to a transcript, but this is a very non-credible way of reporting those numbers.
- storystarling 10mo agoThat implies a throughput of around 16 million tokens per second. Since coding agent loops are inherently sequential—you have to wait for the inference to finish before the next step—that volume seems architecturally impossible. You're bound by latency, not just cost.
- mrob 10mo agoThe original post claimed they were "running hundreds of concurrent agents": https://cursor.com/blog/scaling-agents https://cursor.com/blog/scaling-agents
- simonw 10mo agoIt was 2,000 concurrent agents at peak. I'd still be surprised if that added up to "trillions" of tokens. A trillion is a very big number.
- mikkupikku 10mo ago16 million a second across 2000 agents would be 8000 tokens per second per agent. This doesn't seem right to me.
- Snuggly73 10mo agoI mean, its right there in their blog - https://cursor.com/blog/scaling-agents https://cursor.com/blog/scaling-agents "We've deployed trillions of tokens across these agents toward a single goal. The system isn't perfectly efficient, but it's far more effective than we expected."