4 ms·
16 million a second across 2000 agents would be 8000 tokens per second per agent. This doesn't seem right to me.
by mikkupikku 9mo ago
16 million a second across 2000 agents would be 8000 tokens per second per agent. This doesn't seem right to me.