3 ms·
A billion tokens a day is 11,000 tokens a second sustained. How many tokens per second are you getting off of GPT 5.6 Sol per project?
by rpdillon 2mo ago
A billion tokens a day is 11,000 tokens a second sustained. How many tokens per second are you getting off of GPT 5.6 Sol per project?
- sheepscreek 2mo agoUltra mode spins up many sub-agents. On a particularly challenging task, I’ve had as many as 29 agents working at one time. Also if you don’t specify, most end up being the same as the parent model which is pretty wasteful. I engineered a skill that spins up Terra High agents for most sub-agents, resorting to Sol Medium for technical research and Luna High for code/in-project research tasks. On a slightly different topic, Luna Max is incredibly capable and doesn’t use as much quota (Luna tokens are dirt cheap).
- iJohnDoe 2mo agoMost importantly, are you seeing a return on investment for time and ultimate outcome? No one can judge the enjoyment, learning, and hobby aspects. Just wondering if there is an end goal for that much overall expenditure (time, money, energy, etc.)
- _zoltan_ 2mo agoI absolutely see a return. I do not pay for this (we have a corporate gateway), for the price of a junior developer I can get 3-4-5 senior developer's work done. it's insane value.
- jeffmcjunkin 2mo agoOften people are counting all tokens, including cached input tokens, for those more impressive "billions of tokens" quotes.
- rpdillon 2mo agoAh, thanks, I'd missed that nuance in the other reply!