2 ms·
They said 6 billion tokens, which isn't as much as I thought it might be.
by SoMomentary 1mo ago
They said 6 billion tokens, which isn't as much as I thought it might be.
- trostaft 1mo agoAm I doing my napkin math correct? The post says it's using a model comparable to Fable 5.1, which is $50 per million output tokens. So this is ~$300K? Surely an over-estimate due to caching.
- FartyMcFarter 29d agoSurely input tokens are also involved, and not necessarily only for the initial prompt if there are feedback loops or agent interactions.