2 ms·
The cost of the input tokens, not the reasoning or output. Agree though that benchmarks aren't very helpful w.r.t. estimating real world performance or costs.
by andai 7mo ago
The cost of the input tokens, not the reasoning or output.
Agree though that benchmarks aren't very helpful w.r.t. estimating real world performance or costs.
What we'd need are people giving the same real world tasks to 4.6 and 4.7 and measuring time, quality and costs.
- irthomasthomas 7mo agoThanks, that wasn't clear because it mentioned conversations, but it is only measuring the input tokens. So its just measuring the difference in the tokenizer.