3 ms·
The other part of that is that while price per token may be going down, tokens per task is going up
by bandrami 5mo ago
The other part of that is that while price per token may be going down, tokens per task is going up
- no-name-here 5mo agoFor ~equivalent tasks/results, or because we’re expecting more or better from tasks? The real measure should be cost per ~equivalent task result, not cost per token nor tokens per task.
- bandrami 5mo agoFor better performance of ~equivalent tasks. That's what all the harness tooling people are using does: (often) increasing output quality by significantly increasing token counts.