3 ms·
Does this analysis factor in potential caching of tokens on the server side? It seems that if they organize things well (as a model provider), they can save qu
by smokel 5mo ago
Does this analysis factor in potential caching of tokens on the server side? It seems that if they organize things well (as a model provider), they can save quite a lot on that. Looking at my Cursor statistics makes it clear that the token calculations are not at all trivial.
- simonw 5mo agoI believe the ccusage tool I used takes cached token pricing into account.