3 ms·
Except that the API cost is literally logged on disk for every session and it's easy to analyze those logs.
by weird-eye-issue 6mo ago
Except that the API cost is literally logged on disk for every session and it's easy to analyze those logs.
- verve_rat 6mo agoWe aren't talking about API costs or number of tokens consumed, we are talking about number of tokens in a monthly subscription.
- weird-eye-issue 6mo agoAgain, it is not based on number of tokens. If it was solely based on number of tokens then things like cache misses would not impact the usage so much. It's based on the actual cost which includes things like the caching costs.