3 ms·

You and I have no way of knowing that.

• weird-eye-issue 6mo ago
  Except that the API cost is literally logged on disk for every session and it's easy to analyze those logs.
  • verve_rat 6mo ago
    We aren't talking about API costs or number of tokens consumed, we are talking about number of tokens in a monthly subscription.
    • weird-eye-issue 6mo ago
      Again, it is not based on number of tokens. If it was solely based on number of tokens then things like cache misses would not impact the usage so much. It's based on the actual cost which includes things like the caching costs.