3 ms·
I don't know whether the major AI companies will move to usage models. But let's assume that they do. However: I would expect chat interfaces to be charged pe
by eru 1y ago
I don't know whether the major AI companies will move to usage models. But let's assume that they do.
However: I would expect chat interfaces to be charged per query, not per token. End users don't understand tokens, and don't want to have to understand tokens.
If you charge per query, you don't gain anything from extra wordy responses.