3 ms·
No, you paid for the end result. The thought process is a step in between, a function. Think about it, who should get charged if the answer you received comes f
by throw1234567891 2mo ago
No, you paid for the end result. The thought process is a step in between, a function. Think about it, who should get charged if the answer you received comes from a cache? Thinking tokens are the complexity-of-the-problem cost. I mean, you may not agree but both are valid points of view.
- anigbrowl 2mo agoNo I didn't. I buy my tokens from a provider that exposes the model reasoning so I can understand what it's doing and work with it, or interrupt if I see things going in the wrong direction.
- throw1234567891 2mo agoI agree with you in principle. I'm just pointing out that the latter is in some way another valid point of view.
- HDBaseT 2mo agoThinking tokens aren't free though. This is not a valid point of view. If I was being charged for the raw, output/input token count, excluding thinking/reasoning token costs, then sure. But at least via the API, you pay for tokens you cannot see.
- ardel95 2mo agoIs it really that unusual? When you attach an image or a video, it gets converted to tokens you don’t see, at a rate that is proprietary to the model. You pay for those tokens, but don’t see them. Even how text is converted to tokens is a property of the dictionary, which is opaque for proprietary models. There are features of input and output that are opaque to you, but that you pay for. Part of how model providers chose to run their service.
- throw1234567891 2mo agoWell, I don’t pay for them. Maybe you do. But again, they’re a byproduct, an intermediary. They contribute to your result but aren’t the final result. I’m not defending their position, just showing you an alternative universe.
- deleted 2mo ago[deleted]
- hamandcheese 2mo ago> No, you paid for the end result. No, I literally am paying for the thought process, per token. "Pay only for the result" is not how these things are billed.
- mirzap 2mo agoNope. You are charged for the reasoning tokens as well. Actually, most of the expense is the reasoning part.