3 ms·
Are you saying that some models will take 100x more tokens than other (models in the same ballpark) for the same task? Is the 100 a real measured metric or just
by monsieurbanana 1y ago
Are you saying that some models will take 100x more tokens than other (models in the same ballpark) for the same task? Is the 100 a real measured metric or just random numbers to illustrate a point?
- simpaticoder 1y agoWith thinking models, yes 100x is not just possible, but probable. You get charged for the intermediate thinking tokens, even if you don't see them (which is the case for Grok, for example). And even if you do see them, they won't necessarily add value.
- monsieurbanana 1y ago> With thinking models, yes 100x is not just possible, but probable So the answer is no then, because I don't put reasoning and non-reasoning models in the same ballpark when it comes to token usage. You can just turn off reasoning.
- datadrivenangel 1y agothe GPT 5 models use ~10x more tokens depending on the reasoning settings.