2 ms·
maximizing token usage for the token seller is clear goal to profitability /s actually wait, is that's why LLMs are so wordy ?
by PunchyHamster 11mo ago
maximizing token usage for the token seller is clear goal to profitability /s
actually wait, is that's why LLMs are so wordy ?
- undefeated 11mo agoUnlikely, because the free version of ChatGPT isn't really making them any money, so less tokens is actually better — which I assume is why anthropic pushes Haiku models on free users which are not just more quantized but also less wordy.