4 ms·

How would it be a money grab? If the new tokenizer requires more tokens to encode the same information, it costs them more money for inference. The point of cha

How would it be a money grab? If the new tokenizer requires more tokens to encode the same information, it costs them more money for inference. The point of charging per token is that the cost is proportional to the number of tokens. That's my understanding anyway

abrookewood 6mo ago
Because everyone burns through their limits much faster, forcing them to upgrade to higher limits or new tiers.
- simianwords 6mo ago
  They could just increase the token cost no? There’s little need for cute conspiracies like these
  - sumeno 6mo ago
    They would have to tell people if they did that.
  - svnt 6mo ago
    There are no conspiracies where a corporation has profit incentive. There is perhaps a question of planning and initial intentionality, but the metrics and motivation to continue are clear enough.
- Jtarii 6mo ago
  I think someone would much sooner switch to a competitor than up their tier.
  - dandaka 6mo ago
    If model provider believes they have a better model, it can be a viable bet. But many (me included) started experimenting with other providers because of enshittification from Anthropic (price + uptime). Only to find, that Codex is not that worse in quality for a significantly more output per $.
msp26 6mo ago
Not necessarily with speculative decoding. Whitespace would be trivial to predict and they would petty much keep using the same amount of compute as before. I don't think that's their primary motive for doing this but it is a side effect.