5 ms·
Another way to think about it: every single user of Claude is paying an extra tax in every single request
by jeffrwells 5mo ago
Another way to think about it: every single user of Claude is paying an extra tax in every single request
- zythyx 5mo agoIsn't it basically the same as paying dust to crypto exchanges when making a transaction - it's so miniscule that it's not worth caring about?
- teaearlgraycold 5mo agoWell the system prompt is probably permanently cached.
- dymk 5mo agoTakes up a portion of the context window, though
- whateveracct 5mo agoAnd the beginning of the context window gets more attention, right?
- wongarsu 5mo agoOn API pricing you still pay 10% of the input token price on cache reads. Not sure if the subscription limits count this though. And of course all conversations now have to compact 80 tokens earlier, and are marginally worse (since results get worse the more stuff is in the context)