3 ms·
It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
by dymk 5mo ago
It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider.
- esseph 5mo ago> It’s crazy that people don’t understand cached tokens despite them being priced separately on the cost pages of every single provider. Depends on your subscription type. Some are just a flat monthly fee.
- dymk 5mo agoThose aren't the people worrying about token counts, then.
- jauntywundrkind 5mo agoIts crazy that people think caching is such a silver bullet, despite the cost of long context windows still being ridiculously high even with caching. https://blog.exe.dev/expensively-quadratic https://blog.exe.dev/expensively-quadratic https://news.ycombinator.com/item?id=47000034 https://news.ycombinator.com/item?id=47000034