3 ms·
And in many scenarios, cache hits are 99% of tokens, so the price difference in caching really adds up quickly.
by miroljub 2mo ago
And in many scenarios, cache hits are 99% of tokens, so the price difference in caching really adds up quickly.
3 ms·