2 ms·
Also, unlike OpenAI, Anthropic's prompt caching is explicit (you set up to 4 cache "breakpoints"), meaning if you don't implement caching then you don't benefit
by moyix 10mo ago
Also, unlike OpenAI, Anthropic's prompt caching is explicit (you set up to 4 cache "breakpoints"), meaning if you don't implement caching then you don't benefit from it.
- netcraft 10mo agothats a very generous way of putting it. Anthropic's prompt caching is actively hostile and very difficult to implement properly.