4 ms·
thats a very generous way of putting it. Anthropic's prompt caching is actively hostile and very difficult to implement properly.
by netcraft 8mo ago
thats a very generous way of putting it. Anthropic's prompt caching is actively hostile and very difficult to implement properly.