2 ms·
You have to mark exactly which parts of the prompt you want to cache. The only vendor I've seen with "automatic" prompt caching so far is DeepSeek https://plat
by simonw 2y ago
You have to mark exactly which parts of the prompt you want to cache.
The only vendor I've seen with "automatic" prompt caching so far is DeepSeek https://platform.deepseek.com/api-docs/news/news0802/ https://platform.deepseek.com/api-docs/news/news0802/