3 ms·
>Deepseek invented the paradigm of prompt caching Caching was always here, you don't need to do anything special to get it on a single user local backend runni
by orbital-decay 2mo ago
>Deepseek invented the paradigm of prompt caching
Caching was always here, you don't need to do anything special to get it on a single user local backend running a base model or a chatbot in the first place. Among commercial providers, OpenAI adopted it in 4o first.