3 ms·
Cerebras supports prompt caching and has a doc about it. A fairly standard automatic prefix-based implementation with 5min expiry. They do not seem to discount
by dannyw 2mo ago
Cerebras supports prompt caching and has a doc about it. A fairly standard automatic prefix-based implementation with 5min expiry.
They do not seem to discount cached input for the self-serve Developer tier. Maybe they do for enterprise rate cards?
https://inference-docs.cerebras.ai/capabilities/prompt-caching https://inference-docs.cerebras.ai/capabilities/prompt-cachi...
- scosman 2mo agoah, that makes it feasible! Okay, glad it's not technical limit. They should fix the pricing...