4 ms·
> One huge problem with these "cheap" models is that they happen to be more expensive in the typical agent workflow if the provider does not support caching. D
by JimDabell 1y ago
> One huge problem with these "cheap" models is that they happen to be more expensive in the typical agent workflow if the provider does not support caching.
DeepSeek supports caching and cache hits are a tenth of the cost.
$0.028/M for cache hit
$0.28/M for cache miss
$0.42/M for output
— https://api-docs.deepseek.com/news/news250929 https://api-docs.deepseek.com/news/news250929
- grim_io 1y agoI auto disqualify the chinese first party endpoints. If they are okay for you, then sure go ahead. Enjoy the caching. What other provider is going to support it?
- JimDabell 1y ago> I auto disqualify the chinese first party endpoints. Why?
- curseofcasandra 1y agoI’m guessing it’s something along the lines of this: https://youtu.be/kYiUY07TzS4 https://youtu.be/kYiUY07TzS4
- guluarte 1y agoby your logic then you have to disqualify openai and anthropic first party endpoints for testing gpt and claude...
- grim_io 1y agoThere is no bug in my logic. Anthropic and OpenAI are not chinese first party providers.