4 ms·
It's pretty amazing that they made prompt caching automatic. It's rare that a company gives a 50% discount without the customer explicitly requesting it! Of cou
by alach11 2y ago
It's pretty amazing that they made prompt caching automatic. It's rare that a company gives a 50% discount without the customer explicitly requesting it! Of course... they might be retaining some margin, judging by their discount being 50% vs. Anthropic's 90%.
- WiSaGaN 2y agoThis was first done by deepseek. [1] [1]: https://platform.deepseek.com/api-docs/news/news0802/ https://platform.deepseek.com/api-docs/news/news0802/
- nextworddev 2y agoHaven’t tried Deepseek - how do they compare to OaI?
- WiSaGaN 2y agoThey release SOTA open source coding models. [1] Their API us also incredibly cheap due to the novel attention and MoE arch. [1]: https://aider.chat/docs/leaderboards/ https://aider.chat/docs/leaderboards/
- voiper1 2y agoAider benchmarks them great for coding... super slow token generation. Much cheaper but once you're used to the speed... it's too slow.