3 ms·
> if OpenRouter is blindly dispatching your requests This can somewhat be the case, depending on your config. I updated mine to make DeepSeek high priority bec
by skeledrew 2mo ago
> if OpenRouter is blindly dispatching your requests
This can somewhat be the case, depending on your config. I updated mine to make DeepSeek high priority because I was having a lot of cache misses and reliability issues with the default (cheapest (at face value)) providers, and cost was actually higher overall than anticipated. Was smooth sailing from then; might have to tweak things again now pricing has changed though.
- nyargh 2mo agoI was having the same issue. Did not find any provider that had a cache hit rate anywhere close to DeepSeeks own API. Not sure if this was an OpenRouter issue or with the other inference providers.
- brandon997 2mo agoYou could also check out token.dance. They offer DeepSeek and other models through an OpenAI-compatible API, and the pricing seems pretty competitive. Might be worth comparing the cache rates.