3 ms·
I know what they're saying. Why would openrouter calculate it thay way lol. They obviously dont. Think for a sec, they arent idiots.
by dakolli 2mo ago
I know what they're saying. Why would openrouter calculate it thay way lol. They obviously dont. Think for a sec, they arent idiots.
- RussianCow 2mo agoHow else would you expect them to calculate it?
- dakolli 2mo agoDo you really think they're docking points because cache invalidation due to provider switching? Seriously llms are frying ya'lls brain.
- RussianCow 2mo agoThey're not "docking points", they're calculating it in the most straightforward way. If I start a session and the majority of requests are sent to Provider A, and my last request gets routed to Provider B, I have a 0% cache hit rate with Provider B. I'm very curious how else you expect this to be calculated? Do you think they're completely omitting requests that switch providers mid-session? FWIW, I get significantly higher than listed cache hit rates when I pin my session to a specific provider, which is further evidence of the above.
- dakolli 2mo agoWhy wouldn't you only calculate consecutive requests with the same provider....
- irthomasthomas 2mo agoSomething is up. Deepseek cache hit rate on zenmux is 98%, but only 85% via openrouter.