6 ms·
> Are you buying from a provider that isn't listed on open router already I am using openrouter with zdr guardrail which routes to any provider that supposedly
by bwfan123 3mo ago
> Are you buying from a provider that isn't listed on open router already
I am using openrouter with zdr guardrail which routes to any provider that supposedly doesnt train on user data. I also use fireworks (directly, not via openrouter) which is a provider promising zdr and has a bunch of open weights models. My issue is that these zdr providers dont transparently disclose caching/tokens etc and so they end up being far more expensive than directly using DS.
- x312 3mo agoHave you tried Novita? They're zdr and I find they usually have better cache hit rates than fireworks. No affiliation.
- bwfan123 3mo agoThanks for the input. Let me check it out.
- smartbit 3mo ago> OpenRouter has taken the stance that in-memory caching of prompts is not considered “retaining” data, and we therefore allow endpoints/models with implicit caching to be hit when a ZDR routing policy is in effect. [0] OpenRouter doesn’t list DeepSeek as ZDR combined with Caching. Thanks for the tip of Fireworks as Fireworks has Zero Data Retention by default. [1] [0] https://openrouter.ai/docs/guides/features/zdr https://openrouter.ai/docs/guides/features/zdr [1] https://docs.fireworks.ai/guides/security_compliance/data_handling https://docs.fireworks.ai/guides/security_compliance/data_ha...