3 ms·
This is only a thinly veiled ad. It's fine, I was curious about this exact setup, anyways. What would be useful is a cost metric. I'm curious how much I'd be w
by loufe 2mo ago
This is only a thinly veiled ad. It's fine, I was curious about this exact setup, anyways.
What would be useful is a cost metric. I'm curious how much I'd be willing to spend as a premium to not have those companies piping my conversations directly to the NSA. Maybe only some conversations? Claude and OpenAI are heavily subsidized, by all accounts, so Kimi K3 on a private endpoint might end up costing more or less - that's what I want to know.
- mayank 2mo agoI was curious about the cost angle too, i.e. how much "free" coding agent I can get for what cost. Here's the research by Fable if you're interested: https://claude.ai/public/artifacts/2c9a5001-0b7e-4944-beb1-9888434fd989 https://claude.ai/public/artifacts/2c9a5001-0b7e-4944-beb1-9...
- aprilnya 2mo agoWith OpenRouter this is pretty easy to see - each model page has various providers listed along with an icon marking providers with zero data retention, and the price. You can also set up an account-wide "guardrail" to prevent routing to non-ZDR providers.
- lukeschlather 2mo agoOpenAI and Anthropic also claim they don't retain data. I'm not sure what it would take for me to trust any of these inference companies, and why I should trust them more than the big ones.
- theshrike79 2mo agoI trust both OpenAI And Anthropic, they have literal billions to lose if someone finds out they've been training with in-house corporate data. Just the GDPR/CCPA fines alone WILL bankrupt both companies.