3 ms·
Ask HN: Would you pay for an AI API that guarantees zero prompt retention?
i am just tired of looking for a reliable open-source model AI API with ZDR and don't even save my prompts. I'm thinking of a service for people like me who want to use it.
idea is a simple OpenAI-compatible API:
Access to open-weight models
zero retention of prompts and completions
no training on data
only retain metadata required for billing and operations: request ID, model, input/output token counts, latency, timestamp, etc.
no request/response in logs
Just here to check interest. I am not 100% sure if I can get compute to do it or not (may be i can just try with my 5090 first with a small model), but I just want to check and talk with people rather than just thinking in my head.
- cregy 1mo agoOpenrouter offers that already on a few models
- selfhoster11 1mo agoTinfoil etc offer TEE inference that works well, directly or via API routers.
- mhrnik 1mo agothanks. tinfoil [dot] sh looks promising. trying it.
- ljlolel 1mo agoMy router provides that! TrustedRouter.com we have many end to end encrypted models, and providers including Tinfoil but also others Importantly i have confidential compute so you can verify the end to end process of not logging the data -- at all. https://trustedrouter.com/blog/how-confidential-computing-protects-ai-prompts?utm_source=hackernews&utm_medium=organic_reply&utm_campaign=openrouter_conversations_202608&utm_content=20260827_hackernews_zero_retention_api https://trustedrouter.com/blog/how-confidential-computing-pr...
- mhrnik 1mo agothanks, checking