4 ms·
Zero-trust AI APIs serving Llama 2 70B inside enclaves
- purplecats 3y agobrilliant! very excited to use this. what will pricing look like (tried CMF-F)?
- purplecats 3y agoalso can you make your whitepaper accessible without the login/email hoops
- mithril-docs 3y agoHi, We've added a copy directly in our GitHub repo: https://github.com/mithril-security/blind_llama/blob/main/docs/docs/whitepaper/blind_llama_whitepaper.pdf https://github.com/mithril-security/blind_llama/blob/main/do...
- mithril-docs 3y agoHi there, Thanks for your question and sorry for the delay in getting back to you! The pricing information is available here: https://www.mithrilsecurity.io/pricing https://www.mithrilsecurity.io/pricing
- kromem 3y agoI've been thinking about the privacy model of E2E encrypted channels with AI processing before sending back for a while now. Awesome to see people doing it and wish you the best of luck.
- jerpint 3y agoHow “secure” is this zero-trust? Are there cryptographic guarantees?
- deleted 3y ago[deleted]
- amluto 3y agoThis seems likely to be extremely weak. The TPM is somewhat useful for verifying that hardware that you own or fairly tightly specify is running what you think it is unless there is a moderately sophisticated physical attacker around. But for servers in the cloud? How are you even supposed to know what firmware, etc you’re verifying? Actual confidential computing systems (TDX, fancy variants of SEV, etc) are meant to address this type of use case. The TPM isn’t.
- vvoruganti 3y agoIs the model being served using confidential GPUs?