3 ms·
The other thing, is encrypted inferencing a thing/service currently? I want to run my own models locally just because if I'm going to be chatting to it about my
by ge96 7mo ago
The other thing, is encrypted inferencing a thing/service currently? I want to run my own models locally just because if I'm going to be chatting to it about my day to day life why send it to a server in plaintext.
- lukewarm707 7mo agoencrypted inferencing, meaning homomorphic encryption: no, it's not solved. cryptographic confirmation of zero knowledge: yes. the latter, based on trust in the hardware manufacturer and their root ca. so, encrypted if you trust intel/nvidia to sign it. there are a few services, phala, tinfoil, near ai, redpill is an aggregator of those