47 ms·

Just wondering, why do you care about encryption in this context?

• darkpicnic 3mo ago
  If payloads to LLMs are being passed around to various nodes, even trusted ones (like friends and family), it gets awkward if you send something very personal. Think sending a medical question to medgemma:27b.
  • oezi 3mo ago
    Even if transport is encrypted, the LLM computations will always be clear text, right?
    • embedding-shape 3mo ago
      Indeed, it's in-transit-encrypted so snoopers won't be able to see it, but it's not E2E encrypted nor in-process encrypted, the one's doing the inference could obviously see the input/output.