3 ms·
Does Mesh LLM encrypt the payload between nodes? Is it possible to read requests from other users?
by darkpicnic 3mo ago
Does Mesh LLM encrypt the payload between nodes? Is it possible to read requests from other users?
- tekacs 3mo agoI'm not affiliated, but yes – the main 'point' of iroh is that it's 'dial-a-key', QUIC with encryption based on the keys of the endpoints.
- metadat 3mo agoJust wondering, why do you care about encryption in this context?
- darkpicnic 3mo agoIf payloads to LLMs are being passed around to various nodes, even trusted ones (like friends and family), it gets awkward if you send something very personal. Think sending a medical question to medgemma:27b.
- oezi 3mo agoEven if transport is encrypted, the LLM computations will always be clear text, right?
- embedding-shape 3mo agoIndeed, it's in-transit-encrypted so snoopers won't be able to see it, but it's not E2E encrypted nor in-process encrypted, the one's doing the inference could obviously see the input/output.