4 ms·
But.. if the LLM uses something like a MOE architecture, then surely some information about the prompt would leak just by observing what parts of the model are
by totetsu 2y ago
But.. if the LLM uses something like a MOE architecture, then surely some information about the prompt would leak just by observing what parts of the model are pulled into memory?
- palata 2y agoI think if you want full homomorphic encryption, you have to go for the worst case. So you always pull all the model? That's usually why FHE is not practical.