3 ms·
This seems a fine tradeoff to me, depending on the context. There are datasets and operations on them where speed being sacrificed for privacy/security seems ap
by randomImmigrant 2mo ago
This seems a fine tradeoff to me, depending on the context. There are datasets and operations on them where speed being sacrificed for privacy/security seems appropriate.
Ideally, give me a dial, to ask for encrypted intelligence when I need it. Kind of like a private chat, but with deeper privacy protections.
- XorNot 2mo agoExcept that's for pathetically small datasets. What real datasets exist where this would be a worthwhile trade off versus simply owning the hardware? The numbers are so bad that underpowered local hardware would still beat it.
- inigyou 2mo agoyep I can beat 0.0008 tokens/s on GLM-5.2 on my CPU