3 ms·

Sounds like a side channel attack waiting to happen.

• unglaublich 5mo ago
  So I guess we'll all be applying a random rotation to our matrices now to obscure their contents, like TurboQuant does. https://arkaung.github.io/interactive-turboquant/#rotation https://arkaung.github.io/interactive-turboquant/#rotation
  • buildbot 5mo ago
    Not that it super matters, but random hadamards for quantization have been a thing since way before turboquant. https://arxiv.org/abs/2404.00456 https://arxiv.org/abs/2404.00456
    • DiabloD3 5mo ago
      Which llama.cpp now does.