3 ms·
Not that it super matters, but random hadamards for quantization have been a thing since way before turboquant. https://arxiv.org/abs/2404.00456 https://arxiv.
by buildbot 4mo ago
Not that it super matters, but random hadamards for quantization have been a thing since way before turboquant.
https://arxiv.org/abs/2404.00456 https://arxiv.org/abs/2404.00456
- DiabloD3 4mo agoWhich llama.cpp now does.