3 ms·
You might like an information-theoretic take on SpinQuant and the likes [1]. tl;dr: round((2*R)*x) is not a great idea for an R-bit quantization. [1] https://
by jjssmith 2y ago
You might like an information-theoretic take on SpinQuant and the likes [1].
tl;dr: round((2*R)*x) is not a great idea for an R-bit quantization.
[1] https://arxiv.org/abs/2410.13780 https://arxiv.org/abs/2410.13780