3 ms·
>so long as quantization isn't too extreme (as it is here) This is true for post-training quantization, not for quantization-aware training, and not for someth
by orbital-decay 2y ago
>so long as quantization isn't too extreme (as it is here)
This is true for post-training quantization, not for quantization-aware training, and not for something like BitNet. Here they claim comparable performance per parameter count as normal models, that's the entire point.