3 ms·
It's not nerfed, it's natively trained at that quantization a.k.a. Quantization Aware Training.
by zozbot234 6mo ago
It's not nerfed, it's natively trained at that quantization a.k.a. Quantization Aware Training.
- pbgcp2026 6mo agoQAT typically uses BF16/FP32 during the training process to simulate lower precision.