3 ms·
QAT is an optimizing quantization algorithm, not naive quant.
by binary132 2mo ago
QAT is an optimizing quantization algorithm, not naive quant.
- MrDrMcCoy 2mo agoRight, but the way they phrased it suggested that without QAT it could not be quanted at all.
- dragonwriter 2mo agoIsn’t QAT a training approach (roughly, simulating quantization in the forward pass during training so that quantization of the level targeted in training has close-to-optimal behavior), not a quantization algorithm? Hence, the name?
- binary132 2mo agosounds like a repeatable method of optimizing quantization to me, friend