4 ms·
What quantization methods rely on second order gradients? I thought people just applied gradient decent, then round to whatever precision.
by thomasahle 4y ago
What quantization methods rely on second order gradients? I thought people just applied gradient decent, then round to whatever precision.
- p1esk 4y agoCurrent SOTA post training quantization method is GPTQ: https://arxiv.org/abs/2210.17323 https://arxiv.org/abs/2210.17323