4 ms·
Current SOTA post training quantization method is GPTQ: https://arxiv.org/abs/2210.17323 https://arxiv.org/abs/2210.17323
by p1esk 4y ago
Current SOTA post training quantization method is GPTQ:
https://arxiv.org/abs/2210.17323 https://arxiv.org/abs/2210.17323