2 ms·
Is 4 bits too small? Or is the quantization method just not sophisticated enough. See https://arxiv.org/pdf/2210.17323.pdf https://arxiv.org/pdf/2210.17323.pdf
by sebzim4500 4y ago
Is 4 bits too small? Or is the quantization method just not sophisticated enough.
See https://arxiv.org/pdf/2210.17323.pdf https://arxiv.org/pdf/2210.17323.pdf