3 ms·
This paper from last month has a method for acceptable 3-bit quantization and a start at 2-bit. https://arxiv.org/abs/2307.13304 https://arxiv.org/abs/2307.133
by astrange 3y ago
This paper from last month has a method for acceptable 3-bit quantization and a start at 2-bit.
https://arxiv.org/abs/2307.13304 https://arxiv.org/abs/2307.13304