At first glance, that sounds like it could work. From what I've read, there seems to be two main ways to regain some quality with quantization: post-training wh

At first glance, that sounds like it could work. From what I've read, there seems to be two main ways to regain some quality with quantization: post-training which happens after, and quantization-aware training which quantizes during training but leaves the activations and gradients full precision