I personally fine-tuned it with QAT = quantisation aware training and custom extensions to induce the sparsity. https://pytorch.org/docs/stable/quantization.ht

I personally fine-tuned it with QAT = quantisation aware training and custom extensions to induce the sparsity. https://pytorch.org/docs/stable/quantization.html#quantization-aware-training-for-static-quantization https://pytorch.org/docs/stable/quantization.html#quantizati...