4 ms·
https://github.com/mmastrac/diffgemma#custom-quantization https://github.com/mmastrac/diffgemma#custom-quantization has some instructions on (naively) quantizin
by mmastrac 2mo ago
https://github.com/mmastrac/diffgemma#custom-quantization https://github.com/mmastrac/diffgemma#custom-quantization has some instructions on (naively) quantizing the upstream model as well.