2 ms·
let me try this out as well
by zahlekhan 2mo ago
let me try this out as well
- mmastrac 2mo agohttps://github.com/mmastrac/diffgemma#custom-quantization https://github.com/mmastrac/diffgemma#custom-quantization has some instructions on (naively) quantizing the upstream model as well.