4 ms·

It should be possible to run on Mac via https://github.com/mmastrac/diffgemma https://github.com/mmastrac/diffgemma, but I'm at rustconf right now and I can't d

It should be possible to run on Mac via https://github.com/mmastrac/diffgemma https://github.com/mmastrac/diffgemma, but I'm at rustconf right now and I can't download weights on hotel wifi easily.

zahlekhan 27d ago
let me try this out as well
- mmastrac 27d ago
  https://github.com/mmastrac/diffgemma#custom-quantization https://github.com/mmastrac/diffgemma#custom-quantization has some instructions on (naively) quantizing the upstream model as well.