3 ms·
Only the 'it' models seem to have quants. I was really hoping to try a base model.
by Wowfunhappy 7mo ago
Only the 'it' models seem to have quants. I was really hoping to try a base model.
- kristjansson 7mo agoBasic quantization is easy if you have enough RAM (not VRAM) to load the weights.