4 ms·
So what we want now is unsloth (or anyone) to release 4/6-bit quantized models of these releases?
by ComputerGuru 4mo ago
So what we want now is unsloth (or anyone) to release 4/6-bit quantized models of these releases?
- coder543 4mo agoYep, Unsloth already did, as linked in the comment at the top of this thread