4 ms·
Seems pretty useful, often hopping between different quants. I wonder if this would work for different "branches" of a model. E.g. qwen 3.6 35b regular vs ablit
by sarjann 3mo ago
Seems pretty useful, often hopping between different quants. I wonder if this would work for different "branches" of a model.
E.g. qwen 3.6 35b regular vs abliterated.
- alessandroberna 3mo agoSeems like it wouldn't work for different branches. It probably needs to store the full F16 version for each model variant, even if the variants share the same base model