3 ms·
Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
by cubefox 7mo ago
Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
- irthomasthomas 7mo agoit enables models larger than was previously possible.
- cubefox 7mo agoNo because the base model from which the distilled or quantized models are derived is larger.