4 ms·
Efficiency gains can be used to make existing models more profitable, or to make new larger and more intelligent models.
by irthomasthomas 7mo ago
Efficiency gains can be used to make existing models more profitable, or to make new larger and more intelligent models.
- cubefox 7mo agoSome yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
- irthomasthomas 7mo agoit enables models larger than was previously possible.
- cubefox 7mo agoNo because the base model from which the distilled or quantized models are derived is larger.