5 ms·
Is there a way to figure out likely quantization from the output. I mean, does quantization degrade output quality in certain ways that are different from other
by weinzierl 1y ago
Is there a way to figure out likely quantization from the output. I mean, does quantization degrade output quality in certain ways that are different from other modification of other model properties (e.g. size or distillation)?