4 ms·
Did you...did you read the technical details? This is almost all they talk about, this method was created to get around. Take a look, it's good stuff! Basicall
by tbalsam 2y ago
Did you...did you read the technical details? This is almost all they talk about, this method was created to get around.
Take a look, it's good stuff! Basically a LoRA to reconstruct outliers lost by quantization, helping keep the performance of the original model.