4 ms·

What's wrong with quantization?

• minimaxir 3y ago
  There's still a (subjective) generative quality loss, even with recent tricks to minimize it.
  • leetharris 3y ago
    Q8 is generally less than 1% degradation, Q5KM is around 3%. After that is when it starts to really degrade.