3 ms·

> (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model Uh-huh...