3 ms·QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (SOTA sub-4-bit inference)1 points by Hugsun 2y ago