3 ms·Why quantize to int8 when k3 is int4? I could be wrong, but that’s what I remember seeing.by withinboredom 2mo agoWhy quantize to int8 when k3 is int4? I could be wrong, but that’s what I remember seeing.