4 ms·SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving2 points by matt_d 6mo ago