4 ms·DuoAttention-Slashes memory and latency for LLMs without sacrificing performance2 points by dsr12 2y ago