3 ms·Paged KV-Cache Compression with Variable Compression Rates per Attention Head2 points by jgrahamc 2y ago