5 ms·Aren't advances in KV caching making compute cost not quite quadratic?by diziet 1y agoAren't advances in KV caching making compute cost not quite quadratic?