3 ms·Why would it be higher? You can keep KV cache precomputed like before.by paraschopra 2y agoWhy would it be higher? You can keep KV cache precomputed like before.