4 ms·No. Your KV cache is kept in memory also.by DSingularity 1y agoNo. Your KV cache is kept in memory also.