50 ms·Storage based KVCache for denser token factory1 points by baruch 5mo agobaruch 5mo agoIt is possible to get more tokens out of the same hardware by leveraging fast storage for KVCache, it is especially useful for agentic workloads.