3 ms·A Minimal KV Cache Manager for Paged Attention in ~100 Lines of Python2 points by tspeterkim 2y ago