4 ms·Efficient Memory Management for Large Language Model Serving with PagedAttention2 points by sonabinu 1y ago