2 ms·vLLM v0.6.0: 2.7x Throughput Improvement and 5x Latency Reduction3 points by xmo 2y agodeleted 2y ago[deleted]