3 ms·

Ray doesn't offer anything if you use vLLM on top of Ray Serve though.

• dzr0001 2y ago
  It does if you need pipeline parallelism across multiple nodes.