3 ms·
To get the production level performance, you do need the RDNA compatible hardware. However, vLLM supports multi node clusters over normal ethernet too https://
by Maxious 10mo ago
To get the production level performance, you do need the RDNA compatible hardware.
However, vLLM supports multi node clusters over normal ethernet too https://docs.vllm.ai/en/stable/serving/parallelism_scaling/#multi-node-deployment https://docs.vllm.ai/en/stable/serving/parallelism_scaling/#...