4 ms·
The lab is tied to the vLLM project. I would say it might get picked up sooner by vLLM than other inference frameworks.
by helloericsf 2y ago
The lab is tied to the vLLM project. I would say it might get picked up sooner by vLLM than other inference frameworks.