3 ms·
Does this mean I should switch to sglang? How hard is it to add the capability for these type of models to vLLM? Or does it already handle them?
by ilaksh 6mo ago
Does this mean I should switch to sglang? How hard is it to add the capability for these type of models to vLLM? Or does it already handle them?
- zhangchen 6mo ago[dead]