3 ms·

Lmao that output genuinely gives me the creeps. What's you opnion vs. SGLang in this regard?

• kouteiheika 1mo ago
  > What's you opnion vs. SGLang in this regard? No opinion yet, but I'm planning to temporarily switch and see how it goes. I really hope the grass is greener there, but I'm keeping my expectations in check for now.
  • h-jones 1mo ago
    I’ve had to debug DSV4 issues with both SGLang and vLLM in the last month. FWIW current SGLang nightly seems fine.
  • girvo 1mo ago
    SGLang also accepts vibe coded PRs, but seems to be more careful about what goes in
• bugglebeetle 1mo ago
  I recently switched to using for some large volume inference with small, fine-tuned models and was surprised how nice and painless things were. vLLM seems to have a lot more gotchas and kludged together stuff once you get outside of anything straightforward.