Yep, this. I see a lot of other worryingly confident answers in the thread that are wrong. SGLang finally has at least some notes[0], but I’m always surprised

Yep, this. I see a lot of other worryingly confident answers in the thread that are wrong. SGLang finally has at least some notes[0], but I’m always surprised there isn’t more of a community wide effort to trace down the sources of indeterminism. [0] https://docs.sglang.ai/references/faq.html https://docs.sglang.ai/references/faq.html