2 ms·
It has a clever way to decode multiple valid tokens at once, rather than just one token at a time. Corresponding project link: https://github.com/sgl-project/s
by OutOfHere 2y ago
It has a clever way to decode multiple valid tokens at once, rather than just one token at a time.
Corresponding project link: https://github.com/sgl-project/sglang https://github.com/sgl-project/sglang