4 ms·
Thanks for sharing your XP. I liked the documentation of sglang, especially when it comes to structured output: https://docs.sglang.ai/backend/structured_output
by behnamoh 2y ago
Thanks for sharing your XP. I liked the documentation of sglang, especially when it comes to structured output: https://docs.sglang.ai/backend/structured_outputs.html https://docs.sglang.ai/backend/structured_outputs.html
I couldn't find info on TGI constrained generation though.