3 ms·
There are many solutions for constrained/structured generation with LLMs these days, here is a blog post my employer published about this a while back: https://
by shawnz 2y ago
There are many solutions for constrained/structured generation with LLMs these days, here is a blog post my employer published about this a while back: https://monadical.com/posts/how-to-make-llms-speak-your-language.html https://monadical.com/posts/how-to-make-llms-speak-your-lang...
I'm partial to Outlines lately, but they all have various upsides and downsides.
OpenAI even natively added support for this on their platform recently: https://openai.com/index/introducing-structured-outputs-in-the-api/ https://openai.com/index/introducing-structured-outputs-in-t...
- hedgehog 2y agoThis is a really good post. I did find one error, Instructor works well with at least one other back end (Ollama). Outlines looks quite interesting but I wasn't able to get it to work reliably.