2 ms·
Have you looked into structured generation with a library like outlines? https://github.com/dottxt-ai/outlines https://github.com/dottxt-ai/outlines
by msp26 2y ago
Have you looked into structured generation with a library like outlines? https://github.com/dottxt-ai/outlines https://github.com/dottxt-ai/outlines
- druskacik 2y agoYes! This library is great and definitely helps, but I still had problems with performance. For example, smaller models would still hallucinate when extracting a JSON field when the given field wasn't present in the text (I'd expect null, but it provided either an incorrect value from the text, or a totally made up value).