3 ms·
Interesting. Do you have any benchmarks?
by Joschkabraun 2y ago
Interesting. Do you have any benchmarks?
- mritchie712 2y agoNo benchmarks, just my anecdotal experience trying to get local LLM's to respond with JSON. The method above works for my use case nearly 100% of the time. Other things I've tried (e.g. `outlines`[0]) are really slow or don't work at all. Would love to hear what others have tried! 0 - https://github.com/outlines-dev/outlines https://github.com/outlines-dev/outlines
- Joschkabraun 2y agoAh yes. Have you tried out instructor [0] or Guidance [1]? [0]: https://github.com/jxnl/instructor/ https://github.com/jxnl/instructor/ [1]: https://github.com/guidance-ai/guidance/tree/main https://github.com/guidance-ai/guidance/tree/main