3 ms·
No benchmarks, just my anecdotal experience trying to get local LLM's to respond with JSON. The method above works for my use case nearly 100% of the time. Othe
by mritchie712 3y ago
No benchmarks, just my anecdotal experience trying to get local LLM's to respond with JSON. The method above works for my use case nearly 100% of the time. Other things I've tried (e.g. `outlines`[0]) are really slow or don't work at all. Would love to hear what others have tried!
0 - https://github.com/outlines-dev/outlines https://github.com/outlines-dev/outlines
- Joschkabraun 3y agoAh yes. Have you tried out instructor [0] or Guidance [1]? [0]: https://github.com/jxnl/instructor/ https://github.com/jxnl/instructor/ [1]: https://github.com/guidance-ai/guidance/tree/main https://github.com/guidance-ai/guidance/tree/main