5 ms·
We've had this for over 1 year in Lamini - https://lamini-ai.github.io/inference/json_output/ https://lamini-ai.github.io/inference/json_output/ Works with any
by gdiamos 2y ago
We've had this for over 1 year in Lamini - https://lamini-ai.github.io/inference/json_output/ https://lamini-ai.github.io/inference/json_output/
Works with any open LLM, including Llama 3.1
- radarsat1 2y agoLooks useful!
- AStrangeMorrow 2y agoAlso the outlines library: https://github.com/outlines-dev/outlines https://github.com/outlines-dev/outlines
- gdiamos 2y agoYeah! - outlines, guidance, jsonformer were inspiring for this line of work
- HanClinto 2y agoAlso note llama.cpp with grammar support: https://github.com/ggerganov/llama.cpp/tree/master/grammars https://github.com/ggerganov/llama.cpp/tree/master/grammars Supports an EBNF-like syntax, as well as JSON-Schema.
- gdiamos 2y ago[flagged]
- msoad 2y agoWhy not JSON Schema?
- gdiamos 2y agoWe did some user studies and found that people found it less intuitive.