3 ms·
The behavior of an LLM is not and cannot be “well-specified”.
by xigoi 4mo ago
The behavior of an LLM is not and cannot be “well-specified”.
- Der_Einzige 4mo agotrumps voice wrong https://developers.openai.com/api/docs/guides/structured-outputs https://developers.openai.com/api/docs/guides/structured-out... https://github.com/guidance-ai/guidance https://github.com/guidance-ai/guidance https://github.com/noamgat/lm-format-enforcer https://github.com/noamgat/lm-format-enforcer https://github.com/mlc-ai/xgrammar https://github.com/mlc-ai/xgrammar https://github.com/dottxt-ai/outlines https://github.com/dottxt-ai/outlines
- JCTheDenthog 4mo agoLibraries like Guidance guarantee that the output of an LLM will be syntactically correct (i.e. it will be valid JSON or whatever output format you are wanting). They do not, and fundamentally cannot guarantee that the data contained in them is actually correct, and cannot make the actual behavior of the LLM "well-specified". Or, as you put it, trumps voice wrong.