12 ms·
Wrong, custom "specs" i.e. schemas, are literally all we have for "real" guardrails with LLMs. https://developers.openai.com/api/docs/guides/structured-outputs
by Der_Einzige 4mo ago
Wrong, custom "specs" i.e. schemas, are literally all we have for "real" guardrails with LLMs.
https://developers.openai.com/api/docs/guides/structured-outputs?example=moderation https://developers.openai.com/api/docs/guides/structured-out...
Nothing else operates on the logprobs level and literally bans continuations that fail your schema.
- scwoodal 4mo agoEnforcing structured outputs from LLMs is not the same thing as using linters, formatters, static analysis to control how an agent writes code.
- Der_Einzige 4mo agoNo, it's not. It's strictly better.
- scwoodal 4mo agoCan you share examples, links to Github of this approach? I'd like to learn.