41 ms·
With function calls the model may or may not output something that matches the schema, with structured output the schema is enforced at the logit level.
by guntars 2y ago
With function calls the model may or may not output something that matches the schema, with structured output the schema is enforced at the logit level.
- jasonjmcghee 2y agoAt least in the case of openai, you can set "strict" to "true" and function calling / tool use must / is enforced to follow the schema too.