4 ms·
> Even their "function calling" abstraction still hallucinates parameters and schema huh? sample code please? this should not be true since Structured Outputs
by swyx 2y ago
> Even their "function calling" abstraction still hallucinates parameters and schema
huh? sample code please? this should not be true since Structured Outputs came out - literally prevented from generating invalid json
(more: https://www.latent.space/p/openai-api-and-o1 https://www.latent.space/p/openai-api-and-o1)
- amitness 2y agoIt's not enabled by default for their function calling API. So, hallucination is possible. You have to set 'strict' to True manually to use the same grammar-based sampling they use for structured outputs. https://platform.openai.com/docs/guides/function-calling?api-mode=responses#strict-mode https://platform.openai.com/docs/guides/function-calling?api...