3 ms·
Smaller models really arent great at structured output. If this works it would be great for a local model that might not be as good but as long as it respects s
by sareiodata 5mo ago
Smaller models really arent great at structured output. If this works it would be great for a local model that might not be as good but as long as it respects structured output will be vastly more useful.
- OutOfHere 5mo ago> Smaller models really arent great at structured output. That doesn't seem to hold true. Consider gpt-5.4-nano which supports structured output just fine. https://developers.openai.com/api/docs/models/gpt-5.4-nano https://developers.openai.com/api/docs/models/gpt-5.4-nano It seems like a concern that's orthogonal to the model size.
- nosyke 5mo agoI genuinely doubt that they are just lying though lol
- yoeven 5mo agoWe have a full benchmark breakdown specifically on structured output that you can take a look at https://interfaze.ai/leaderboards/structured-output-benchmark https://interfaze.ai/leaderboards/structured-output-benchmar...