3 ms·
There was a paper going around claiming that structured outputs did hurt the quality of the output, but it turns out their experiment setup was laughably bad [0
by crystal_revenge 2y ago
There was a paper going around claiming that structured outputs did hurt the quality of the output, but it turns out their experiment setup was laughably bad [0].
It looks like, so long as you're reasonable with the prompting, you tend to get better outputs when using structure.
0. https://blog.dottxt.co/say-what-you-mean.html https://blog.dottxt.co/say-what-you-mean.html
- coredog64 2y agoI’ve seen one case where structured output was terrible: OCR transcription of handwritten text in a form with blanks. You want a very low temperature for transcription, but as soon as the model starts to see multiple blank sequences, it starts to hallucinate that “” is the most likely next token.