3 ms·
I've built pipelines with lab provided structured outputs and without, one thing to be aware of is enforcing structured outputs has a performance penalty. That
by davedx 9mo ago
I've built pipelines with lab provided structured outputs and without, one thing to be aware of is enforcing structured outputs has a performance penalty.
That might not matter to you, but it can be 2-3x slower sometimes.