3 ms·
Didn't they release a structured output mode recently to finally solve this?
by cyral 2y ago
Didn't they release a structured output mode recently to finally solve this?
- astrange 2y agoIt doesn't solve the second problem. Though I can't say how much of an issue it is, and CoT would help. JSON also isn't an ideal format for a transformer model because it's recursive and they aren't, so they have to waste attention on balancing end brackets. YAML or other implicit formats are better for this IIRC. Also don't know how much this matters.