3 ms·
Structured outputs are hard... but they claimed to have solved this a year ago. They were lying, of course, and meanwhile charged output tokens for malformed
by jappgar 2y ago
Structured outputs are hard... but they claimed to have solved this a year ago.
They were lying, of course, and meanwhile charged output tokens for malformed JSON.
- jiggawatts 2y agoStructured output is trivial: just select the output tokens from the given list of probability values filtered for the allowed next tokens in the schema. Other LLM vendors figured this out many months ago.
- retinaros 2y agothey did not . anthropic often sends broken json