3 ms·
Structured output is trivial: just select the output tokens from the given list of probability values filtered for the allowed next tokens in the schema. Other
by jiggawatts 2y ago
Structured output is trivial: just select the output tokens from the given list of probability values filtered for the allowed next tokens in the schema.
Other LLM vendors figured this out many months ago.
- retinaros 2y agothey did not . anthropic often sends broken json