2 ms·
Even more than that. With Structured Outputs we essentially control layout of the response, so we can force LLM to go through different parts of the completion
by abdullin 1y ago
Even more than that. With Structured Outputs we essentially control layout of the response, so we can force LLM to go through different parts of the completion in a predefined order.
One way teams exploit that - force LLM to go through a predefined task-specific checklist before answering. This custom hard-coded chain of thought boosts the accuracy and makes reasoning more auditable.