4 ms·
Its true - Cursor, Cline, and many others still use xml for tool calls. In JSON, the model needs to "focus" on escaping characters correctly while also sampling
by bhaktatejas922 1y ago
Its true - Cursor, Cline, and many others still use xml for tool calls. In JSON, the model needs to "focus" on escaping characters correctly while also sampling from a reduced token distribution.
https://aider.chat/2024/08/14/code-in-json.html https://aider.chat/2024/08/14/code-in-json.html