4 ms·
Do all of these models, regardless of parameters, support tool use and structured output?
by codybontecou 10mo ago
Do all of these models, regardless of parameters, support tool use and structured output?
- Y_Y 10mo agoIn principle any model can do these. Tool use is just detecting something like "I should run a db query for pattern X" and structured output is even easier, just reject output tokens that don't match the grammar. The only question is how well they're trained, and how well your inference environment takes advantage.
- Ey7NFZ3P0nzAe 10mo agoYes they all support tool use at least.