3 ms·
Hey Simon - In your experience, what's the best "small" model for function/tool calling? Of the ones I've tested they seem to return the function call even when
by prettyblocks 2y ago
Hey Simon - In your experience, what's the best "small" model for function/tool calling? Of the ones I've tested they seem to return the function call even when it's not needed, which requires all kinds of meta prompting & templating to weed out. Have you found a model that more or less just gets it right?
- simonw 2y agoI'm afraid I don't have a great answer for that - I haven't spent nearly enough time with function calling in these models. I'm hoping to add function calling to my LLM library soon which will make me much better equipped to experiment here.
- prettyblocks 2y agoCool, thanks for the reply. Looking forward to following along with your progress.