3 ms·
Have you tested tool calling capabilities of these cheaper models?
by antupis 2y ago
Have you tested tool calling capabilities of these cheaper models?
- simonw 2y agoNot yet. A lot of them make bold claims and there are benchmarks like https://gorilla.cs.berkeley.edu/leaderboard.html https://gorilla.cs.berkeley.edu/leaderboard.html but I don't have my own function calling test harness setup yet.
- leobg 2y agoYou know that you can make any model call and use tools simply by giving it few shot examples and writing your own parsing logic. I’ve done it many times for clients, both at the prompt and at the fine-tune level.