4 ms·

Is there any OSS model that is good for function calling? Gorilla LLM comes to mind. Not sure if it's actually good at specifically the function calling api tho

Is there any OSS model that is good for function calling? Gorilla LLM comes to mind. Not sure if it's actually good at specifically the function calling api though.

sunshadow 3y ago
Yes, Functionary: https://github.com/MeetKai/functionary/ https://github.com/MeetKai/functionary/ MIT Licensed Its actively maintained as open-source. You can even run it with llama.cpp
tosh 3y ago
Mixtral and some Mistral-7b fine-tunes seem to do alright on function calling.