4 ms·
Function calling might be one reason. If your app has a lot of custom functions for interacting with tools, fine tuning may be preferred over using context toke
by subroutine 2y ago
Function calling might be one reason. If your app has a lot of custom functions for interacting with tools, fine tuning may be preferred over using context tokens.
- AlexeyBrin 2y agoCan you recommend a tutorial/document about fine tuning a small model for selecting the correct functions ? Would be great to have something local that can replace OpenAI functions/tools API.
- subroutine 2y agoThe linked GitHub article above describes syntax for fine tuning Mistral for function calling. Here is an example of data prepared for fine tuning Llama for function calling... https://huggingface.co/datasets/mzbac/function-calling-llama-3-format-v1.1/viewer https://huggingface.co/datasets/mzbac/function-calling-llama... I'm unaware of any comprehensive guides - we're still in the wild west.