3 ms·
unfortunately, I don't think gemma 3 supports tool calling well. It's not trained into the model, and the 'support' for tool calling is post model training. We
by mchiang 1y ago
unfortunately, I don't think gemma 3 supports tool calling well. It's not trained into the model, and the 'support' for tool calling is post model training.
We are working with Google, and trying to give the feedback on improving tool calling capabilities for future Gemma models. Fingers crossed!
- ai_viewz 1y agoWe can do function calling with Google's Gemma 3, just need to follow the right pattern.
- Eisenstein 1y agoAll instruct templates are added in "post model training", and Gemma 3 works fine calling custom MCP tools using Jan and KoboldCpp.