3 ms·
Has anyone successfully fine tuned it for function calling? Thinking could use a lightweight model like this to interpret args in a pipeline then format them fo
by te_chris 3y ago
Has anyone successfully fine tuned it for function calling? Thinking could use a lightweight model like this to interpret args in a pipeline then format them for passing down the chain
- aluxian 3y agoThought the same. Ollama has a JSON mode, it's the closest I got to using it for function calling: brew install ollama brew services start ollama curl http://localhost:11434/api/generate -d '{ "model": "phi:2.7b-chat-v2-q5_K_M", "prompt": "Generate a JSON object that models a list of products", "raw": true, "format": "json", "stream": false }' | jq If you want to keep in touch / share intel: linkedin.com /in/ aluxian or `me` at my username dot com