3 ms·
It does decently well actually. You can test function-calling using Langroid. There are several example scripts you could try from the repo, e.g. uv run ex
by d4rkp4ttern 2y ago
It does decently well actually. You can test function-calling using Langroid. There are several example scripts you could try from the repo, e.g.
uv run examples/basic/tool-extract-short-example.py --model ollama/mistral-small
sample output:
https://gist.github.com/pchalasani/662d7f13dbe690d6e2bfef01c8b70026 https://gist.github.com/pchalasani/662d7f13dbe690d6e2bfef01c...
Langroid has a ToolMessage mechanism that lets you specify a tool/fn-call using Pydantic, which is then transpiled into system message instructions.