4 ms·
Llama-3.1 supports tool calls via prompting
- Onawa 2y agohttps://ollama.com/blog/tool-support https://ollama.com/blog/tool-support Ollama enables tool support for a variety of models now as well, including Llama-3.1.
- realprimoh 2y agoSo do most LLMs now days, no?
- viraptor 2y agoKind of. Those that are explicitly trained to do that with consistent formats will do it better. They'll also save you the extra tokens needed to explain the format/method of interacting with functions. But yeah, you can simulate this with any recent model and enough explanation.
- ndr_ 2y agoDifferent approach, which also works with Llama 3.0 8B: let the LLM write the tool invocation of choice in Python syntax, parse the LLM response with the Python AST package. (PoC'y hackathon demo) code here: https://github.com/ndurner/aileen2 https://github.com/ndurner/aileen2.
- gjsgdj 2y ago[dead]
- gjsgdj 2y ago[dead]