4 ms·
btw that's not how tools work at all. Tools are function/API based. (Unless you expose a function run_sql(query), but that's on you.)
by TZubiri 2y ago
btw that's not how tools work at all. Tools are function/API based. (Unless you expose a function run_sql(query), but that's on you.)
- verdverm 2y agoI brought it up because popular frameworks are offering this type of agent or function out of the box There is no "way that tools work" You pass OpenAPI like schemas along with the prompt and you get back a JSON object. The rest is code and you can do anything you want with. The LLM is merely mapping from unstructured text onto a schema best it can, and we know they are imperfect.
- TZubiri 2y agohttps://en.wikipedia.org/wiki/Robustness_principle https://en.wikipedia.org/wiki/Robustness_principle "be conservative in what you send, be liberal in what you accept" LLM parses text into a list of parameters. You design your function such that it is safe regardless of what the parameters are.