3 ms·
Hey, so I got pretty far into implementing open api specs for LLMs. To the point where you can point to an open api spec, ingest it, and then it’s available for
by J_Shelby_J 3y ago
Hey, so I got pretty far into implementing open api specs for LLMs. To the point where you can point to an open api spec, ingest it, and then it’s available for GPT to select to satisfy user requests.
I do this by minify the specs and building an index to feed it that it selects from using logit bias.
Im at pause point on it while I figure out how to actually have GPT build the calls, but I think something like you have might solve that.
https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier
- dinp 3y agoBefore the function calling update[0] it was possible for the gpt models to use tools using specific prompts but it was unreliable. Have you tried using function calling to let the model build the calls? [0] https://openai.com/blog/function-calling-and-other-api-updates https://openai.com/blog/function-calling-and-other-api-updat...