3 ms·

https://apiforllm.com/ https://apiforllm.com/ I've been working on this on and off for a few weeks now. The idea is to let LLMs interact with the outside world

by dinp 3y ago

https://apiforllm.com/ https://apiforllm.com/ I've been working on this on and off for a few weeks now. The idea is to let LLMs interact with the outside world using function calling. Eg- I built a simple version of chatgpt web browsing using function calling. There's a django site which is responsible for the auth, managing chats etc and then there's a flask site that's responsible for running functions in a gvisor sandbox. Users will be able to upload their functions as docker images and I'll run them in a sandbox. There is a lot of self doubt at this point: who is this for? Will people pay for usage? Should I open source the entire thing or part of it? To add to this: I have no online audience, how do I promote this? I do have some answers to these questions. Eg- should I open source the flask site and get llama 2 to use it? It provides value to the community + hopefully I can get some attention for the project. I would appreciate any feedback on this project. Please send me an email if you want some openai credits added to your account. Edit: use testaccount/demouser to login, I've added some credits for testing.

J_Shelby_J 3y ago
Hey, so I got pretty far into implementing open api specs for LLMs. To the point where you can point to an open api spec, ingest it, and then it’s available for GPT to select to satisfy user requests. I do this by minify the specs and building an index to feed it that it selects from using logit bias. Im at pause point on it while I figure out how to actually have GPT build the calls, but I think something like you have might solve that. https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier
- dinp 3y ago
  Before the function calling update[0] it was possible for the gpt models to use tools using specific prompts but it was unreliable. Have you tried using function calling to let the model build the calls? [0] https://openai.com/blog/function-calling-and-other-api-updates https://openai.com/blog/function-calling-and-other-api-updat...

by dinp 3y ago

J_Shelby_J 3y ago

Hey, so I got pretty far into implementing open api specs for LLMs. To the point where you can point to an open api spec, ingest it, and then it’s available for GPT to select to satisfy user requests. I do this by minify the specs and building an index to feed it that it selects from using logit bias. Im at pause point on it while I figure out how to actually have GPT build the calls, but I think something like you have might solve that. https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier

dinp 3y ago
Before the function calling update[0] it was possible for the gpt models to use tools using specific prompts but it was unreliable. Have you tried using function calling to let the model build the calls? [0] https://openai.com/blog/function-calling-and-other-api-updates https://openai.com/blog/function-calling-and-other-api-updat...