3 ms·
While not explicitly mentioned, why only openai api is supported? Folks with local LLMs feels left out.
by 3abiton 1y ago
While not explicitly mentioned, why only openai api is supported? Folks with local LLMs feels left out.
- nicovank 1y agoThis is in the works :) In the past and still today, OpenAI has much better and easier function call support, something we rely on. We currently are running through LiteLLM, so while undocumented in theory other LLMs could work (in my experience they don't). I’m working on updating and fixing this.