4 ms·
Does it accept custom openai endpoints and model names? Would be cool to be able to hook this up with ollama or something local.
by gunalx 2y ago
Does it accept custom openai endpoints and model names?
Would be cool to be able to hook this up with ollama or something local.
- j4mie 2y agoFrom the article: "It adds LLM as a dependency, and takes advantage of LLM’s Python API to abstract over the details of talking to the models. This means sqlite-utils-ask can use any of the models supported by LLM or its plugins" Ollama is supported in LLM via this plugin: https://github.com/simonw/llm-ollama https://github.com/simonw/llm-ollama
- gunalx 2y agoThanks for the info. I just assumed LLM was a en var manager for openai stuff. But makes sense.