3 ms·
Can I connect it to any OpenAI Rest compatible LLM? So having my own LLM on premises based eg on ollama OpenAI Rest endpoint?
by jhoechtl 3y ago
Can I connect it to any OpenAI Rest compatible LLM? So having my own LLM on premises based eg on ollama OpenAI Rest endpoint?
- Weves 3y agoYes absolutely! We actually have a doc specifically for Ollama: https://docs.danswer.dev/gen_ai_configs/ollama https://docs.danswer.dev/gen_ai_configs/ollama