3 ms·
Hi there! To the developers: Is there a way to use a personally owned and hosted LLM? If not, is there an interest in developing such a feature?
by Mithriil 3y ago
Hi there! To the developers:
Is there a way to use a personally owned and hosted LLM? If not, is there an interest in developing such a feature?
- 110 3y agoHi Mithril, For search we already use a offline/self-hosted model from HuggingFace. And you can easily configure it to use other SentenceTransformer models from HuggingFace For chat, follow this feature: https://github.com/khoj-ai/khoj/issues/201 https://github.com/khoj-ai/khoj/issues/201 to see when Khoj gets the ability to use offline/self-hosted chat models