3 ms·
I see. So this is like, I can have tabby be my LLM server with this limitation or I can just turn that feature off and point tabby at my self hosted LLM as any
by SOLAR_FIELDS 2y ago
I see. So this is like, I can have tabby be my LLM server with this limitation or I can just turn that feature off and point tabby at my self hosted LLM as any other OpenAI compatible endpoint?
- wsxiaoys 2y agoYes - however, the FIM model requires careful configuration to properly set the prompt template.