3 ms·
Do you support custom LLMs?
by czyhandsome 3y ago
Do you support custom LLMs?
- jackmpcollins 3y agoAt the moment only those that support the OpenAI Chat API, with function calling for the structured outputs. For example you can use LocalAI[0][1] to run models locally. [0] https://github.com/go-skynet/LocalAI https://github.com/go-skynet/LocalAI [1] https://localai.io/features/openai-functions/ https://localai.io/features/openai-functions/