4 ms·
Can I use open source LLMs with this? Would be great if everything was available self hosted with open source models.
by Scipio_Afri 3y ago
Can I use open source LLMs with this? Would be great if everything was available self hosted with open source models.
- JackHopkins 3y agoNative support for OS LLMs is on the roadmap - the main challenge is to figure out how to manage the knowledge distillation for local models. It’s a top priority (along with typescript support), so check back in a few weeks? Right now any ‘plug-in’ model needs to conform to the OpenAI API. (P.S Carthago delenda est)
- deleted 3y ago[deleted]