3 ms·
What locally hosted (on device, or on local network) LLMs does it support? I can only see mention of using cloud providers.
by smcleod 3y ago
What locally hosted (on device, or on local network) LLMs does it support? I can only see mention of using cloud providers.
- faune 3y agoIt’s purely API based communication, but we route it through our own API and your communication with it gets sent to OpenAI or Mistral. No unique identifiers for sent messages, we do have some custom content filtering in place for safety.