4 ms·

Thanks! Do you happen to know if there any OpenWebUI plugins similar to this?

• irthomasthomas 1y ago
  You can use this with openwebui already. Just llm install llm-model-gateway. Then after you save a consortium you run llm serve --host 0.0.0.0 This will give you a openai compatible endpoint which you add to your chat client.