4 ms·

Onyx.app has a self hosted option. I just did the docker setup yesterday. It’s not a great home user option imo but seems like it’s functional for enterprise.

• Fischgericht 1y ago
  Just had a quick look - while they have that self-hosting option, they still assume you will use a cloud LLM. I started digging because I got confused of them not mentioning any GPU when it comes to resource requirements. There is some documentation on using it fully self-hosted including the LLM, but the emphasis here is on "some". To be clear: I am looking at this from a CEO perspective, not a "I will play with it in my spare time" nerd one.
• jxmesth 1y ago
  Going off on a tangent here but, does anyone have a good guide on how to set up an AI/LLM/GPT chatbot/agent for a small business? Not looking to spend millions but a couple thousand are alright. TIA
  • pdksam 1y ago
    Hmm I thought this would be a competitive space already i.e. integrating llm chat bots on any website
  • tinodb 1y ago
    Open-webui works well for us: https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui
    • jxmesth 1y ago
      u/tinodb, thanks