3 ms·

To be clear, this is an open-source frontend for a not-open-source AI provider. It's calling OpenAI behind the scenes.

• eurekin 3y ago
  Can it call anything self hosted or ollama?
  • Falimonda 3y ago
    That's on the roadmap
    • htsh 3y ago
      Can one enter their own opeanai URL and api-key? (so we can use openai-compatible things like openrouter or lm-studio)?
      • nullstyle 3y ago
        Doesn't look like it: https://gitlab.com/literally-useful/voxos/-/blob/dev/voxos/services/agents.py?ref_type=heads#L34 https://gitlab.com/literally-useful/voxos/-/blob/dev/voxos/s... edit: shouldn't be hard to enable though
      • Falimonda 3y ago
        Yes, you can define your own key in either the .env, CLI call on run.sh, or in your environment. https://gitlab.com/literally-useful/voxos/-/blob/dev/.env?ref_type=heads#L11 https://gitlab.com/literally-useful/voxos/-/blob/dev/.env?re...
        • nullstyle 3y ago
          That doesn't let me send requests to my local litellm instance, though. You have to be able to configure the endpoint that requests are sent against as well.
          • Falimonda 3y ago
            Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
            • nullstyle 3y ago
              Hell yeah. Good luck!
              • Falimonda 3y ago
                Do you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/
                • nullstyle 3y ago
                  I'm not sure if it is _fully_ openai compatible, but whispercpp has a server bundled that says it is "OAI-like": https://github.com/ggerganov/whisper.cpp/tree/master/examples/server https://github.com/ggerganov/whisper.cpp/tree/master/example... I don't have any direct experience with it... I've only played around with whisper locally, using scripts.
                • khimaros 3y ago
                  https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI
  • lxe 3y ago
    I think anything compatible with either chat completions or completions API should work.
  • speedgoose 3y ago
    It should be possible using LiteLLM and a patch or a proxy. https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm
• Falimonda 3y ago
  Fair enough. With that said, support for running a local, self-hosted, and non-OpenAI cloud-hosted models is in the works.
• deleted 3y ago
  [deleted]
• Cheer2171 3y ago
  "Open source" need to be banned from the titles of these kinds of submissions. Or at least you should have to call it an "API client". The post title as written seems intentionally deceptive.
  • Falimonda 3y ago
    That sounds like a personal preference. The repo is public and welcomes contributors which by definition is open-source. There's nothing deceptive about it, but you're free to get pedantic over it all you'd like.
  • neilv 3y ago
    I think not everyone understands why it's very important that the term mean more than "I put something in GitHub". Especially when that something is promoting the opposite of open source. (That's "open sores", which is different.)