3 ms·

The speed of the response is waaay to quick for using OpenAi as backend, it's almost instant!

• armcat 1y ago
  I've been asking bespoke questions and the timing is >2 seconds, and slower than what I get for the same questions to ChatGPT (using gpt-4.1-mini). I am looking at their call stack and what I see: "verifyOpenAIConnection()", "generateOpenAIChatCompletion()", "getOpenAIModels()", etc. Maybe it's just so it's compatible with OpenAI API?
  • martinald 1y ago
    Check the bottom, I think it's just some off the shelf chat UI that uses OpenAI compatible API behind the scenes.
    • armcat 1y ago
      Ah got it, it looks like it's a whole bunch of things so it can also interface with ollama, and other APIs.