3 ms·

I've been asking bespoke questions and the timing is >2 seconds, and slower than what I get for the same questions to ChatGPT (using gpt-4.1-mini). I am looking

by armcat 1y ago

I've been asking bespoke questions and the timing is >2 seconds, and slower than what I get for the same questions to ChatGPT (using gpt-4.1-mini). I am looking at their call stack and what I see: "verifyOpenAIConnection()", "generateOpenAIChatCompletion()", "getOpenAIModels()", etc. Maybe it's just so it's compatible with OpenAI API?

martinald 1y ago
Check the bottom, I think it's just some off the shelf chat UI that uses OpenAI compatible API behind the scenes.
- armcat 1y ago
  Ah got it, it looks like it's a whole bunch of things so it can also interface with ollama, and other APIs.