4 ms·
They provide that with base URL parameter: --api_base_url: You can use this flag (or the OPENAI_BASE_URL environment variable) to pass a different API URL from
by coolspot 2y ago
They provide that with base URL parameter:
--api_base_url: You can use this flag (or the OPENAI_BASE_URL environment variable) to pass a different API URL from the default "https://api.openai.com/v1 https://api.openai.com/v1". This allows you to use other OpenAI-compatible LLM providers like TogetherAI, self-hosted vLLM or Ollama, etc.