3 ms·
It's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.
by shekhar101 3y ago
It's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.
- gardenfelder 3y agohttps://github.com/BerriAI/liteLLM-proxy https://github.com/BerriAI/liteLLM-proxy