3 ms·

Congrats for shipping! Have you seen LiteLLM Gateway before? As a bonus it supports a lot of different providers. https://docs.litellm.ai/docs/simple_proxy ht

Congrats for shipping! Have you seen LiteLLM Gateway before? As a bonus it supports a lot of different providers. https://docs.litellm.ai/docs/simple_proxy https://docs.litellm.ai/docs/simple_proxy

Stream 1y ago
Yes. Because my original purpose is to use third party LLMs in JetBrains AI Assistant, it doesn't provide Ollama or LM Studio endpoints as required. So I decide to develop one on myself.