3 ms·
Thoughts on any-llm-gateway versus litellm-proxy? litellm is a great library, but one team using litellm-proxy reported having many issues with it to me. I hav
by bravura 11mo ago
Thoughts on any-llm-gateway versus litellm-proxy?
litellm is a great library, but one team using litellm-proxy reported having many issues with it to me. I haven't tried it yet.
- cowmix 11mo agoYeah, I wonder what gaps in Litellm Proxy made Mozilla want to even do this.
- dbish 11mo agoWhat were the problems? I've been trying it out and haven't hit issues yet, but not using it at scale yet so I'm curious what to watch out for. I figure it's open source (MIT) so I can make changes as needed if there was anything particulary annoying.