3 ms·
I've used LiteLLM for my 1k-user service https://LibreThinker.com https://LibreThinker.com Works okay-ish, but some vendors now default to MFA on API keys (eg O
by mmarian 5mo ago
I've used LiteLLM for my 1k-user service https://LibreThinker.com https://LibreThinker.com Works okay-ish, but some vendors now default to MFA on API keys (eg OpenAI) which makes things tricky; I decided to simply let those fail for now.
- sbinnee 5mo agoI am a bit familiar with litellm. Do you proxy server?