3 ms·
LiteLLM. https://www.litellm.ai/ https://www.litellm.ai/
by spdustin 2y ago
LiteLLM.
https://www.litellm.ai/ https://www.litellm.ai/
- ponywombat 2y agoLiteLLM seemed to be the best approach for what I needed - simple integration with different models (mainly OpenAI and the various Bedrock models) and the ability to track costs / limit spending. It's working really well so far.
- emporas 2y agoDidn't know about LiteLLM. That seems to be the right kind of middleware most people would need, instead of Langchain.