4 ms·
This makes sense to me. I’d previously mentioned here [1]: > …can’t people just build their product with openAI or other and plan to move away based on the cos
by bredren 3y ago
This makes sense to me. I’d previously mentioned here [1]:
> …can’t people just build their product with openAI or other and plan to move away based on the cost and fit for their circumstances?
> Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior?
This seems to reduce the switching costs to almost nothing.
[1] https://news.ycombinator.com/item?id=36626943 https://news.ycombinator.com/item?id=36626943
- detente18 3y agoThose are really cool use-cases. I wrote a bit about our initial motivation for LiteLLM here - https://hackernoon.com/litellm-call-every-llm-api-like-its-openai https://hackernoon.com/litellm-call-every-llm-api-like-its-o.... tldr; reliable model switching involved multiple 100-line if/else statements, which made our code messy, and debugging in prod pretty hard.
- detente18 3y agoIf you'd like to add any of these ideas as notebooks to our cookbook - https://github.com/BerriAI/litellm/tree/main/cookbook https://github.com/BerriAI/litellm/tree/main/cookbook, we'd love the contribution!