3 ms·
Don't Put All Your Tokens in One Basket
- turtleyacht 3mo agoHow do you prepare the fallback if it already took tokens to query the simpler model?
- rafaelnexus 3mo agoI don't know if I understood your question.
- deleted 3mo ago[deleted]
- plumman1 3mo agodon't litellm and similar do this already?
- rafaelnexus 3mo agoAbsolutely, a pretty good one.
- santiago-pl 3mo agoActually, LiteLLM is the most popular, it was first product of this type, but there is plenty of more efficient and reliable alternate AI Gateways right now. I've written one - GoModel. https://gomodel.enterpilot.io/ https://gomodel.enterpilot.io/