3 ms·
This is bad, especially from a downstream dependency perspective. DSPy and CrewAI also import LiteLLM, so you could not be using LiteLLM as a gateway, but still
by eoskx 6mo ago
This is bad, especially from a downstream dependency perspective. DSPy and CrewAI also import LiteLLM, so you could not be using LiteLLM as a gateway, but still importing it via those libraries for agents, etc.
- nickvec 6mo agoWow, the postmortem for this is going to be brutal. I wonder just how many people/orgs have been affected.
- eoskx 6mo agoYep, I think the worst impact is going to be from libraries that were using LiteLLM as just an upstream LLM provider library vs for a model gateway. Hopefully, CrewAI and DSPy can get on top of it soon.
- benatkin 6mo agoI'm surprised to see nanobot uses LiteLLM: https://github.com/HKUDS/nanobot https://github.com/HKUDS/nanobot LiteLLM wouldn't be my top choice, because it installs a lot of extra stuff. https://news.ycombinator.com/item?id=43646438 https://news.ycombinator.com/item?id=43646438 But it's quite popular.
- flux3125 6mo agoI completely removed nanobot after I found that. Luckily, I only used it a few times and inside a docker container. litellm 1.82.6 was the latest version I could find installed, not sure if it was affected.