4 ms·
LLMRouter: An Open-Source Library for LLM Routing
- NickGarfinkel 9mo agoGreat concept! Have had to build some bare bones solutions to handle LLM routing but no reason I needed to roll my own. Planning to give this a go next time I run into that issue. Are you thinking about integrating smarter cost monitoring and reporting into routing as well?
- wendgeabos 9mo agoHow does it determine task complexity? Or is this a parameter the user passes in?
- itake 9mo agoI think the expectation is you provide your own training data for task complexity and the router trains a model for you.
- pehtran 9mo agoAmount of emojis makes me uncomfortable
- octoberfranklin 9mo agoYeah definitely gives off that "we generated this project with an LLM" smell.
- OutThisLife 9mo agomeh
- dist-epoch 9mo agoIt's a bit annoying that every AI library implements it's own protocol handlers for every provider - OpenAI, Google, Anthropic. I'm not talking about the routing part, thats cool, but about how you need to load the API keys in this library. We need something like Language Server Protocol, where we have a single openai library, a single gemini library, and all libraries use that.