there's RouteLLM: https://github.com/lm-sys/RouteLLM https://github.com/lm-sys/RouteLLM nvidia has LLMRouter https://build.nvidia.com/nvidia/llm-router https:/

there's RouteLLM: https://github.com/lm-sys/RouteLLM https://github.com/lm-sys/RouteLLM nvidia has LLMRouter https://build.nvidia.com/nvidia/llm-router https://build.nvidia.com/nvidia/llm-router llama-index also supports routing https://docs.llamaindex.ai/en/stable/examples/low_level/router https://docs.llamaindex.ai/en/stable/examples/low_level/rout... semantic router seems interesting https://github.com/aurelio-labs/semantic-router/ https://github.com/aurelio-labs/semantic-router/ you could also just use langchain to route https://jimmy-wang-gen-ai.medium.com/llm-router-in-langchain-fd503ece1195 https://jimmy-wang-gen-ai.medium.com/llm-router-in-langchain... interesting paper PickLLM: Context-Aware RL-Assisted Large Language Model Routing https://arxiv.org/abs/2412.12170 https://arxiv.org/abs/2412.12170