3 ms·
you're doing model routing - any thoughts on https://github.com/lm-sys/RouteLLM https://github.com/lm-sys/RouteLLM and Martian? hope you dont raise funding bef
by swyx 2y ago
you're doing model routing - any thoughts on https://github.com/lm-sys/RouteLLM https://github.com/lm-sys/RouteLLM and Martian?
hope you dont raise funding before you figure out what they haven't
- ieuanking 2y agowe have looked at route llm and played with it but we felt like they were focusing on cost minimization, we think theres more work to be done in focusing on routing for the best possible output without the cost constraint. Also just trying to provide easy ways for people to use tools like route llm that dont require coding knowledge. That being said we def wanna release a benchmark of our routing in comparison to some of the pre-trained defaults in route llm
- swyx 2y agocool. its a very small distinction in my mind to flip from one to the other. all the best.