3 ms·
Arch-Router: Aligning LLM Routing with Human Preferences
- honorable_coder 1y agoThe core insight of decoupling route selection from model assignment is rooted in first principles engineering thinking. Someone recently wrote about their work in more detail here: https://medium.com/@dracattusdev/finally-an-llm-router-that-thinks-like-an-engineer-96ccd8b6a24e https://medium.com/@dracattusdev/finally-an-llm-router-that-...
- sparacha 1y agoHey! I built this. AMA. The model router is built into the proxy layer here: https://github.com/katanemo/archgw https://github.com/katanemo/archgw