3 ms·
The tool currently allows only one set of strong and weak models. I’d be really good to allow more than two models and change dynamically based on multiple con
by vatican_banker 2y ago
The tool currently allows only one set of strong and weak models.
I’d be really good to allow more than two models and change dynamically based on multiple constraints like latency, reasoning complexity, costs, etc.
- ModelBox 2y agoactually ModelBox(model.box) offers that, the autorouter function can dynamically switch to different models according to latency, geo-position and costs.
- KTibow 2y agoSome of that is already possible, since it can generate a difficulty score for a prompt that could be manually mapped between models based on ranges.
- voiper1 2y agoI think unify.ai (like openrouter) does that - it has several paramters you can choose from. But the underlying "how to choose a model that's smart enough but not too smart" seems difficult to understand.
- TechDebtDevin 2y agoIts just sentiment analysis.
- Oras 2y agoPortkey does that with configuration. You assign a base model, then add more models with weight to load-balance.