4 ms·
I always plug openrouter.ai for making cross-model comparisons. It's my general goto for random stuff. (I am not affiliated, just a user)
by mcbuilder 2y ago
I always plug openrouter.ai for making cross-model comparisons. It's my general goto for random stuff. (I am not affiliated, just a user)
- pickettd 2y agoI love the idea of openrouter. I hadn't realized until recently though that you don't necessarily know what quantization a certain provider is running. And of course context size can vary widely from provider to provider for the same model. This blog post had great food for thought https://aider.chat/2024/11/21/quantization.html https://aider.chat/2024/11/21/quantization.html
- avereveard 2y agoTo expand a little, some providers may apply more aggressive optimization in periods of high load.