3 ms·
OpenRouter-served models are often more heavily quantized than what you can run locally, or try for yourself on generic cloud-based infrastructure.
by zozbot234 6mo ago
OpenRouter-served models are often more heavily quantized than what you can run locally, or try for yourself on generic cloud-based infrastructure.
- Computer0 6mo agoI just choose a specific provider so it's not switching all the time.