3 ms·
> Providers probably serve quantized versions without disclosing it It should be OpenRouter's responsibility to protect you against it, by regularly benchmarki
by joelthelion 22d ago
> Providers probably serve quantized versions without disclosing it
It should be OpenRouter's responsibility to protect you against it, by regularly benchmarking providers and giving you the control to avoid bad providers.
In fact, that's a big opportunity for them, since it justifies their place as a middleman between users and inference providers.
- ActivePattern 22d ago100% agree. The key issue is that users think they are getting results from a specific model configuration and they are clearly not, which is fraudulent. If OpenRouter wants to succeed as a business, they need to be auditing the providers they connect to (i.e. benchmarking) and removing fraudulent ones from their service.
- ipaddr 22d agoThey already succeed selling for 7 billion. Auditing is up to you and can be a new business for those looking for new opportunties.
- pessimizer 22d ago> by regularly benchmarking providers and giving you the control to avoid bad providers. Or by fining them, or getting rid of them altogether.