3 ms·
My one big problem with OpenRouter is that, as far as I can tell, they don't provide any indication of how many companies are using each model. For all I know
by simonw 1y ago
My one big problem with OpenRouter is that, as far as I can tell, they don't provide any indication of how many companies are using each model.
For all I know there are a couple of enormous whales on there who, should they decide to switch from one model to another, will instantly impact those overall ratings.
I'd love to have a bit more transparency about volume so I can tell if that's what is happening or not.
- minimaxir 1y agoGranted, due to OpenRouter's 5.5% surcharge, any enormous whales have a strong financial incentive to use the provider's API directly. A "weekly active API Keys" faceted by models/app would be a useful data point to measure real-world popularity though.
- eli 1y agoThey kinda have that already, no? https://openrouter.ai/apps?url=https%3A%2F%2Faider.chat%2F https://openrouter.ai/apps?url=https%3A%2F%2Faider.chat%2F
- minimaxir 1y agoAggregating by tokens causes the problem simonw mentions in that one poweruser can skew the chart too much.
- simonw 1y agoRight, that chart shows App usage based on the user-agent header but doesn't tell you if there is a single individual user of an app that skews the results.
- __mharrison__ 1y agoI was skewing the Gemini starts with my Aider usage. Basically the only model in using with openrouter, until I recently started running qwen3-next locally. 2.5 is probably the best balance for tools like Aider.