3 ms·
As a bit of a side note, I want to like Cerebras, but using any of the models through OpenRouter that uses them has lead to, too many throttling responses. Like
by sdesol 1y ago
As a bit of a side note, I want to like Cerebras, but using any of the models through OpenRouter that uses them has lead to, too many throttling responses. Like you can't seem to make a few calls per minute. I'm not sure if Cerebras is throttling OpenRouter or if they are throttling everybody.
If somebody from Cerebras is reading this, are you having capacity issues?
- gompertz 1y agoYou can get your own key with cerebras and then use it in openrouter. Its a little hidden, but for each provider you can explicitly provide your own key. Then it won't be throttled.
- omneity 1y agoWhy would you go through openrouter in this case?
- theshrike79 1y agoEasier to switch models
- scottyeager 1y agoHaven't seen any issues like this while using a key from their subscription plan: https://www.cerebras.ai/blog/introducing-cerebras-code https://www.cerebras.ai/blog/introducing-cerebras-code
- deleted 1y ago[deleted]