3 ms·
Cerebras has OpenAI compatible "Qwen Code" support. ~4000 tokens/s. Qwen code's 480B param model (MoE) that's quite good. Not quite sonnet good, but speed is am
by scosman 1y ago
Cerebras has OpenAI compatible "Qwen Code" support. ~4000 tokens/s. Qwen code's 480B param model (MoE) that's quite good. Not quite sonnet good, but speed is amazing.
https://www.cerebras.ai/blog/introducing-cerebras-code https://www.cerebras.ai/blog/introducing-cerebras-code
- jascha_eng 1y agoCerebras is super cool. I wish OpenAI and Anthropic would have their models hosted there. But I guess supporting yet another platform is hard.
- arjie 1y agoWhen they announced this I went to try it and they only work with Cline really (which is what they promote there) but Cline has this VSCode dependency as far as I know and I don't really like that. I have my IDE flow and my CLI flow and I don't want to mix them. But you're right, they have an OpenAI compatible API https://inference-docs.cerebras.ai/resources/openai https://inference-docs.cerebras.ai/resources/openai so perhaps I can actually use this in the CLI! Thanks for making me take another look. EDIT: Woah, Charm supports this natively. This is great. I am going to try this now.
- dpkirchner 1y agoI'm using Cerebras's MCP with Claude Code and it works mostly OK. CC doesn't send updates through the MCP by default (as far as I can tell) so I have to add an instruction to CLAUDE.md to tell it to always send code creation and updates through the Cerebras MCP, which works pretty well.
- arjie 1y agoThis is an interesting idea. Since I have the subscription for the rest of a month, I'll give it a crack. Wasn't impressed by the Qwen-3 model, though.