2 ms·
Mistral's partnership with Cerebras for inference hardware has received less commentary than I expected. They're basically blowing the competition out of the wa
by anon373839 2y ago
Mistral's partnership with Cerebras for inference hardware has received less commentary than I expected. They're basically blowing the competition out of the water, with Le Chat getting 1,100+ tokens per second of per-user throughput.
- lis 2y agoYes, I'm really impressed by the speed as well. A bit more about the collaboration can be found here: https://cerebras.ai/blog/mistral-le-chat https://cerebras.ai/blog/mistral-le-chat
- thih9 2y agoFor those that haven’t, best to see it yourself - it is visibly, significantly faster: https://chat.mistral.ai/chat https://chat.mistral.ai/chat
- Mekoloto 2y agoThats just crazy. I'm curious when someone will do the right experiment in a way that some LLM on Cerebras will do the reasoning so well so big so fast, that it does something very novel