Groq absolutely crushes on performance. You can try yourself on public chat https://chat.groq.com/ https://chat.groq.com/ mixtral-8x7B - 490T/s mistral-7B -

Groq absolutely crushes on performance. You can try yourself on public chat https://chat.groq.com/ https://chat.groq.com/ mixtral-8x7B - 490T/s mistral-7B - 860T/s