4 ms·
I don't think you are reading the table correctly. On LMSYS it's better than all models except the latest Gemini 1.5 Pro and GPT-4o. But there is a detailed ben
by modeless 2y ago
I don't think you are reading the table correctly. On LMSYS it's better than all models except the latest Gemini 1.5 Pro and GPT-4o. But there is a detailed benchmark table and different models win different benchmarks.
So results are mixed, but the real takeaway is this is a competitive model that is good enough to be worth using today. It puts xAI significantly above their previous position, and up near the top of the field with OpenAI, Anthropic, Google, and Meta. And their new H100 cluster should allow them to keep up with the next wave of releases, whenever that starts.