3 ms·

The lead has been taken over by Xai already as far as I know. They seem to have 100k H100's up and running. OpenAI is not really leading the LLM world anyway e

• belter 2y ago
  > OpenAI is not really leading the LLM world anyway ever since Claude sonnet 3.5 came out. Something many times repeated. It just takes a few minutes with the different models to find out it's not true.
  • csomar 2y ago
    I'd say it's 50/50 at the moment. Half the times, sonnet gives a definitive and better answer.
  • daghamm 2y ago
    I usually use them side by side, and very often (not always) Claude is better.
  • mnky9800n 2y ago
    I think the main issue with these metrics, which you implicitly highlight, Is that they are not a one size fits all approach. In fact, they are often treated, at least casually, like they are some kind of model fit like an r squared value. Which is maybe a good description narrowly constrained to the task or set of tasks they are being evaluated on for the metric. But the complexity of the user experience combined with the poor sample rate that a person can individually experience leads to conclusions like these. And they are perfectly valid conclusions. If the model doesn’t work for you, why use it? But it also suggests that personal experience cannot be used to decide if the model performs in aggregate well or not. But this doesn’t matter to the individual user or problem space. Because they should of course use whatever works best for them.