3 ms·
no, sonnet 3.5 is #7 on LiveBench, even below DeepSeek V3.
by behnamoh 2y ago
no, sonnet 3.5 is #7 on LiveBench, even below DeepSeek V3.
- thegeomaster 2y agoThe parent comment was talking about coding specifically, not the average score. I see o1 at 69.69, and Claude 3.5 Sonnet at 67.13.
- sebastiennight 2y agoo1's score looks like exactly what I would expect Elon Musk to aim for with Grok's benchmarks