4 ms·
Grok 3 at the top of Chatboat Arena with 1400, and the model will continue to improve as it trains more.
by Rover222 2y ago
Grok 3 at the top of Chatboat Arena with 1400, and the model will continue to improve as it trains more.
- Rover222 2y ago[flagged]
- rvz 2y agoNo idea why was this downvoted, but you are correct. Seems like the team at xAI caught up very quickly to OpenAI to be at the top of the leaderboard in one of the benchmarks and also caught up with features with Grok 3. Giving credit where credit is due, even though this is a race to zero.
- Rover222 2y agoYeah, so many people aren't capable of talking about anything Musk-adjacent with clear thoughts. It's insane how quickly xAI went from not existing, to the top of the benchmarks.
- nhod 2y agoI'm not sure what you mean here? Musk has a history of doing both incredibly useful and cool things, and also incredibly dumb, cruel, and for some people even terrible things. That context should be part of any clear thinking around him. He does not get a clean slate in every new discussion of him. There are widespread, legitimate concerns about what kind of person Elon Musk is turning out to be. There is a lot of chatter about fears of China's AI rise, but what happens if we get Elon's brand of cruelty and lack of empathy in an authoritarian superintelligent AI ? Is that the AI future we want? Can you imagine an SAI with real power that interacts with people like Elon does on Twitter? I am not sure that is a future I want to live in.
- Rover222 2y agoWe’re trying to talk about the capabilities of Grok and you can only focus on Musk. That’s what I’m talking about.
- spiderfarmer 2y agoDon’t defend a persona over substance. His concerns are valid and relevant to the discussion.
- notfromhere 2y agoIt’s relevant to the subject since he owns it.
- FranzFerdiNaN 2y agoYou cant see this separate from Musk. Musk isnt a business as usual type.
- nozzlegear 2y agoThere would be no Grok without Musk, any discussion of Grok is going to involve discussion of Musk as well.
- dkjaudyeqooe 2y agoI think people here are thinking very clearly about Musk and his various projects. Not sure about people elsewhere though.
- concordDance 2y agoDepends what you mean by "people here". I mean, obviously the majority of HN commentators and even the majority of commentators on this thread seem to be. But there will always be a couple of slightly unhinged folk in a big enough group of readers.
- ks2048 2y agoCan't you just take DeepSeek and put it behind an API and get to the top of the benchmarks immediately?
- sinuhe69 2y agoWe got more emotional and opinionated people on HN and they often reacted in an emotional way instead of using logic and being curious.
- darthrupert 2y ago[flagged]
- 1024core 2y agoAnd Anthropic not even in the top 10 ...
- deleted 2y ago[deleted]
- 3abiton 2y agoI keep hearing about Claude's impressive coding skills (compared to its benches) yet, not evident for me (I use the web version, not cline). Compared to 4o it's not that great.
- zurfer 2y agoMy pet theory is that Sonnet was trained really cleverly on a lot code that resembles real world cases. In our small and humble internal evals it regularly beats any other frontier models on some tasks. The shape of capability is really not intuitive/1 dimensional
- anti-soyboy 2y agoLol no company is making money using 4o, however thanks to claude sonnet programms like Cursor are usable lol. 4o agents suck, just try it instead of talking
- 3abiton 2y agoI did try it yet for more than a week still 4o still pretty much better in terms of python coding and architecture/documentation design
- throwaway314155 2y agoThat doesn't match my experience at all.
- Alifatisk 2y agoI can honestly tell you from my experience that Sonnet 3.5s coding skills did things no other models did right last year during the summer, this was even though the benchmarks showed that it wasn't the best performing at coding tasks.
- riku_iki 2y agoAnd DeepSeek is just 3% behind. It seems in that benchmark all LLMs perform well and top is formed within some statistical error.
- rvnx 2y agoIt could also be that they got "inspired" by DeepSeek, hence the very similar results. So it could be that their success is mostly about taking an open and free thing, and turned it proprietary.
- torginus 2y agoThese percentage points don't mean anything. Look up how the Elo system works. They just add 1000 to the result to make it a nicer number.
- DonHopkins 2y agoYou know what they say: Fascists are good at keeping the training runs on time.