4 ms·
No, it was not. It was not better than o1, nor o1-pro. Yes, it was _cheaper_ than those models, and superior in price/performance if the performance was accep
by mwigdahl 2y ago
No, it was not. It was not better than o1, nor o1-pro. Yes, it was _cheaper_ than those models, and superior in price/performance if the performance was acceptable. But in terms of raw performance it was behind them.
- johnfn 2y agoChatbot arena leaderboard[1] says otherwise. 4o is ahead now, but that version of 4o was released after r1. r1 was ahead of all version of 4o and o1 at the time of release. https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leaderboard https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leade...
- mwigdahl 2y agoChatbot arena leaderboard is a good test for vibes and style of response, but not much else. R1's performance in objective benchmarks (coding, etc.) showed very good performance, granted, but inferior to the full o1 and o1-pro models. It's still a very impressive feat, but it wasn't frontier-pushing.