5 ms·
Takeaway: >o1-preview is about on par with Anthropic's Claude 3.5 Sonnet in terms of accuracy but takes about 10X longer to achieve similar results to Sonnet.
by meowface 2y ago
Takeaway:
>o1-preview is about on par with Anthropic's Claude 3.5 Sonnet in terms of accuracy but takes about 10X longer to achieve similar results to Sonnet.
Scores:
>GPT-4o: 9%
>o1-preview: 21%
>Claude 3.5 Sonnet: 21%
>MindsAI: 46% (current highest score)
- deleted 2y ago[deleted]
- krackers 2y agoThere were rumors that 3.5 Sonnet heavily used synthetic data for training, in the same way that OpenAI plans to use o1 to train Orion. Maybe this confirm it?
- GaggiX 2y agoThe takeaway is also that o1-preview is a major improvement compare to GPT-4o. Anthropic is just ahead.
- Alifatisk 2y agoHow the hell is Anthropic this far ahead? I am yet impressed
- meowface 2y agoTrue. I've updated my post to include some of the scores.
- disgruntledphd2 2y agoIt's a little embarrassing for OpenAI though?
- dr_dshiv 2y agoI think they’d expect as much from Dario. He designed GPT3…
- attentive 2y agowho knows what MindsAI is?