4 ms·
The aider benchmarks that swyx posted below suggest o1 is still better than r1 (though an oom more expensive). Interestingly r1+sonnet (architect/editor) wins t
by theptip 2y ago
The aider benchmarks that swyx posted below suggest o1 is still better than r1 (though an oom more expensive). Interestingly r1+sonnet (architect/editor) wins though.
This suggests r1 is indeed better at reasoning but its coding is holding it back, which checks out given the large corpus of coding tasks and much less rich corpus for reasoning.
- attentionmech 2y agoI love this paradigm of reasoning by one model and actual work by another. This opens up avenues of specialization and then eventually smaller plays working on more niche things.