3 ms·
OpenAI o1-preview is SOTA at 79.7% on the aider code editing leaderboard, with "whole" edit format. With the practical "diff" format, it ranks between GPT-4o &
by anotherpaulg 2y ago
OpenAI o1-preview is SOTA at 79.7% on the aider code editing leaderboard, with "whole" edit format. With the practical "diff" format, it ranks between GPT-4o & Sonnet.
80% o1-preview whole
77% Sonnet diff
75% o1-preview diff
75% Sonnet whole
71% GPT-4o diff