4 ms·
New SOTA's on: SWE-Bench - 71.7 Competition Code - 2727 ARC (Semi Private Eval) - 75.7 on low, 87.5% on high compute Frontier Math (previous SOTA was 2%) -
by famouswaffles 2y ago
New SOTA's on:
SWE-Bench - 71.7
Competition Code - 2727
ARC (Semi Private Eval) - 75.7 on low, 87.5% on high compute
Frontier Math (previous SOTA was 2%) - 25% on high compute