4 ms·
I didn't plot it, but I had the impression the Aider benchmark success rates for SOTA over time were a hockey curve. Like the improvements between 60 and 70 fe
by k__ 1y ago
I didn't plot it, but I had the impression the Aider benchmark success rates for SOTA over time were a hockey curve.
Like the improvements between 60 and 70 felt much faster than those between 80 and 90.