4 ms·
Just a few months ago people were still talking about exponential progress. The fact that we’re already going for just linear progress is not a good sign
by wohoef 1y ago
Just a few months ago people were still talking about exponential progress.
The fact that we’re already going for just linear progress is not a good sign
- falcor84 1y agoLinear growth on a 0-100 benchmark is quite likely an exponential increase in capability.
- usaar333 1y agoExcept it is sublinear. Sonnet 4 was 10.2% above sonnet 3.7 after 3 months.
- GoatInGrey 1y agoWe should all know that in the software world, the last 10% requires 90% of the effort!
- baq 1y agoSublinear as demonstrated on a sigmoid scale is quite fast enough for me thank you.
- falcor84 1y agoThis got me thinking - is there any reasonable metric we could use to measure the intellectual capabilities of the most capable species on Earth that had evolved at each point in time? I wonder what kind of growth function we'd see. Silly idea - is there an inter-species game that we could use in order to measure ELO?
- theptip 1y agohttps://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ https://metr.org/blog/2025-03-19-measuring-ai-ability-to-com... We are still at 7mo doubling time on METR task duration. If anything the rate is increasing if you bias to more recent measurements.