3 ms·
We're seeing diminishing returns in benchmark space, which is partly an artefact of construction, not an absolutely true commentary on how things are progressin
by energy123 1y ago
We're seeing diminishing returns in benchmark space, which is partly an artefact of construction, not an absolutely true commentary on how things are progressing.
- klabb3 1y agoWell yes but there is no better way to measure without resorting to pure hearsay. How would you make an accurate assessment of something so inherently vague?
- energy123 1y agoAlter the benchmark space that we care about, for example focus only on ARC-AGI-2 and then suddenly the gains are no longer diminishing but are accelerating.