3 ms·
> That's fine if you want to measure sample efficiency, but ARC-AGI is supposed to measure progress towards AGI. On the Measure of Intelligence defines intelli
by trott 2y ago
> That's fine if you want to measure sample efficiency, but ARC-AGI is supposed to measure progress towards AGI.
On the Measure of Intelligence defines intelligence as skill-acquisition efficiency, I believe, where efficiency is with respect to whatever is the limiting factor. For each ARC task, the primary limiting factor is the number of samples in it. And the skill here is your ability to convert inputs into the correct outputs. In other words, in this context, intelligence is sample-efficiency, as I see it.
- YeGoblynQueenne 2y agoIs that what fchollet is claiming?
- trott 2y agoNot sure. But I think this follows logically from the definition of intelligence he is using. Also, see II.2.2 in the paper.