4 ms·
arc agi isnt testing a models ability to store files and code things. its testings its ability to reason through puzzles given the same information as a human
by anthonypasq 6mo ago
arc agi isnt testing a models ability to store files and code things. its testings its ability to reason through puzzles given the same information as a human
- knollimar 6mo agoif you tested my ability to reason and you gave me some challenging problems that involved arithmetic, it might be a better test if you gave me a scratch pad so I don't mess up the reasoning parts by failing arithmetic.
- falcor84 6mo agoBut that's the thing, as a human faced with a problem I'd often say "Sure, just let me get a pen, some paper and a calculator". Why shouldn't we make it easy for AIs to use their tools of choice?