pawelk411

4 ms·

1. 1.▲
   by pawelk411 6mo ago

   Its below 1% lmao
2. 2.▲
   by pawelk411 6mo ago

   Yeah but thats literally above ASI, let alone AGI. Average human scores <1% on this bench, opus scores 97.1% when given an actual vision access, which means agi was long ago achieved
3. 3.▲
   by pawelk411 6mo ago

   Because it is. Opus 4.6 jumps from 0.0% to 97.1% when given visual input
4. 4.▲
   by pawelk411 6mo ago

   New benchmark idea: 20 questions of guess the number 1-10, with different answers. We run this on 10,000 humans, take best score. Then we take 50 ai attempts, but take the worst attempt so "worst case scenarior robustness or so".