4 ms·
Human performance is much closer to 100% on this, depending on your human. It's easy to miss the dot in the corner of the headline graph in TFA that says "STEM
by 6gvONxR4sf7o 2y ago
Human performance is much closer to 100% on this, depending on your human. It's easy to miss the dot in the corner of the headline graph in TFA that says "STEM grad."
- tim333 2y agoA fair comparison might be average human. The average human isn't a STEM grad. It seems STEM grad approximately equals an IQ of 130. https://www.accommodationforstudents.com/student-blog/the-subjects-with-the-highest-iqs https://www.accommodationforstudents.com/student-blog/the-su... From a post elsewhere the scores on ARC-AGI-PUB are approx average human 64%, o3 87%. https://news.ycombinator.com/item?id=42474659 https://news.ycombinator.com/item?id=42474659 Though also elsewhere, o3 seems very expensive to operate. You could probably hire a PhD researcher for cheaper.
- jeremyjh 2y agoWhy would an average human be more fair than a trained human? The model is trained.