For ARC v1 it was found that it was much less resistant to brute force than intended/designed. This was improved in v2, which LLMs are currently doing less good

For ARC v1 it was found that it was much less resistant to brute force than intended/designed. This was improved in v2, which LLMs are currently doing less good at. Note also that ARC tasks are explicitly designed to be slightly-out-of-reach, things that are quite simple for humans, but current models are pretty bad at - designed to measure and enable progress. But yeah there are many interesting approaches, and ARC is interesting to follow both because it attempts to measure ability to adapt to new takas ("fluid intelligence"), and because we have not saturated it yet.