4 ms·
This is the least true thing ever. All LLMs are terrible at ARC-AGI-3. Every video game can be used as a benchmark. You could rank LLMs on how long they can kee
by UltraSane 7mo ago
This is the least true thing ever. All LLMs are terrible at ARC-AGI-3. Every video game can be used as a benchmark. You could rank LLMs on how long they can keep a game of Dwarf Fortress running or how fast they can beat GTA5.
- ttoinou 7mo agoWe already have specialized AI to play video games
- UltraSane 7mo agoWe are talking about LLMs. a true AGI would be able to beat every video game.
- conception 7mo agoUntil Arc-Battletoads is passed I’m not buying it.
- UltraSane 7mo agoMore like ARC-SegaMasterSystem-ALF
- casey2 7mo agoARC-AGI-3 appears to already be saturated [0] [1] For some reason they refuse to run this on the private set, likely because it's all just a ploy to pump OpenAI [0] https://arcprize.org/leaderboard/community https://arcprize.org/leaderboard/community [1] https://blog.alexisfox.dev/arcagi3 https://blog.alexisfox.dev/arcagi3