3 ms·
To pile on, they're also bad at games that are 2D text based environments. ARC-AGI-3 shows this: https://arcprize.org/arc-agi/3 https://arcprize.org/arc-agi/3
by iwhalen 4mo ago
To pile on, they're also bad at games that are 2D text based environments.
ARC-AGI-3 shows this: https://arcprize.org/arc-agi/3 https://arcprize.org/arc-agi/3
I've done some work as well on Rogue (sorry for self-promotion): https://iwhalen.github.io/rogue-bench/ https://iwhalen.github.io/rogue-bench/
- cubefox 4mo agoThere is no "2D text" processing when it comes to LLMs. They process text as ordinary, sequential 1D text only. And humans process "2D text" like any other 2D image. So 2D text isn't really a thing in any case. Saying LLMs are bad at 2D text is like saying that humans are bad at 2D audio.