3 ms·
Is ARC a benchmark that GPT-4 can be tested against today? I would be curious to see its results.
by cjbprime 4y ago
Is ARC a benchmark that GPT-4 can be tested against today? I would be curious to see its results.
- sanxiyn 4y agoYes it is, and it was tested. GPT-4 can't solve any of the tests.
- famouswaffles 4y agoYes. However, The vision problems will require something much more than an image to text objective task. It will require the equivalent of an artificial visual cortex. We don't have that yet. For abstract analogical reasoning, LLMs don't have a problem with that. https://arxiv.org/abs/2212.09196 https://arxiv.org/abs/2212.09196