5 ms·
You know, François Chollet literally did this, and people don't listen. People should listen to Chollet more. https://twitter.com/fchollet/status/1638643323748
by sanxiyn 4y ago
You know, François Chollet literally did this, and people don't listen. People should listen to Chollet more.
https://twitter.com/fchollet/status/1638643323748618240 https://twitter.com/fchollet/status/1638643323748618240
https://arxiv.org/abs/1911.01547 https://arxiv.org/abs/1911.01547
- cjbprime 4y agoIs ARC a benchmark that GPT-4 can be tested against today? I would be curious to see its results.
- sanxiyn 4y agoYes it is, and it was tested. GPT-4 can't solve any of the tests.
- famouswaffles 4y agoYes. However, The vision problems will require something much more than an image to text objective task. It will require the equivalent of an artificial visual cortex. We don't have that yet. For abstract analogical reasoning, LLMs don't have a problem with that. https://arxiv.org/abs/2212.09196 https://arxiv.org/abs/2212.09196
- famouswaffles 4y agoThat's not stuff an LLM can't do. It's just presented in a way that makes it difficult to do so. First the vision problems will require the equivalent of an artificial visual cortex, something we are seriously lacking in artificial intelligence at the moment. Image to text won't cut it here. For the text, LLMs don't really have any problem with analogical reasoning https://arxiv.org/abs/2212.09196 https://arxiv.org/abs/2212.09196