3 ms·
Interesting. Immediate thoughts and questions: * How would human beings perform on the text-only version of the tasks given to GPT-4? * How would human beings
by cs702 3y ago
Interesting. Immediate thoughts and questions:
* How would human beings perform on the text-only version of the tasks given to GPT-4?
* How would human beings perform if each grid is shown on its own, making it impossible to perform side-by-side visual comparisons?
* How would human beings perform if each grid is shown on its own only once, making it impossible to perform any back-and-forth comparisons?
* How could we give LLMs the ability to "pay attention" to different parts of images, as needed, so they can make back-and-forth comparisons between parts of different images to solve these kinds of visual reasoning tasks?
- mistermann 3y ago* How would human beings perform if they didn't know they were being tested (ie: if in the same mode they are in when writing comments on the internet)? * How would human beings perform if the questions are based on culture war topics, which tend to invoke System 1 intuitive/emotional thinking?
- QuadmasterXLII 3y ago> How could we give LLMs the ability to "pay attention" to different parts of images, as needed, so they can make back-and-forth comparisons between parts of different images to solve these kinds of visual reasoning tasks? I’ve got good news
- YetAnotherNick 3y agoAlso I want to know how would know how much gain could be made by optimizing the prompt for GPT and by including things like CoT. Current version of the prompt is pretty bad both for humans and AI.