2 ms·
You don't need to include 0 on every axis. In this case they really made the numbers smaller than they should be, so it's hard to see that the scale is on the
by nerdponx 2y ago
You don't need to include 0 on every axis.
In this case they really made the numbers smaller than they should be, so it's hard to see that the scale is on the order of single digits. It looks like this is about a 3-4% improvement over GPT-4o-mini and Gemini Pro 1.5.
The bigger problem here is not the axis baseline, but the fact that I have no idea (as a non-AI-researcher) what benchmark this is, or if 0 is even the natural minimum. The caption should at least mention what the natural range of the x-axis is.
- Ukv 2y ago> the fact that I have no idea (as a non-AI-researcher) what benchmark this is The figure labels it as as "average score [on] 6 multimodal reasoning benchmarks", and the caption notes that the full results are in table 7 - which lists those benchmarks: MMStar-R, MMBench-R, MMVet-R, MathVista, AI2D, Hallusion I think it's mostly fine as a lead diagram giving an overview before going into detail.
- nerdponx 2y agoRight, I don't need to know what they are, I just need to know what "64" means. Is the baseline actually 0? That detail is enough to avoid actually drawing 0 on the axis.