4 ms·
> the fact that I have no idea (as a non-AI-researcher) what benchmark this is The figure labels it as as "average score [on] 6 multimodal reasoning benchmarks
by Ukv 2y ago
> the fact that I have no idea (as a non-AI-researcher) what benchmark this is
The figure labels it as as "average score [on] 6 multimodal reasoning benchmarks", and the caption notes that the full results are in table 7 - which lists those benchmarks: MMStar-R, MMBench-R, MMVet-R, MathVista, AI2D, Hallusion
I think it's mostly fine as a lead diagram giving an overview before going into detail.
- nerdponx 2y agoRight, I don't need to know what they are, I just need to know what "64" means. Is the baseline actually 0? That detail is enough to avoid actually drawing 0 on the axis.